A sturdy test automation framework is the most important integrant that helps testers with guidelines or protocols to leverage reusable automated tests rapidly and reliably to achieve the desired testing goals. So what happens when an organization fails to have a robust framework? Without a framework in place, automating more scripts, in the long run, will be a complicated, expensive, and time-consuming task since the need for manual intervention is required frequently. As forerunners, we developed a Selenium Grid-based automation framework called AFTA ( Versions: AFTA 2.0 and AFTA 3.0) that is optimum, homegrown, open-source that focuses mainly on performing Functional Testing effectively and leverages the functional automation tools to conduct Non-Functional Testing.
AFTA 2.0 in a Nutshell
It is a dynamic framework for Test Automation requirements that effectively conducts all aspects of functional testing and leverages the best functional automation tools to conduct non-functional testing successfully. AFTA 2.0 was designed based on the technology needs and modifies the parameters according to the current trend in the market. It helps the testing teams to manage multiple automation components under a single framework and integrates easily with any cloud-based browser and device infrastructure service provider. Its capability to integrate test automation with continuous integration tools is nothing less of an ideal solution for all the deploying and integration challenges that the testing teams face widely. It also offers seamless integration with Continuous Integration tools like Jenkins, Bamboo, and MS build.
Features of AFTA 2.0
More effective usage of our test automation framework results in a large return on investment along with:
- Early defect detection by shifting left the testing cycle
- Improved application stability and enhanced test coverage
- Reduced test cycles resulting in cost savings
- Improved resource utilization and productivity
- Less piling up of defects
- Drive testing on par with the pace of development and delivery
What was missing in AFTA 2.0?
No matter how efficient or successful an approach or solution is, there always comes a time when there is a need to change or update to cope with the emerging new technologies and customer expectations. AFTA 2.0 was not an exception. For instance, during the runtime, when the elements are prerecorded and if any script should be executed or any new build to be deployed or trigger the scripts in that environment, based on the predefined elements locators provided in the framework, it will launch the application and identify whether the locators are available or not. It is not capable of identifying the locators. Another major downside is that in the agile methodology, where the development and testing teams work simultaneously, the changes made in the later sprints are not reflected in the previous sprints because of the absence of StabilizerJS. The need to address the testing and scripting challenges necessitates that the framework undergoes reinvention to make it more relevant and fit in the latest software development approaches and technologies. The following are the list of challenges that both the versions are capable of addressing:
|Features||AFTA 2.0||AFTA 3.0|
Systems & Technologies
|Frequent Code Deploys||Yes||Yes|
|Multiple Scripting Languages||Yes||Yes|
|High Effort For Non-Functional Testing||Yes||Yes|
|Frequent UI Element Properties Changes||No||Yes|
|Complex Report Analysis On Execution Report||No||Yes|
|Self-healing Scripts to Identify Changes||No||Yes|
|Auto Analysis of the Test Automation Results||No||Yes|
|Live Streaming of the Test Results with Intelligence||No||Yes|
What is AFTA 3.0?
The AFTA 3.0 (Beta) version is implemented with advanced functionalities using AI and ML and integrated with AFTA . This modernized version of the homegrown test automation framework helps organizations perform test automation along with the development phase to eliminate any last-minute error detection. The framework is intended predominantly for Agile and DevOps driven environment that allows to overcome the challenges of the conventional methods of testing and providing the best possible customer experience. This becomes practical through reasoning, problem-solving, and machine learning based on the repetitive patterns to identify and rectify issues immediately.
What makes it Unique?
AFTA 3.0 comprises of StabilizedJS that can automatically heal the test scripts during the test execution when the UI element properties change. It provides the flexibility of a data-driven approach identifying essential needs of data portability and abstraction by providing components to access data available in various data sources like Excel, CSV, XML, and DB. Parallel and distributed execution are taken to the next level through TestNG, Grid which can easily address the challenges on the turnaround of script execution and test environment cost to a significant level. AFTA 3.0 provides essential components to run the same scripts in cloud browser and mobile infrastructures, cross-browser testing, etc. We decided to include the AI component in AFTA 2.0. But why AI? AI is the most transformative technology available today and implementing AI in test automation results in greater improvement of the testing team’s productivity. The other impacts of AI-led automation in AFTA 3.0 are:
- Self-healing Scripts to Identify Changes in the Application
- Auto Analysis of the Test Automation Results
- Reduced Script Maintenance
- Easy Integration with any Selenium-based Application Project
- Defect Analytics for High Degree of Reliability
- Auto Update of Defects in Defect Tracking Tool
- Build Analytics on the Previous Runs
- Live Streaming of the Test Results with Intelligence
- Frequent UI Element Properties Changes
- Complex Report Analysis On Execution Report
AFTA 3.0 is an advanced automation framework that supports functional, non-functional, API and mobile testing. Since it is a plug and play framework it can be implemented and used from day one. The framework allows users to choose between the behavioral driven and test-driven method of automation and capable of integrating with many test management tools like JIRA, TestLink which provides a repository of all the document requirements and results. Since all the necessary data are available in one place it helps the testing teams to be more agile towards the entire process. Also, AFTA 3.0 can easily integrate with JMeter and OWASP to avoid any kind of performance slowdown or security vulnerability. The availability of reusable components in the framework accelerates the scripting process by up to 35% than what was earlier.
Some of the major benefits of adapting AI-led framework are:
- Supports end-to-end testing
- Provides real-time analytics
- Facilitates Continuous Integration
- Integrates to SOAP UI, Jmeter, OWASP ZAP
- Reuse automation scripts
- Integrate with web, mobile testing, and cross-browser testing
- Reduce automation effort by 40%
The best part is its compatibility to synchronize with any mobile web like different IOS versions and old or latest versions of Google Chrome and Safari without having to add additional lines of code. The parallel execution helps businesses, especially the testing teams to understand the behavior of the product in various real-time devices to minimize the error occurrences when delivered finally. It also encompasses a cloud-based testing approach that takes automation and continuous delivery to the next level and upholds organizations’ reputation in the digital market.
Latest posts by Christina Sridhar (see all)
- Introduction to Next-Gen AI-Led Test Automation Framework: AFTA 3.0 - February 19, 2020
- Performance Engineering Solutions – The Next Big Thing in Software Testing! - February 5, 2020
- The Next Big Thing in Retail Test Automation: DCqaf - January 29, 2020