Rajdeep will be presenting the following session
Rajdeep varma - The Joy Of Green Builds - Running Tests SmartlyRajdeep varmaAutomation LeadBumble
schedule 1 year agoSold Out!
So you have got a few UI tests and they are running in parallel, great! However, life will not be so sweet once these 'a few' turns into 'a lot'. We grew from a few to 1500 UI tests (although not particularly proud of this number, there are situations and reasons)
We started with a simple parallel distribution of tests 3 years ago. As test count increased failure count run time increased along with increased flaky tests. Mobile tests had their own challenges (eg. device dropping-off, random wi-fi issues, etc) To keep up with this, we created a queue and workers based solution which could distribute the tests more efficiently (https://github.com/badoo/parallel_cucumber). Over time, we made more improvements, in particular:
- Segregation of failures based on infrastructure issues and re-queue the tests
- If a device/emulator malfunction, rescue the tests to another device
- Repeating a single test on 100s of the worker in parallel to detect flakiness
- Repeat a test if a known network issue
- Terminating the build early if more than a certain number of tests have failed
- Health check of each device, before each test to ensure reliability
- Muting a test if failure is known, and highlight outdated mutes if the related task is fixed
In this talk, I will talk about the initial challenges with running UI tests in parallel (Selenium and Appium), how we approached the queue based solution and continuous improvement of this solution; finally, how attendees can use it at their workplace or create their own solution based on our learnings.
1. What got you started/interested in Testing?
A coincidence. I started as manual testing but developed a keen interest in coding and switched to test automation.
2. What has been your best moment/highlight working with Selenium?
The best moment is my very first use of driver.navigate.to "http://google.com" And a browser popping up magically, Wow!
3. What do you think is the biggest challenge faced by Software Testers today?
Accepting the change. More and more QA jobs are demanding hands-on technical skills and it's new normal. The software world is demanding testers with strong technical knowledge
4. What is your advice to testers, who are new to automation?
1. There is no escape from Coding
2. Coding is easy
3. Work on a real automation project. If you don't have the opportunity in your organization, search for an open-source project. Create your own automation frameworks and get them reviewed from some mentor
4. You will not be perfect from the very beginning, it will take years, still, you will never be "Perfect" :)
5. Tell us about the session(s) you will be presenting at the conference and why did you choose those topics?
I will be talking about how automation engineers can see their tests passing even with the unstable infrastructure and flaky tests. Three are various smart ways we have tried and tested in my organization to achieve this. This will not be super technical, but there will be a little bit of code and a demonstration
6. What are some of the key takeaways from your session(s)?
Both, speed and stability of tests are important. If you attend this session, you will get to know some smart solutions to achieve them
7. Which sessions are you most looking forward to attending at Selenium Conf?
The entire list of talks in the schedule is amazing and I will attend whatever I can and I will watch the videos of the talks that I miss. However, I will not miss these talks
Narayan Raman - A Tale of Two Automation Tools
Ivan Krutov - Master-class: Bulletproof Selenium cluster
David Burns - Selenium: Giblets and all
Krishnan Mahadevan - My experiments with Grid
8. Any personal message/remarks you want to share with the Testing community in Asia?
Come and say 'Hi', we can have a chai together