Our client is a 108 year old organization, who is the world’s authority for chemical and scientific information. The application is an online portal with 75 million substances providing the global scientific community with access to the most current chemical and related scientific information available immediately through databases.
Application is an online database portal where scientists, academicians and professionals can log in, search & gather information on chemicals using names, reactions and other related information.
Client has never worked with an IT offshore vendor. Client had to overcome the reluctance to IT outsourcing.
“We totally understand it is a holiday weekend for everyone there and appreciate your willingness to take this assignment on with fewer staff…… Your summary is particularly helpful as well… We appreciate your efforts in accommodating this special assignment, you guys rock, as always”
– QA Manager
Test Lab Setup: With the understanding of the test requirements, we prepared a test plan with the test strategy.
Our team set up the test lab with the latest trending OS and Browsers – Windows 60% and Mac OS 40% with the compatible JRE for each of the browsers.
Jump Start Kit: To ensure there were no major issues in the requested OS and browsers combinations, our expertise performed a quick smoke test and maintained a Jump Start kit with recording of known failure patterns across browsers.
With the given set of test cases, we performed test execution. To ensure no deviation in the schedule, test progress was monitored. As more new versions of browsers were tested, repository with compatibility checklist and defect failure patterns was updated frequently.
Test Management: Open source tools were used for test progress, defect management and configuration management. Using Quality Center, communication, test management was performed.
With User Experience testing, we recorded the responses times across various test scenarios.
Product Knowledge: Our Strong product knowledge helped us to proactively monitor the module changes based on the change requests.
We could identify the modules that needed additional focus. To support scripted testing for increased test coverage, 20% exploratory testing was performed.
Defect Knowledge: For supporting the defect triage with the onsite team, we maintained a defect log in Quality Center and additional clarifications notes.
Root Cause Analysis was performed to identify the key origin of the defect which helps the onsite team to address the source.
Reporting: We consolidated the defects and prepared test summary marking the failures across the requested test combinations.
We ensured delivery in line with the customer expectations ahead of Release.
Process: Streamlined process was aligned to the testing objectives. On each iteration compatibility (60%) and regression (40%) testing was performed.
To ensure streamlined operations and uninterrupted delivery, continuous process improvement was maintained.
Test Executions & Defect Catch Rate: With the same delivery timeline, execution ramped up from 800 to 1200. 30% more test executions performed in a week in 30-35% lesser time.
During the initial days of engagement, delivery cycle was 9 days. However, with the increase in the test executions from 800 to 1200 per week, streamlined process helped to reduce the delivery cycle to 5 days. Now with 1500 test executions per week, the delivery time line is 4 days.
Defect catch rate was improved by 18% and the quality index is now at 24%. Exploratory testing helped us to concentrate on the defect prone areas and unveiling more defects.
Our team had quick clarification and collaborative triage with the onsite team.
Identifying the pain areas based on compatibility results. We escalate it to the client to prioritize their development tasks.
Communication: With the help of Skype, Inter team communications happened. WhatsApp group helped quicker message communication within the team.
Streamlined communication happened between the onsite team and extended team.
Team was divided into small internal teams for delegation and assignment of tasks. To share technical knowledge, improve communication skills and for developing the team spirit, internal teams had weekly meetings.
We have helped our client with capacity planning and technology consulting to give them the right direction they need. With our Transaction based pricing model, our clients was able to predict budget and reduce risk involved in the assignment.
A trained pool of resources on the product is maintained and ramped up on need basis. Jump start KT helps for faster transition.
By reducing the compatibility testing overheads, we saved 50% – 60% thereby increasing the testing ROI. Dedicated infrastructure with multi OS systems helps in easier maintenance and helps to reduce the cost on frequent updates.
We kicked-off this project with an 8 member team focusing only on compatibility testing. Over a period of time, we have ramped up the team size to 24 in order to additionally offer regression and user experience testing.
The performance report on OS/Browser compatibility matrix was prepared. With top performing browsers based on the product response times recorded and reported helped to identify the bottlenecks of the reported modules.
We developed and maintained high level test cases to perform additional coverage. Module based SME observe the changes across modules. RCA on the defects found done by the SME to address the origin.
Including the extensibility to mobile platforms, we provided end to end compatibility solutions. Based on upcoming market releases and defect trends, we uggested the test matrix to the customer.