Machine Learning Software Engineering Patterns and Their Engineering
Implementing Test Automation: What a Manager Should Know
1. IMPLEMENTING TEST
AUTOMATION –
WHAT A MANAGER SHOULD KNOW
Tuesday, February 16, 2016
8 AM PST/4 PM BST/5 PM CEST
Oleksandr Reminnyi
webinar webinar@softserveinc.com
3. webinar@softserveinc.comwebinar
• Are existing manual processes stable enough to automate?
• Are the targeted applications suitable candidates for
automation?
• What return on investment can be expected?
• Will the automation baseline be maintainable with the
company's current efforts and resource skill sets?
• Is your client willing to invest into automation
AUTOMATION READINESS
5. webinar@softserveinc.comwebinar
Quick and Dirty (Q&D)
TEST AUTOMATION GOALS
Solution-based (S-b)
• Click-click and production
• Immediate benefit
• Should be deprecated
soon
• Environment dedication
• Framework setup
• Long term supportability
• Continuous maintenance
orientation
6. webinar@softserveinc.comwebinar
• With Q&D – to gain immediate benefit – any applicable
resources
• With S-b – one senior person per direction/project/platform
• Technology/language is not so important
STAFFING
8. webinar@softserveinc.comwebinar
Services
UI2UI UI3 DB
Test script
Test script
Test script
TEST AUTOMATION
Each test script cares about each possible interface it is supposed to access.
This leads to code duplication, because many scripts access same interfaces.
9. webinar@softserveinc.comwebinar
• Smoke test suite
• Regression test suite
• Never set up 100% automation goal
• Things hard to do manually
• Frequently repeated
SCOPE FOR TEST AUTOMATION
11. webinar@softserveinc.comwebinar
• For Q&D
– just do it
• For S-B:
– Tool selection
– Architecture definition
– Integrations with dev environment
WHAT IT TAKES FOR Q&D OR S-B
12. webinar@softserveinc.comwebinar
• What we have in house?
• What we have open source?
• What market leaders are there in my area?
TOOLS
Tool is not a solution but only one of the means to build the solution.
14. webinar@softserveinc.comwebinar
Legend:
Blue – Automation development
and maintenance efforts
Orange – Planned regression
manual efforts
Green – Time savings
RETURN OF INVESTMENT
Facts:
Era of constant movement to
continuous delivery and
deployment
Number of release cycles per
quarter is rising
Test automation can increase
number of regression runs per
period and at the same time –
decrease time spent on quality
16. webinar@softserveinc.comwebinar
PLAN AUTOMATION WITH AN EXPERT
One Time Activity Iterative
Plan Design Develop MaintainExecute
• Re-facctor manual
tests to be ready
for test
automation
• Framework design
• Plan reusable
libraries
• Define other
abstractions
layers
• Data management
plan
• Review app road
map
• Review manual
test cases
• Verify testability
• Selection of
automation
candidates
• Define test
strategy
• Create test scripts
• Data management
• Build execution
flow
• Recovery
scenarios
• Add to function
libraries
• Tool extensions
• Repository
management
• Documentation
• Create new test
enviroment
• Deploy test suite
• Execute test
scripts
• Results reporting
• Defect
management
• Update assets
• Archive test suite
• Maintain test suite
• Regression tests