SlideShare une entreprise Scribd logo
1  sur  97
Measuring Quality
Release Readiness Criteria and
Quality Reporting
22
11 Years general working experience in IT/QA (30+ projects)
----------
•QA Consultant at Ciklum Interactive
•QA Manager (Manual)
•Automated Testing Manager
•Load Testing Manager
•Project Manager
----------
•Hobbies: Job, Wife and 2 children, Sport
----------
Skype: vladimir.primakov
Linkedin: ua.linkedin.com/in/vladimirprimakov/
Email: v.v.primakov@gmail.com
Some Words About Me
Volodymyr Prymakov (Vladimir Primakov)
33
The presentation will cover the following items:
• Release Readiness criteria as a part of a master test plan, their
types and details. (~ 30 min)
• Release readiness criteria appliance and areas of influence. (~ 5
min)
• Quality report and quality metrics + their connection to release
readiness criteria. (~ 15 min)
• Concluding release readiness. (~1 min)
• Questions (~ 10 min)
Presentation’s Structure
Presentation Plan
44
Release Readiness Criteria as a part of Master Test Plan
Release Readiness Criteria
Master Test Plan
55
Categories of Release Readiness Criteria
Analyzing Quality
(RESULTS)
Catching Quality
(ACTIVITIES)
1. New Functionality Testing
2. Regression Testing
3. Test Environments Testing
4. Unit & Integration testing
5. Special Types of Testing
66
Any Ideas?
Criteria for New Functionality Testing
77
Short Example
Criteria for New Functionality Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Functionality
Priority
Minimum Test
Deepness
Minimum
Functionality
Coverage
Maximum
Fail Rate %
The Highest one 100% Features of Any
Priority
Detailed
Exploratory
testing
100% 0%
High 100%
(all high priority
test
environments)
All priorities Happy path
Exploratory
testing
100% 0%
Medium Please See test environments related criteria
Low Please See test environments related criteria
88
Short Example
Criteria for New Functionality Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Functionality
Priority
Minimum Test
Deepness
Minimum
Functionality
Coverage
Maximum
Fail Rate %
The Highest one 100% Features of Any
Priority
Detailed
Exploratory
testing
100% 0%
High 100%
(all high priority
test
environments)
All priorities Happy path
Exploratory
testing
100% 0%
Medium Please See test environments related criteria
Low Please See test environments related criteria
99
Short Example
Criteria for New Functionality Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Functionality
Priority
Minimum Test
Deepness
Minimum
Functionality
Coverage
Maximum
Fail Rate %
The Highest one 100% Features of Any
Priority
Detailed
Exploratory
testing
100% 0%
High 100%
(all high priority
test
environments)
All priorities Happy path
Exploratory
testing
100% 0%
Medium Please See test environments related criteria
Low Please See test environments related criteria
1010
Short Example
Criteria for New Functionality Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Functionality
Priority
Minimum Test
Deepness
Minimum
Functionality
Coverage
Maximum
Fail Rate %
The Highest one 100% Features of Any
Priority
Detailed
Exploratory
testing
100% 0%
High 100%
(all high priority
test
environments)
All priorities Happy path
Exploratory
testing
100% 0%
Medium Please See test environments related criteria
Low Please See test environments related criteria
1111
Short Example
Criteria for New Functionality Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Functionality
Priority
Minimum Test
Deepness
Minimum
Functionality
Coverage
Maximum
Fail Rate %
The Highest one 100% Features of Any
Priority
Detailed
Exploratory
testing
100% 0%
High 100%
(all high priority
test
environments)
All priorities Happy path
Exploratory
testing
100% 0%
Medium Please See test environments related criteria
Low Please See test environments related criteria
1212
Short Example
Criteria for New Functionality Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Functionality
Priority
Minimum Test
Deepness
Minimum
Functionality
Coverage
Maximum
Fail Rate %
The Highest one 100% Features of Any
Priority
Detailed
Exploratory
testing
100% 0%
High 100%
(all high priority
test
environments)
All priorities Happy path
Exploratory
testing
100% 0%
Medium Please See test environments related criteria
Low Please See test environments related criteria
1313
Short Example
Criteria for New Functionality Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Functionality
Priority
Minimum Test
Deepness
Minimum
Functionality
Coverage
Maximum
Fail Rate %
The Highest one 100% Features of Any
Priority
Detailed
Exploratory
testing
100% 0%
High 100%
(all high priority
test
environments)
All priorities Happy path
Exploratory
testing
100% 0%
Medium Please See test environments related criteria
Low Please See test environments related criteria
1414
Expanded Example
Criteria for New Functionality Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Functionality
Priority
Minimum Test
Deepness
Minimum
Functionality
Coverage
Maximum
Fail Rate %
The Highest one 100% High
(Blocker/Critical)
Detailed
Exploratory
testing
100% 0%
Medium (Major) Detailed
Exploratory
testing
100% 0%
Low (Normal/Trivial) Happy path
Exploratory
testing
100% 0%
High 100%
(all high priority
test
environments)
All priorities Happy path
Exploratory
testing
100% 0%
Medium Please See test environments related criteria
Low Please See test environments related criteria
1515
Test Deepness
Criteria for New Functionality Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Functionality
Priority
Minimum Test
Deepness
Minimum
Functionality
Coverage
Maximum
Fail Rate %
The Highest one 100% High
(Blocker/Critical)
Detailed
Exploratory
testing
100% 0%
Medium (Major) Detailed
Exploratory
testing
100% 0%
Low (Normal/Trivial) Happy path
Exploratory
testing
100% 0%
High 100%
(all high priority
test
environments)
All priorities Happy path
Exploratory
testing
100% 0%
Medium Please See test environments related criteria
Low Please See test environments related criteria
Test Deepness
1616
Test Deepness
Criteria for New Functionality Testing
TEST DEEPNESS / DETALIZATION
Test Case Based Thought Out Test
Detailed Exploratory Test
Happy Path Exploratory test
Smoke test
Nothing
1717
Test Coverage
Criteria for New Functionality Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Functionality
Priority
Minimum Test
Deepness
Minimum
Functionality
Coverage
Maximum
Fail Rate %
The Highest one 100% High
(Blocker/Critical)
Detailed
Exploratory
testing
100% 0%
Medium (Major) Detailed
Exploratory
testing
100% 0%
Low (Normal/Trivial) Happy path
Exploratory
testing
100% 0%
High 100%
(all high priority
test
environments)
All priorities Happy path
Exploratory
testing
100% 0%
Medium Please See test environments related criteria
Low Please See test environments related criteria
Test Coverage
1818
Test Coverage
Criteria for New Functionality Testing
Test Coverage
Test Coverage is 71 %, But should be 100%
1919
MaximumFail Rate %
Criteria for New Functionality Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Functionality
Priority
Minimum Test
Deepness
Minimum
Functionality
Coverage
Maximum
Fail Rate %
The Highest one 100% High
(Blocker/Critical)
Detailed
Exploratory
testing
100% 0%
Medium (Major) Detailed
Exploratory
testing
100% 0%
Low (Normal/Trivial) Happy path
Exploratory
testing
100% 0%
High 100%
(all high priority
test
environments)
All priorities Happy path
Exploratory
testing
100% 0%
Medium Please See test environments related criteria
Low Please See test environments related criteria
Fail Rate %
2020
Fail Rate %
Criteria for New Functionality Testing
Functionality Priority
Maximum Allowable Bugs Number
(Story, Improvement,
New Feature)
Blocker
Bugs
Critical
Bugs
Major
Bugs
Normal
Bugs
Trivial
Bugs
High (Blocker / Critical) 0 0 0 * *
Medium (Major) 0 0 0 * *
Low (Normal/Trivial) 0 0 * * *
PASS CRITERIA
*if too many bugs are in place for the functionality – the bugs number can be
considered for any specific case separately
2121
Fail Rate %
Criteria for New Functionality Testing
Functionality Priority
Maximum Allowable Bugs Number
(Story, Improvement,
New Feature)
Blocker
Bugs
Critical
Bugs
Major
Bugs
Normal
Bugs
Trivial
Bugs
High (Blocker / Critical) 0 0 0 * *
Medium (Major) 0 0 0 * *
Low (Normal/Trivial) 0 0 * * *
PASS CRITERIA
*if too many bugs are in place for the functionality – the bugs number can be
considered for any specific case separately
2222
Fail Rate %
Criteria for New Functionality Testing
Functionality Priority
Maximum Allowable Bugs Number
(Story, Improvement,
New Feature)
Blocker
Bugs
Critical
Bugs
Major
Bugs
Normal
Bugs
Trivial
Bugs
High (Blocker / Critical) 0 0 0 * *
Medium (Major) 0 0 0 * *
Low (Normal/Trivial) 0 0 * * *
PASS CRITERIA
*if too many bugs are in place for the functionality – the bugs number can be
considered for any specific case separately
2323
Fail Rate %
Criteria for New Functionality Testing
Functionality Priority
Maximum Allowable Bugs Number
(Story, Improvement,
New Feature)
Blocker
Bugs
Critical
Bugs
Major
Bugs
Normal
Bugs
Trivial
Bugs
High (Blocker / Critical) 0 0 0 * *
Medium (Major) 0 0 0 * *
Low (Normal/Trivial) 0 0 * * *
PASS CRITERIA
2424
Fail Rate %
Criteria for New Functionality Testing
Functionality Priority
Maximum Allowable Bugs Number
(Story, Improvement,
New Feature)
Blocker
Bugs
Critical
Bugs
Major
Bugs
Normal
Bugs
Trivial
Bugs
Features of Any Priority 0 0 * * *
PASS CRITERIA (short and not so strict)
2525
Fail Rate %
Criteria for New Functionality Testing
Functionality Priority
Maximum Allowable Bugs Number
(Story, Improvement,
New Feature)
Blocker
Bugs
Critical
Bugs
Major
Bugs
Normal
Bugs
Trivial
Bugs
Features of Any Priority 0 0 * * *
PASS CRITERIA (short and not so strict)
Status: FAIL RATE %
Blocked
2626
Fail Rate %
Criteria for New Functionality Testing
Functionality Priority
Maximum Allowable Bugs Number
(Story, Improvement,
New Feature)
Blocker
Bugs
Critical
Bugs
Major
Bugs
Normal
Bugs
Trivial
Bugs
Features of Any Priority 0 0 * * *
PASS CRITERIA (short and not so strict)
Status: FAIL RATE %
Blocked
Failed Release Readiness Criteria
2727
Fail Rate %
Criteria for New Functionality Testing
Functionality Priority
Maximum Allowable Bugs Number
(Story, Improvement,
New Feature)
Blocker
Bugs
Critical
Bugs
Major
Bugs
Normal
Bugs
Trivial
Bugs
Features of Any Priority 0 0 * * *
PASS CRITERIA (short and not so strict)
Status: FAIL RATE %
Blocked
Failed Release Readiness Criteria
Status: Pass Rate %
Failed With Acceptable Bugs
2828
Fail Rate %
Criteria for New Functionality Testing
Functionality Priority
Maximum Allowable Bugs Number
(Story, Improvement,
New Feature)
Blocker
Bugs
Critical
Bugs
Major
Bugs
Normal
Bugs
Trivial
Bugs
Features of Any Priority 0 0 * * *
PASS CRITERIA (short and not so strict)
Status: FAIL RATE %
Blocked
Failed Release Readiness Criteria
Status: Pass Rate %
Failed With Acceptable Bugs
2929
Fail Rate %
Criteria for New Functionality Testing
Functionality Priority
Maximum Allowable Bugs Number
(Story, Improvement,
New Feature)
Blocker
Bugs
Critical
Bugs
Major
Bugs
Normal
Bugs
Trivial
Bugs
Features of Any Priority 0 0 * * *
PASS CRITERIA (short and not so strict)
Status: FAIL RATE %
Blocked
Failed Release Readiness Criteria
Status: Pass Rate %
Failed With Acceptable Bugs
3030
Fail Rate %
Criteria for New Functionality Testing
Functionality Priority
Maximum Allowable Bugs Number
(Story, Improvement,
New Feature)
Blocker
Bugs
Critical
Bugs
Major
Bugs
Normal
Bugs
Trivial
Bugs
Features of Any Priority 0 0 * * *
PASS CRITERIA (short and not so strict)
Status: FAIL RATE %
Blocked
Failed Release Readiness Criteria
Status: Pass Rate %
Failed With Acceptable Bugs
Passed
3131
Fail Rate %
Criteria for New Functionality Testing
Test Coverage
Fail Rate is 29%, But should be 0%
3232
Test Environment Coverage
Criteria for New Functionality Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Functionality
Priority
Minimum Test
Deepness
Minimum
Functionality
Coverage
Maximum
Fail Rate %
The Highest one 100% High
(Blocker/Critical)
Detailed
Exploratory
testing
100% 0%
Medium (Major) Detailed
Exploratory
testing
100% 0%
Low (Normal/Trivial) Happy path
Exploratory
testing
100% 0%
High 100%
(all high priority
test
environments)
All priorities Happy path
Exploratory
testing
100% 0%
Medium Please See test environments related criteria
Low Please See test environments related criteria
Test Environments Coverage
3333
Test Environment Coverage
Criteria for New Functionality Testing
Test Environments
Type OS Browser/Device Resolution Priority
PC Win 7 Chrome 1920*1080 Highest
PC Win 8 (metro) IE 10 1920*1080
HighMac MacOS Firefox 1920*1080
iPad iOs7 iPad 4 2048*1536
Mac MacOS Safari 2880*1800
MediumPC Win 7 IE 11 1366*768
iPad iOs7 iPad 2 1024*768
PC Linux Firefox 1366*768
Low
3434
Test Environment Coverage
Criteria for New Functionality Testing
Test Environments
Type OS Browser/Device Resolution Priority
PC Win 7 Chrome 1920*1080 Highest
PC Win 8 (metro) IE 10 1920*1080
HighMac MacOS Firefox 1920*1080
iPad iOs7 iPad 4 2048*1536
Mac MacOS Safari 2880*1800
MediumPC Win 7 IE 11 1366*768
iPad iOs7 iPad 2 1024*768
PC Linux Firefox 1366*768
Low
There is only 1 highest
priority environment so the
coverage, which it gives for
the priority, is 100%.
3535
Test Environment Coverage
Criteria for New Functionality Testing
Test Environments
Type OS Browser/Device Resolution Priority
PC Win 7 Chrome 1920*1080 Highest
PC Win 8 (metro) IE 10 1920*1080
HighMac MacOS Firefox 1920*1080
iPad iOs7 iPad 4 2048*1536
Mac MacOS Safari 2880*1800
MediumPC Win 7 IE 11 1366*768
iPad iOs7 iPad 2 1024*768
PC Linux Firefox 1366*768
Low
1 environment of 3 high priority
environments gives ~ 33% coverage.
All these environments together
gives 100% coverage for the priority.
3636
Test Environment Coverage - Example
Criteria for New Functionality Testing
3737
What Else?
Criteria for New Functionality Testing
3838
What Else?
Criteria for New Functionality Testing
3939
DEFINTION OF DONE (EXAMPLE)
User story reviewed & adjusted correspondingly
Unit-test created and passed
Integration test created and passed
Pear review passed
UX-review passed
Manual Test Passed
End User Test Passed…
Definition of Done
Criteria for New Functionality Testing
4040
Criteria for Regression Testing
4141
Criteria for Regression Testing
Test Deepness
4242
Criteria for Regression Testing
Test Coverage
Test Deepness
4343
Criteria for Regression Testing
Test Coverage
Test Deepness
Fail Rate
4444
Criteria for Regression Testing
Test Coverage
Test Deepness
Fail Rate
Test Environments
4545
Example
Criteria for Regression Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Scenario
Priority
Minimum
Test
Deepness
Minimum
Functionalit
y Coverage
Maximum
Fail Rate %
The Highest one 100% High Detailed
Exploratory
testing
100% 0%
Medium (That
might be affected
by recent product
changes)
Happy path
Exploratory
testing
100% 0%
Other Medium Happy path
Exploratory
testing
50% 0%
High See test environments related criteria
Medium See test environments related criteria
Low See test environments related criteria
4646
Example
Criteria for Regression Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Scenario
Priority
Minimum
Test
Deepness
Minimum
Functionalit
y Coverage
Maximum
Fail Rate %
The Highest one 100% High Detailed
Exploratory
testing
100% 0%
Medium (That
might be affected
by recent product
changes)
Happy path
Exploratory
testing
100% 0%
Other Medium Happy path
Exploratory
testing
50% 0%
High See test environments related criteria
Medium See test environments related criteria
Low See test environments related criteria
4747
Example
Criteria for Regression Testing
Test Environment
Priority
Coverage of Test
Environments
Tested Scenario
Priority
Minimum
Test
Deepness
Minimum
Functionalit
y Coverage
Maximum
Fail Rate %
The Highest one 100% High Detailed
Exploratory
testing
100% 0%
Medium (That
might be affected
by recent product
changes)
Happy path
Exploratory
testing
100% 0%
Other Medium Happy path
Exploratory
testing
50% 0%
High See test environments related criteria
Medium See test environments related criteria
Low See test environments related criteria
4848
Criteria for Test Environment Testing
Possible Test Environment Ingredients
Internet Speed Antivirus, Firewalls
Plugins
Integration with other
applications and API
User Rights
Runtimes
External Devices
Screen Resolutions and Modes
Hardware and Software Platforms and Modes
Web-browsers
Mobile Software Platforms
Mobile Software Platforms
External Libraries
Hardware
Characteristics and
Capacity
Robots (HD,
Software,
Capabilities)
4949
Criteria for Test Environment Testing
Product-wide Test Deepness
5050
Criteria for Test Environment Testing
Product-wide Test
Deepness
Full Regression
Full Regression for
functionality of certain
priority
Main product Flows test /
User Acceptance Test /
Cover test
Selective Regression
Smoke Test
5151
Criteria for Test Environment Testing
Coverage of
Test Environments
Product-wide Test Deepness
5252
Criteria for Test Environment Testing
Coverage of
Test Environments
Product-wide Test Deepness
Fail Rate
5353
Criteria for Test Environment Testing
Test Environment Priority Target (functionality) Minimum Test
Deepness
Minimum
Coverage of
Test
environments
MaximumFa
il Rate %
Highest Please see the release readiness-criteria for new functionality and old
functionality
High New functionality Please see release readiness-criteria for new
functionality
Old (Regression-related)
functionality
Selective Regression
and/or
Main product Flows
test
100% 0%
Medium New and Old (Regression-
related) functionality
Product-wide Smoke
test
75%* 0%
Low New and Old (Regression-
related) functionality
Product-wide Smoke
test
50%* 0%
Example
*Not covered environments may be covered next release and so on
5454
Criteria for Test Environment Testing
Test Environment Priority Target (functionality) Minimum Test
Deepness
Minimum
Coverage of
Test
environments
MaximumFa
il Rate %
Highest Please see the release readiness-criteria for new functionality and old
functionality
High New functionality Please see release readiness-criteria for new
functionality
Old (Regression-related)
functionality
Selective Regression
and/or
Main product Flows
test
100% 0%
Medium New and Old (Regression-
related) functionality
Product-wide Smoke
test
75%* 0%
Low New and Old (Regression-
related) functionality
Product-wide Smoke
test
50%* 0%
Example
*Not covered environments may be covered next release and so on
5555
Criteria for Test Environment Testing
Test Environment Priority Target (functionality) Minimum Test
Deepness
Minimum
Coverage of
Test
environments
MaximumFa
il Rate %
Highest Please see the release readiness-criteria for new functionality and old
functionality
High New functionality Please see release readiness-criteria for new
functionality
Old (Regression-related)
functionality
Selective Regression
and/or
Main product Flows
test
100% 0%
Medium New and Old (Regression-
related) functionality
Product-wide Smoke
test
75%* 0%
Low New and Old (Regression-
related) functionality
Product-wide Smoke
test
50%* 0%
Example
*Not covered environments may be covered next release and so on
5656
Criteria for Unit & Integration Testing
Test Coverage
Fail Rate
GUI-LESS
Functionality
GUI
Functionality*
Unit & Integration Testing
Test Coverage
Fail Rate
*Criteria may be not so strict, because GUI functionality can be also manually tested
5757
Criteria for Unit & Integration Testing
Example
Integration Testing or Unit-Testing
Priority of
functionality
Minimum
Functionality
Coverage
MaximumFail
Rate %
High 100% 0%*
Medium 0% 0%*
*Depends on severity of the problems found in
integration/unit testing
5858
Criteria for Special Types of testing
Type of testing* Sufficient?
(yes/no)
Passed? Conclusions
Load/Performance
testing (client/server
side)
NOT READY
Security Testing NOT READY
UX-Testing READY
(Accessibility Testing) NOT READY
GENERAL CONCLUSSION: NOT READY
* Usually has separate release readiness criteria, but in any case it should be sufficient
and passed.
Special types of testing, which are obligatory to be conducted and passed
5959
Release readiness criteria appliance and areas of influence
6060
Release readiness criteria appliance and areas of influence
Release readiness criteria
Defines testing activities and product quality sufficient for release
Influences testing strategy, testing approaches, and activities needed
Defines QA Resources requirements
Defines Quality reporting structure and content
Helps making conclusion about release readiness
6161
6262
For those who don’t sleep yet
thank you for being cheerful! 
6363
Quality Reporting and its connection to release readiness criteria
Quality Reporting
6464
1. Number of Bugs and their severity
2. New Functionality Testing & Results
3. Regression Testing & Results
4. Test Environments Testing & Results
5. Unit & Integration testing & Results
6. Special Types of Testing & Results
7. Concluding Release Readiness
Quality Report Structure
Quality Reporting
6565
1. Number of Bugs and their severity
2. New Functionality Testing & Results
3. Regression Testing & Results
4. Test Environments Testing & Results
5. Unit & Integration testing & Results
6. Special Types of Testing & Results
7. Concluding Release Readiness
Quality Report Structure
Quality Reporting
6666
All Not Closed Bugs
Number of Bugs and their severity
6767
All Not Closed Bugs
Number of Bugs and their severity
6868
All Not Closed Bugs – By Component
Number of Bugs and their severity
6969
All Not Closed Bugs – Not-Assigned to any Sprint
Number of Bugs and their severity
7070
Number of Bugs and their severity
All Not Closed Bugs – Not-Assigned to any Sprint
7171
Bugs List (for All not-closed bugs) – That fails release readiness criteria
Number of Bugs and their severity
Bugs List (for All not-closed bugs) – That fails release readiness criteria
Assigned to sprints
Not-Assigned to sprints
7272
Number of Bugs and their severity
Make a separate release readiness
conclusion for this criterion type
7373
New Functionality Statuses (From Tasks Management System)
New Functionality Testing & Results
Features Statuses (Current release)
7474
New Functionality Statuses (From Tasks Management System)
New Functionality Testing & Results
Features Statuses (Current release)
Not-Resolved Features By Components
(Current release)
7575
New Functionality Statuses (From Tasks Management System)
New Functionality Testing & Results
1
Test Environments
7676
New Functionality Statuses (From Tasks Management System)
New Functionality Testing & Results
1
2
7777
New Functionality Statuses (From Tasks Management System)
New Functionality Testing & Results
1
2
3
7878
New Functionality Statuses (From Tasks Management System)
New Functionality Testing & Results
1
2
3
4
7979
New Functionality Statuses (From Tasks Management System)
New Functionality Testing & Results
1
2
3
4
Failed Functionalities Details (Optionally)
8080
New Functionality Testing & Results
Make a separate release readiness
conclusion for this criterion type
8181
Regression testing results for the highest priority environment
Regression Testing & Results
By Components
8282
Regression testing results for the highest priority environment
Regression Testing & Results
Failed Functionalities Details (Optionally)
8383
Regression Testing & Results
Make a separate release readiness
conclusion for this criterion type
8484
Test Environments Testing & Results
Test plans for test environments of different priorities
8585
Test Environments Testing & Results
Make a separate release readiness
conclusion for this criterion type
8686
GUI-less functionality
Unit & Integration testing & Results
Type of testing Coverage Fail Percentage Conclusions
Unit-test 50% 0% READY
Integration test 100% 0% READY
GENERAL RELEASE READINESS CONCLUSSION: READY
8787
GUI-less functionality
Unit & Integration testing & Results
Type of testing Coverage Fail Percentage Conclusions
Unit-test 50% 0% READY
Integration test 100% 0% READY
GENERAL RELEASE READINESS CONCLUSSION: READY
8888
GUI-less functionality
Unit & Integration testing & Results
Type of testing Coverage Fail Percentage Conclusions
Unit-test 50% 0% READY
Integration test 100% 0% READY
GENERAL RELEASE READINESS CONCLUSSION: READY
8989
GUI-less functionality
Unit & Integration testing & Results
Type of testing Coverage Fail Percentage Conclusions
Unit-test 50% 0% READY
Integration test 100% 0% READY
GENERAL RELEASE READINESS CONCLUSSION: READY
9090
Special Types of Testing & Results
Type of testing* Sufficient?
(yes/no)
Passed? Conclusions
Load/Performance
testing (client/server
side)
NOT READY
Security Testing NOT READY
UX-Testing READY
(Accessibility Testing) NOT READY
GENERAL RELEASE READINESS CONCLUSSION: NOT READY
* Usually has separate release readiness criteria, but in any case it should be sufficient
and passed.
9191
Special Types of Testing & Results
Type of testing* Sufficient?
(yes/no)
Passed? Conclusions
Load/Performance
testing (client/server
side)
NOT READY
Security Testing NOT READY
UX-Testing READY
(Accessibility Testing) NOT READY
GENERAL RELEASE READINESS CONCLUSSION: NOT READY
* Usually has separate release readiness criteria, but in any case it should be sufficient
and passed.
9292
Special Types of Testing & Results
Type of testing* Sufficient?
(yes/no)
Passed? Conclusions
Load/Performance
testing (client/server
side)
NOT READY
Security Testing NOT READY
UX-Testing READY
(Accessibility Testing) NOT READY
GENERAL RELEASE READINESS CONCLUSSION: NOT READY
* Usually has separate release readiness criteria, but in any case it should be sufficient
and passed.
9393
Special Types of Testing & Results
Type of testing* Sufficient?
(yes/no)
Passed? Conclusions
Load/Performance
testing (client/server
side)
NOT READY
Security Testing NOT READY
UX-Testing READY
(Accessibility Testing) NOT READY
GENERAL RELEASE READINESS CONCLUSSION: NOT READY
* Usually has separate release readiness criteria, but in any case it should be sufficient
and passed.
9494
Concluding Release Readiness
Criterion Status
1. Number of Bugs and their severity
NOT READY
2. New Functionality Testing & Results
READY
3. Regression Testing & Results
READY
4. Test Environments Testing & Results
NOT READY
5. Unit & Integration testing & Results
READY
6. Special Types of Testing & Results
NOT READY
GENERAL CONCLUSSION: NOT READY
9595
Concluding Release Readiness
Criterion Status
1. Number of Bugs and their severity
NOT READY
2. New Functionality Testing & Results
READY
3. Regression Testing & Results
READY
4. Test Environments Testing & Results
NOT READY
5. Unit & Integration testing & Results
READY
6. Special Types of Testing & Results
NOT READY
GENERAL CONCLUSSION: NOT READY
9696
Instruments Facilitating Quality Reporting
CSV
CSV
As Gadgets, iFrames,
Screenshots, Links
plugins
9797
Thank you! ;)
QUESTIONS?

Contenu connexe

Tendances

От хаоса к автоматизации тестирования на примере Backend
От хаоса к автоматизации тестирования на примере BackendОт хаоса к автоматизации тестирования на примере Backend
От хаоса к автоматизации тестирования на примере Backend
COMAQA.BY
 

Tendances (20)

The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary ThornThe 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
 
От хаоса к автоматизации тестирования на примере Backend
От хаоса к автоматизации тестирования на примере BackendОт хаоса к автоматизации тестирования на примере Backend
От хаоса к автоматизации тестирования на примере Backend
 
Practical Test Strategy Using Heuristics
Practical Test Strategy Using HeuristicsPractical Test Strategy Using Heuristics
Practical Test Strategy Using Heuristics
 
Agile Testing
Agile TestingAgile Testing
Agile Testing
 
Dietmar Strasser - Traditional QA meets Agile Development
Dietmar Strasser -  Traditional QA meets Agile DevelopmentDietmar Strasser -  Traditional QA meets Agile Development
Dietmar Strasser - Traditional QA meets Agile Development
 
Manage Testing by Dependencies—Not Activities
Manage Testing by Dependencies—Not ActivitiesManage Testing by Dependencies—Not Activities
Manage Testing by Dependencies—Not Activities
 
Quality management
Quality managementQuality management
Quality management
 
Examples how to move towards Zero Defects
Examples how to move towards Zero DefectsExamples how to move towards Zero Defects
Examples how to move towards Zero Defects
 
Defect root cause analysis, Андрей Титаренко
Defect root cause analysis, Андрей ТитаренкоDefect root cause analysis, Андрей Титаренко
Defect root cause analysis, Андрей Титаренко
 
Combinatorial Black-Box Testing with Classification Trees
Combinatorial Black-Box Testing with Classification TreesCombinatorial Black-Box Testing with Classification Trees
Combinatorial Black-Box Testing with Classification Trees
 
Agile Testing: Methods and Models
Agile Testing: Methods and ModelsAgile Testing: Methods and Models
Agile Testing: Methods and Models
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Agile testing practice
Agile testing practiceAgile testing practice
Agile testing practice
 
A Software Testing Intro
A Software Testing IntroA Software Testing Intro
A Software Testing Intro
 
Free-ebook-rex-black advanced-software-testing
Free-ebook-rex-black advanced-software-testingFree-ebook-rex-black advanced-software-testing
Free-ebook-rex-black advanced-software-testing
 
Test Cases - are they dead?
Test Cases - are they dead?Test Cases - are they dead?
Test Cases - are they dead?
 
Qa exploratory test charter template
Qa exploratory test charter templateQa exploratory test charter template
Qa exploratory test charter template
 
Test analysis & design good practices@TDT Iasi 17Oct2013
Test analysis & design   good practices@TDT Iasi 17Oct2013Test analysis & design   good practices@TDT Iasi 17Oct2013
Test analysis & design good practices@TDT Iasi 17Oct2013
 
TLC
TLCTLC
TLC
 
Moving Towards Zero Defects with Specification by Example
Moving Towards Zero Defects with Specification by ExampleMoving Towards Zero Defects with Specification by Example
Moving Towards Zero Defects with Specification by Example
 

En vedette (6)

Yvette Rivers presents: Real world quality management
Yvette Rivers presents: Real world quality managementYvette Rivers presents: Real world quality management
Yvette Rivers presents: Real world quality management
 
Metadata quality criteria
Metadata quality criteriaMetadata quality criteria
Metadata quality criteria
 
Product Descriptions The Best Thing Since Sliced Bread
Product Descriptions   The Best Thing Since Sliced BreadProduct Descriptions   The Best Thing Since Sliced Bread
Product Descriptions The Best Thing Since Sliced Bread
 
Research methods Quality criteria, research ethics, and other research issue...
Research methods  Quality criteria, research ethics, and other research issue...Research methods  Quality criteria, research ethics, and other research issue...
Research methods Quality criteria, research ethics, and other research issue...
 
ISO 9001 - It sets out the criteria for a quality management system and is th...
ISO 9001 - It sets out the criteria for a quality management system and is th...ISO 9001 - It sets out the criteria for a quality management system and is th...
ISO 9001 - It sets out the criteria for a quality management system and is th...
 
Testing Metrics
Testing MetricsTesting Metrics
Testing Metrics
 

Similaire à QA Club Kiev #17 Measuring quality by Volodymyr Prymakov

Advanced A/B Testing at Wix - Aviran Mordo and Sagy Rozman, Wix.com
Advanced A/B Testing at Wix - Aviran Mordo and Sagy Rozman, Wix.comAdvanced A/B Testing at Wix - Aviran Mordo and Sagy Rozman, Wix.com
Advanced A/B Testing at Wix - Aviran Mordo and Sagy Rozman, Wix.com
DevOpsDays Tel Aviv
 
Test case attributes
Test case attributesTest case attributes
Test case attributes
Johan Hoberg
 

Similaire à QA Club Kiev #17 Measuring quality by Volodymyr Prymakov (20)

Mattias Ratert - Incremental Scenario Testing
Mattias Ratert - Incremental Scenario TestingMattias Ratert - Incremental Scenario Testing
Mattias Ratert - Incremental Scenario Testing
 
How agile performance testing helps automate and scale test processes
How agile performance testing helps automate and scale test processesHow agile performance testing helps automate and scale test processes
How agile performance testing helps automate and scale test processes
 
Volodymyr Prymakov and Vlada Benyukh Detailed manual estimation approach for ...
Volodymyr Prymakov and Vlada Benyukh Detailed manual estimation approach for ...Volodymyr Prymakov and Vlada Benyukh Detailed manual estimation approach for ...
Volodymyr Prymakov and Vlada Benyukh Detailed manual estimation approach for ...
 
Risk-Based Test Techniques
Risk-Based Test TechniquesRisk-Based Test Techniques
Risk-Based Test Techniques
 
Automate test, tools, advantages, and disadvantages
Automate test, tools, advantages,  and disadvantagesAutomate test, tools, advantages,  and disadvantages
Automate test, tools, advantages, and disadvantages
 
Database Unit Testing Made Easy with VSTS
Database Unit Testing Made Easy with VSTSDatabase Unit Testing Made Easy with VSTS
Database Unit Testing Made Easy with VSTS
 
Software Test Metrics and Measurements
Software Test Metrics and MeasurementsSoftware Test Metrics and Measurements
Software Test Metrics and Measurements
 
Advanced A/B Testing at Wix - Aviran Mordo and Sagy Rozman, Wix.com
Advanced A/B Testing at Wix - Aviran Mordo and Sagy Rozman, Wix.comAdvanced A/B Testing at Wix - Aviran Mordo and Sagy Rozman, Wix.com
Advanced A/B Testing at Wix - Aviran Mordo and Sagy Rozman, Wix.com
 
Acceptance Test Driven Development at StarWest 2014
Acceptance Test Driven Development at StarWest 2014Acceptance Test Driven Development at StarWest 2014
Acceptance Test Driven Development at StarWest 2014
 
Test case attributes
Test case attributesTest case attributes
Test case attributes
 
Black Box Testing Techniques by Sampath M
Black Box Testing Techniques by Sampath MBlack Box Testing Techniques by Sampath M
Black Box Testing Techniques by Sampath M
 
Exploratory Testing for Developers
Exploratory Testing for DevelopersExploratory Testing for Developers
Exploratory Testing for Developers
 
Performance On Demand
Performance On DemandPerformance On Demand
Performance On Demand
 
Engineers: Apply Automation to Increase Quality, Speed to Market
Engineers: Apply Automation to Increase Quality, Speed to MarketEngineers: Apply Automation to Increase Quality, Speed to Market
Engineers: Apply Automation to Increase Quality, Speed to Market
 
Software Quality and Test Strategies for Ruby and Rails Applications
Software Quality and Test Strategies for Ruby and Rails ApplicationsSoftware Quality and Test Strategies for Ruby and Rails Applications
Software Quality and Test Strategies for Ruby and Rails Applications
 
General Software Tester Training
General Software Tester TrainingGeneral Software Tester Training
General Software Tester Training
 
Testing 3: Types Of Tests That May Be Required
Testing 3: Types Of Tests That May Be RequiredTesting 3: Types Of Tests That May Be Required
Testing 3: Types Of Tests That May Be Required
 
ISTQB Foundation - Chapter 2
ISTQB Foundation - Chapter 2ISTQB Foundation - Chapter 2
ISTQB Foundation - Chapter 2
 
LlosengCh10E2.ppt
LlosengCh10E2.pptLlosengCh10E2.ppt
LlosengCh10E2.ppt
 
Software testing foundation
Software testing foundationSoftware testing foundation
Software testing foundation
 

Plus de QA Club Kiev

Agile performance testing
Agile performance testingAgile performance testing
Agile performance testing
QA Club Kiev
 
QAClubKiev Performance-Structure
QAClubKiev Performance-StructureQAClubKiev Performance-Structure
QAClubKiev Performance-Structure
QA Club Kiev
 
QA Club Kiev #13 Performance Testing - introduction
QA Club Kiev #13  Performance Testing - introductionQA Club Kiev #13  Performance Testing - introduction
QA Club Kiev #13 Performance Testing - introduction
QA Club Kiev
 
Qa club kiev #12 istqb сertification
Qa club kiev #12  istqb сertification Qa club kiev #12  istqb сertification
Qa club kiev #12 istqb сertification
QA Club Kiev
 
ISTQB Certification
ISTQB CertificationISTQB Certification
ISTQB Certification
QA Club Kiev
 
Test management in scrum
Test management in scrumTest management in scrum
Test management in scrum
QA Club Kiev
 
Qa club kiev #11 test documentation - introduction
Qa club kiev #11  test documentation - introductionQa club kiev #11  test documentation - introduction
Qa club kiev #11 test documentation - introduction
QA Club Kiev
 
Agile testing - introduction
Agile testing - introductionAgile testing - introduction
Agile testing - introduction
QA Club Kiev
 
Effective testing in scrum approach and tools
Effective testing in scrum   approach and toolsEffective testing in scrum   approach and tools
Effective testing in scrum approach and tools
QA Club Kiev
 
Skype testing overview
Skype testing overviewSkype testing overview
Skype testing overview
QA Club Kiev
 

Plus de QA Club Kiev (20)

QA Club Kiev #20. Mobile Testing. Tips & Tricks
QA Club Kiev #20. Mobile Testing. Tips & TricksQA Club Kiev #20. Mobile Testing. Tips & Tricks
QA Club Kiev #20. Mobile Testing. Tips & Tricks
 
QA Club Kiev #20. Making life easier with Docker
QA Club Kiev #20. Making life easier with DockerQA Club Kiev #20. Making life easier with Docker
QA Club Kiev #20. Making life easier with Docker
 
QA Club Kiev #19 - ISTQB to be or not to be
QA Club Kiev #19 - ISTQB to be or not to beQA Club Kiev #19 - ISTQB to be or not to be
QA Club Kiev #19 - ISTQB to be or not to be
 
Whay QA- engineers should know how to code
Whay QA- engineers should know how to codeWhay QA- engineers should know how to code
Whay QA- engineers should know how to code
 
Mobile Testing. What to do?
Mobile Testing. What to do?Mobile Testing. What to do?
Mobile Testing. What to do?
 
Мифы Автоматизации
Мифы АвтоматизацииМифы Автоматизации
Мифы Автоматизации
 
QA Club Kiev #17 QA Challenge by Oleksandr Maidaniuk
QA Club Kiev #17 QA Challenge by Oleksandr MaidaniukQA Club Kiev #17 QA Challenge by Oleksandr Maidaniuk
QA Club Kiev #17 QA Challenge by Oleksandr Maidaniuk
 
QA Club Kiev #16: BA in IT
QA Club Kiev #16: BA in ITQA Club Kiev #16: BA in IT
QA Club Kiev #16: BA in IT
 
Agile performance testing
Agile performance testingAgile performance testing
Agile performance testing
 
QAClubKiev Performance-Structure
QAClubKiev Performance-StructureQAClubKiev Performance-Structure
QAClubKiev Performance-Structure
 
QA Club Kiev #13 Performance Testing - introduction
QA Club Kiev #13  Performance Testing - introductionQA Club Kiev #13  Performance Testing - introduction
QA Club Kiev #13 Performance Testing - introduction
 
Qa club kiev #12 istqb сertification
Qa club kiev #12  istqb сertification Qa club kiev #12  istqb сertification
Qa club kiev #12 istqb сertification
 
ISTQB Certification
ISTQB CertificationISTQB Certification
ISTQB Certification
 
Test management in scrum
Test management in scrumTest management in scrum
Test management in scrum
 
Qa club kiev #11 test documentation - introduction
Qa club kiev #11  test documentation - introductionQa club kiev #11  test documentation - introduction
Qa club kiev #11 test documentation - introduction
 
Agile testing - introduction
Agile testing - introductionAgile testing - introduction
Agile testing - introduction
 
Effective testing in scrum approach and tools
Effective testing in scrum   approach and toolsEffective testing in scrum   approach and tools
Effective testing in scrum approach and tools
 
Selenium as a trend
Selenium as a trendSelenium as a trend
Selenium as a trend
 
Web testing
Web testingWeb testing
Web testing
 
Skype testing overview
Skype testing overviewSkype testing overview
Skype testing overview
 

Dernier

Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 

Dernier (20)

Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
Magic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptxMagic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptx
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 

QA Club Kiev #17 Measuring quality by Volodymyr Prymakov

  • 1. Measuring Quality Release Readiness Criteria and Quality Reporting
  • 2. 22 11 Years general working experience in IT/QA (30+ projects) ---------- •QA Consultant at Ciklum Interactive •QA Manager (Manual) •Automated Testing Manager •Load Testing Manager •Project Manager ---------- •Hobbies: Job, Wife and 2 children, Sport ---------- Skype: vladimir.primakov Linkedin: ua.linkedin.com/in/vladimirprimakov/ Email: v.v.primakov@gmail.com Some Words About Me Volodymyr Prymakov (Vladimir Primakov)
  • 3. 33 The presentation will cover the following items: • Release Readiness criteria as a part of a master test plan, their types and details. (~ 30 min) • Release readiness criteria appliance and areas of influence. (~ 5 min) • Quality report and quality metrics + their connection to release readiness criteria. (~ 15 min) • Concluding release readiness. (~1 min) • Questions (~ 10 min) Presentation’s Structure Presentation Plan
  • 4. 44 Release Readiness Criteria as a part of Master Test Plan Release Readiness Criteria Master Test Plan
  • 5. 55 Categories of Release Readiness Criteria Analyzing Quality (RESULTS) Catching Quality (ACTIVITIES) 1. New Functionality Testing 2. Regression Testing 3. Test Environments Testing 4. Unit & Integration testing 5. Special Types of Testing
  • 6. 66 Any Ideas? Criteria for New Functionality Testing
  • 7. 77 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  • 8. 88 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  • 9. 99 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  • 10. 1010 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  • 11. 1111 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  • 12. 1212 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  • 13. 1313 Short Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% Features of Any Priority Detailed Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  • 14. 1414 Expanded Example Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% High (Blocker/Critical) Detailed Exploratory testing 100% 0% Medium (Major) Detailed Exploratory testing 100% 0% Low (Normal/Trivial) Happy path Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria
  • 15. 1515 Test Deepness Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% High (Blocker/Critical) Detailed Exploratory testing 100% 0% Medium (Major) Detailed Exploratory testing 100% 0% Low (Normal/Trivial) Happy path Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria Test Deepness
  • 16. 1616 Test Deepness Criteria for New Functionality Testing TEST DEEPNESS / DETALIZATION Test Case Based Thought Out Test Detailed Exploratory Test Happy Path Exploratory test Smoke test Nothing
  • 17. 1717 Test Coverage Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% High (Blocker/Critical) Detailed Exploratory testing 100% 0% Medium (Major) Detailed Exploratory testing 100% 0% Low (Normal/Trivial) Happy path Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria Test Coverage
  • 18. 1818 Test Coverage Criteria for New Functionality Testing Test Coverage Test Coverage is 71 %, But should be 100%
  • 19. 1919 MaximumFail Rate % Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% High (Blocker/Critical) Detailed Exploratory testing 100% 0% Medium (Major) Detailed Exploratory testing 100% 0% Low (Normal/Trivial) Happy path Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria Fail Rate %
  • 20. 2020 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs High (Blocker / Critical) 0 0 0 * * Medium (Major) 0 0 0 * * Low (Normal/Trivial) 0 0 * * * PASS CRITERIA *if too many bugs are in place for the functionality – the bugs number can be considered for any specific case separately
  • 21. 2121 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs High (Blocker / Critical) 0 0 0 * * Medium (Major) 0 0 0 * * Low (Normal/Trivial) 0 0 * * * PASS CRITERIA *if too many bugs are in place for the functionality – the bugs number can be considered for any specific case separately
  • 22. 2222 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs High (Blocker / Critical) 0 0 0 * * Medium (Major) 0 0 0 * * Low (Normal/Trivial) 0 0 * * * PASS CRITERIA *if too many bugs are in place for the functionality – the bugs number can be considered for any specific case separately
  • 23. 2323 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs High (Blocker / Critical) 0 0 0 * * Medium (Major) 0 0 0 * * Low (Normal/Trivial) 0 0 * * * PASS CRITERIA
  • 24. 2424 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict)
  • 25. 2525 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict) Status: FAIL RATE % Blocked
  • 26. 2626 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict) Status: FAIL RATE % Blocked Failed Release Readiness Criteria
  • 27. 2727 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict) Status: FAIL RATE % Blocked Failed Release Readiness Criteria Status: Pass Rate % Failed With Acceptable Bugs
  • 28. 2828 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict) Status: FAIL RATE % Blocked Failed Release Readiness Criteria Status: Pass Rate % Failed With Acceptable Bugs
  • 29. 2929 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict) Status: FAIL RATE % Blocked Failed Release Readiness Criteria Status: Pass Rate % Failed With Acceptable Bugs
  • 30. 3030 Fail Rate % Criteria for New Functionality Testing Functionality Priority Maximum Allowable Bugs Number (Story, Improvement, New Feature) Blocker Bugs Critical Bugs Major Bugs Normal Bugs Trivial Bugs Features of Any Priority 0 0 * * * PASS CRITERIA (short and not so strict) Status: FAIL RATE % Blocked Failed Release Readiness Criteria Status: Pass Rate % Failed With Acceptable Bugs Passed
  • 31. 3131 Fail Rate % Criteria for New Functionality Testing Test Coverage Fail Rate is 29%, But should be 0%
  • 32. 3232 Test Environment Coverage Criteria for New Functionality Testing Test Environment Priority Coverage of Test Environments Tested Functionality Priority Minimum Test Deepness Minimum Functionality Coverage Maximum Fail Rate % The Highest one 100% High (Blocker/Critical) Detailed Exploratory testing 100% 0% Medium (Major) Detailed Exploratory testing 100% 0% Low (Normal/Trivial) Happy path Exploratory testing 100% 0% High 100% (all high priority test environments) All priorities Happy path Exploratory testing 100% 0% Medium Please See test environments related criteria Low Please See test environments related criteria Test Environments Coverage
  • 33. 3333 Test Environment Coverage Criteria for New Functionality Testing Test Environments Type OS Browser/Device Resolution Priority PC Win 7 Chrome 1920*1080 Highest PC Win 8 (metro) IE 10 1920*1080 HighMac MacOS Firefox 1920*1080 iPad iOs7 iPad 4 2048*1536 Mac MacOS Safari 2880*1800 MediumPC Win 7 IE 11 1366*768 iPad iOs7 iPad 2 1024*768 PC Linux Firefox 1366*768 Low
  • 34. 3434 Test Environment Coverage Criteria for New Functionality Testing Test Environments Type OS Browser/Device Resolution Priority PC Win 7 Chrome 1920*1080 Highest PC Win 8 (metro) IE 10 1920*1080 HighMac MacOS Firefox 1920*1080 iPad iOs7 iPad 4 2048*1536 Mac MacOS Safari 2880*1800 MediumPC Win 7 IE 11 1366*768 iPad iOs7 iPad 2 1024*768 PC Linux Firefox 1366*768 Low There is only 1 highest priority environment so the coverage, which it gives for the priority, is 100%.
  • 35. 3535 Test Environment Coverage Criteria for New Functionality Testing Test Environments Type OS Browser/Device Resolution Priority PC Win 7 Chrome 1920*1080 Highest PC Win 8 (metro) IE 10 1920*1080 HighMac MacOS Firefox 1920*1080 iPad iOs7 iPad 4 2048*1536 Mac MacOS Safari 2880*1800 MediumPC Win 7 IE 11 1366*768 iPad iOs7 iPad 2 1024*768 PC Linux Firefox 1366*768 Low 1 environment of 3 high priority environments gives ~ 33% coverage. All these environments together gives 100% coverage for the priority.
  • 36. 3636 Test Environment Coverage - Example Criteria for New Functionality Testing
  • 37. 3737 What Else? Criteria for New Functionality Testing
  • 38. 3838 What Else? Criteria for New Functionality Testing
  • 39. 3939 DEFINTION OF DONE (EXAMPLE) User story reviewed & adjusted correspondingly Unit-test created and passed Integration test created and passed Pear review passed UX-review passed Manual Test Passed End User Test Passed… Definition of Done Criteria for New Functionality Testing
  • 41. 4141 Criteria for Regression Testing Test Deepness
  • 42. 4242 Criteria for Regression Testing Test Coverage Test Deepness
  • 43. 4343 Criteria for Regression Testing Test Coverage Test Deepness Fail Rate
  • 44. 4444 Criteria for Regression Testing Test Coverage Test Deepness Fail Rate Test Environments
  • 45. 4545 Example Criteria for Regression Testing Test Environment Priority Coverage of Test Environments Tested Scenario Priority Minimum Test Deepness Minimum Functionalit y Coverage Maximum Fail Rate % The Highest one 100% High Detailed Exploratory testing 100% 0% Medium (That might be affected by recent product changes) Happy path Exploratory testing 100% 0% Other Medium Happy path Exploratory testing 50% 0% High See test environments related criteria Medium See test environments related criteria Low See test environments related criteria
  • 46. 4646 Example Criteria for Regression Testing Test Environment Priority Coverage of Test Environments Tested Scenario Priority Minimum Test Deepness Minimum Functionalit y Coverage Maximum Fail Rate % The Highest one 100% High Detailed Exploratory testing 100% 0% Medium (That might be affected by recent product changes) Happy path Exploratory testing 100% 0% Other Medium Happy path Exploratory testing 50% 0% High See test environments related criteria Medium See test environments related criteria Low See test environments related criteria
  • 47. 4747 Example Criteria for Regression Testing Test Environment Priority Coverage of Test Environments Tested Scenario Priority Minimum Test Deepness Minimum Functionalit y Coverage Maximum Fail Rate % The Highest one 100% High Detailed Exploratory testing 100% 0% Medium (That might be affected by recent product changes) Happy path Exploratory testing 100% 0% Other Medium Happy path Exploratory testing 50% 0% High See test environments related criteria Medium See test environments related criteria Low See test environments related criteria
  • 48. 4848 Criteria for Test Environment Testing Possible Test Environment Ingredients Internet Speed Antivirus, Firewalls Plugins Integration with other applications and API User Rights Runtimes External Devices Screen Resolutions and Modes Hardware and Software Platforms and Modes Web-browsers Mobile Software Platforms Mobile Software Platforms External Libraries Hardware Characteristics and Capacity Robots (HD, Software, Capabilities)
  • 49. 4949 Criteria for Test Environment Testing Product-wide Test Deepness
  • 50. 5050 Criteria for Test Environment Testing Product-wide Test Deepness Full Regression Full Regression for functionality of certain priority Main product Flows test / User Acceptance Test / Cover test Selective Regression Smoke Test
  • 51. 5151 Criteria for Test Environment Testing Coverage of Test Environments Product-wide Test Deepness
  • 52. 5252 Criteria for Test Environment Testing Coverage of Test Environments Product-wide Test Deepness Fail Rate
  • 53. 5353 Criteria for Test Environment Testing Test Environment Priority Target (functionality) Minimum Test Deepness Minimum Coverage of Test environments MaximumFa il Rate % Highest Please see the release readiness-criteria for new functionality and old functionality High New functionality Please see release readiness-criteria for new functionality Old (Regression-related) functionality Selective Regression and/or Main product Flows test 100% 0% Medium New and Old (Regression- related) functionality Product-wide Smoke test 75%* 0% Low New and Old (Regression- related) functionality Product-wide Smoke test 50%* 0% Example *Not covered environments may be covered next release and so on
  • 54. 5454 Criteria for Test Environment Testing Test Environment Priority Target (functionality) Minimum Test Deepness Minimum Coverage of Test environments MaximumFa il Rate % Highest Please see the release readiness-criteria for new functionality and old functionality High New functionality Please see release readiness-criteria for new functionality Old (Regression-related) functionality Selective Regression and/or Main product Flows test 100% 0% Medium New and Old (Regression- related) functionality Product-wide Smoke test 75%* 0% Low New and Old (Regression- related) functionality Product-wide Smoke test 50%* 0% Example *Not covered environments may be covered next release and so on
  • 55. 5555 Criteria for Test Environment Testing Test Environment Priority Target (functionality) Minimum Test Deepness Minimum Coverage of Test environments MaximumFa il Rate % Highest Please see the release readiness-criteria for new functionality and old functionality High New functionality Please see release readiness-criteria for new functionality Old (Regression-related) functionality Selective Regression and/or Main product Flows test 100% 0% Medium New and Old (Regression- related) functionality Product-wide Smoke test 75%* 0% Low New and Old (Regression- related) functionality Product-wide Smoke test 50%* 0% Example *Not covered environments may be covered next release and so on
  • 56. 5656 Criteria for Unit & Integration Testing Test Coverage Fail Rate GUI-LESS Functionality GUI Functionality* Unit & Integration Testing Test Coverage Fail Rate *Criteria may be not so strict, because GUI functionality can be also manually tested
  • 57. 5757 Criteria for Unit & Integration Testing Example Integration Testing or Unit-Testing Priority of functionality Minimum Functionality Coverage MaximumFail Rate % High 100% 0%* Medium 0% 0%* *Depends on severity of the problems found in integration/unit testing
  • 58. 5858 Criteria for Special Types of testing Type of testing* Sufficient? (yes/no) Passed? Conclusions Load/Performance testing (client/server side) NOT READY Security Testing NOT READY UX-Testing READY (Accessibility Testing) NOT READY GENERAL CONCLUSSION: NOT READY * Usually has separate release readiness criteria, but in any case it should be sufficient and passed. Special types of testing, which are obligatory to be conducted and passed
  • 59. 5959 Release readiness criteria appliance and areas of influence
  • 60. 6060 Release readiness criteria appliance and areas of influence Release readiness criteria Defines testing activities and product quality sufficient for release Influences testing strategy, testing approaches, and activities needed Defines QA Resources requirements Defines Quality reporting structure and content Helps making conclusion about release readiness
  • 61. 6161
  • 62. 6262 For those who don’t sleep yet thank you for being cheerful! 
  • 63. 6363 Quality Reporting and its connection to release readiness criteria Quality Reporting
  • 64. 6464 1. Number of Bugs and their severity 2. New Functionality Testing & Results 3. Regression Testing & Results 4. Test Environments Testing & Results 5. Unit & Integration testing & Results 6. Special Types of Testing & Results 7. Concluding Release Readiness Quality Report Structure Quality Reporting
  • 65. 6565 1. Number of Bugs and their severity 2. New Functionality Testing & Results 3. Regression Testing & Results 4. Test Environments Testing & Results 5. Unit & Integration testing & Results 6. Special Types of Testing & Results 7. Concluding Release Readiness Quality Report Structure Quality Reporting
  • 66. 6666 All Not Closed Bugs Number of Bugs and their severity
  • 67. 6767 All Not Closed Bugs Number of Bugs and their severity
  • 68. 6868 All Not Closed Bugs – By Component Number of Bugs and their severity
  • 69. 6969 All Not Closed Bugs – Not-Assigned to any Sprint Number of Bugs and their severity
  • 70. 7070 Number of Bugs and their severity All Not Closed Bugs – Not-Assigned to any Sprint
  • 71. 7171 Bugs List (for All not-closed bugs) – That fails release readiness criteria Number of Bugs and their severity Bugs List (for All not-closed bugs) – That fails release readiness criteria Assigned to sprints Not-Assigned to sprints
  • 72. 7272 Number of Bugs and their severity Make a separate release readiness conclusion for this criterion type
  • 73. 7373 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results Features Statuses (Current release)
  • 74. 7474 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results Features Statuses (Current release) Not-Resolved Features By Components (Current release)
  • 75. 7575 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results 1 Test Environments
  • 76. 7676 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results 1 2
  • 77. 7777 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results 1 2 3
  • 78. 7878 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results 1 2 3 4
  • 79. 7979 New Functionality Statuses (From Tasks Management System) New Functionality Testing & Results 1 2 3 4 Failed Functionalities Details (Optionally)
  • 80. 8080 New Functionality Testing & Results Make a separate release readiness conclusion for this criterion type
  • 81. 8181 Regression testing results for the highest priority environment Regression Testing & Results By Components
  • 82. 8282 Regression testing results for the highest priority environment Regression Testing & Results Failed Functionalities Details (Optionally)
  • 83. 8383 Regression Testing & Results Make a separate release readiness conclusion for this criterion type
  • 84. 8484 Test Environments Testing & Results Test plans for test environments of different priorities
  • 85. 8585 Test Environments Testing & Results Make a separate release readiness conclusion for this criterion type
  • 86. 8686 GUI-less functionality Unit & Integration testing & Results Type of testing Coverage Fail Percentage Conclusions Unit-test 50% 0% READY Integration test 100% 0% READY GENERAL RELEASE READINESS CONCLUSSION: READY
  • 87. 8787 GUI-less functionality Unit & Integration testing & Results Type of testing Coverage Fail Percentage Conclusions Unit-test 50% 0% READY Integration test 100% 0% READY GENERAL RELEASE READINESS CONCLUSSION: READY
  • 88. 8888 GUI-less functionality Unit & Integration testing & Results Type of testing Coverage Fail Percentage Conclusions Unit-test 50% 0% READY Integration test 100% 0% READY GENERAL RELEASE READINESS CONCLUSSION: READY
  • 89. 8989 GUI-less functionality Unit & Integration testing & Results Type of testing Coverage Fail Percentage Conclusions Unit-test 50% 0% READY Integration test 100% 0% READY GENERAL RELEASE READINESS CONCLUSSION: READY
  • 90. 9090 Special Types of Testing & Results Type of testing* Sufficient? (yes/no) Passed? Conclusions Load/Performance testing (client/server side) NOT READY Security Testing NOT READY UX-Testing READY (Accessibility Testing) NOT READY GENERAL RELEASE READINESS CONCLUSSION: NOT READY * Usually has separate release readiness criteria, but in any case it should be sufficient and passed.
  • 91. 9191 Special Types of Testing & Results Type of testing* Sufficient? (yes/no) Passed? Conclusions Load/Performance testing (client/server side) NOT READY Security Testing NOT READY UX-Testing READY (Accessibility Testing) NOT READY GENERAL RELEASE READINESS CONCLUSSION: NOT READY * Usually has separate release readiness criteria, but in any case it should be sufficient and passed.
  • 92. 9292 Special Types of Testing & Results Type of testing* Sufficient? (yes/no) Passed? Conclusions Load/Performance testing (client/server side) NOT READY Security Testing NOT READY UX-Testing READY (Accessibility Testing) NOT READY GENERAL RELEASE READINESS CONCLUSSION: NOT READY * Usually has separate release readiness criteria, but in any case it should be sufficient and passed.
  • 93. 9393 Special Types of Testing & Results Type of testing* Sufficient? (yes/no) Passed? Conclusions Load/Performance testing (client/server side) NOT READY Security Testing NOT READY UX-Testing READY (Accessibility Testing) NOT READY GENERAL RELEASE READINESS CONCLUSSION: NOT READY * Usually has separate release readiness criteria, but in any case it should be sufficient and passed.
  • 94. 9494 Concluding Release Readiness Criterion Status 1. Number of Bugs and their severity NOT READY 2. New Functionality Testing & Results READY 3. Regression Testing & Results READY 4. Test Environments Testing & Results NOT READY 5. Unit & Integration testing & Results READY 6. Special Types of Testing & Results NOT READY GENERAL CONCLUSSION: NOT READY
  • 95. 9595 Concluding Release Readiness Criterion Status 1. Number of Bugs and their severity NOT READY 2. New Functionality Testing & Results READY 3. Regression Testing & Results READY 4. Test Environments Testing & Results NOT READY 5. Unit & Integration testing & Results READY 6. Special Types of Testing & Results NOT READY GENERAL CONCLUSSION: NOT READY
  • 96. 9696 Instruments Facilitating Quality Reporting CSV CSV As Gadgets, iFrames, Screenshots, Links plugins