1 Jun 2013 ... Mike Smith – Chairman, Advanced Level Working Group. (ALWG) .... syllabus. LO
TM. LO TA. LO TTA. AL2012. ISTQB® - November 2012. 15 ...
ISTQB® Advanced Level (CTAL) 2012 Syllabus - Overview Mike Smith – Chairman, Advanced Level Working Group (ALWG) June 2013
Contents 1
Introduction to ISTQB®
2
CTAL 2012: What’s changed?
3
CTAL 2012: Exam Structure
4
Grandfathering & Equivalence
5
Key Dates
6
Meet the Team!
ISTQB® - November 2012
2
ISTQB® – Vision ISTQB® Vision “To continually improve and advance the software testing profession by: Defining and maintaining a Body of Knowledge which allows testers to be certified based on best practices, connecting the international software testing community, and encouraging research.”
ISTQB® - November 2012
3
ISTQB® EcoEco-system ISTQB ®
Examination Body
• Creation of new syllabi • Definition of worldwide rules • Working Group activities
• Performs exams • Issues certificates
Member Board • • • • • •
Translation/ Release of new syllabi Accreditation of training providers Creation and release of exam questions Adoption of ISTQB® rules Contribution to ISTQB® Working Groups Perform exam/ issue certificates
Segregation of duties International harmonization and mutual recognition
ISTQB® - November 2012
Certified
Tester
Accredited Training Provider • Creation of course materials • Delivery of courses
4
ISTQB® Working Groups Training providers
Member Boards
Exam Providers
ISTQB® General Assembly Glossary
Release Management
Executive Committee
Foundation Marketing
Product Dev. Steering Committee
Strategy
Advanced
Audit Expert
ISTQB® - November 2012
Governance
TBOK
Exam 5
Processes
Footprint – Geographic Coverage
46 Boards 70 Countries The countries in which ISTQB® operates contribute to over 90% of the worldwide GDP ISTQB® - November 2012
6
ISTQB® Cumulative Certificates issued
ISTQB® - November 2012
7
Footprint – Number of Certifications
The distribution of Certificates issued by ISTQB® as of March 2012 is as follows:
ISTQB® - November 2012
8
Results Analysis – Pass Rate
ISTQB® - November 2012
9
Footprint – Number of Accredited Training Providers
ISTQB® can rely on a considerable number of accredited training providers worldwide As of March 2012 we can count on: – 180+ accreditations for Foundation Level – 80+ accreditations for Advanced Level
ISTQB® - November 2012
10
ISTQB® Channels You Tube presence
: http://www.youtube.com/user/ISTQBORG
Slide Share presence
: http://www.slideshare.net/ISTQBORG
LinkedIn Community
: http://www.linkedin.com/
groups?about=&gid=4064826&trk=anet_ug_grppro Twitter channel
: http://twitter.com/#!/ISTQBORG
XING community
: https://www.xing.com/net/istqb
Facebook Page
: http://www.facebook.com/istqborg
ISTQB® - November 2012
11
Contents 1
Introduction to ISTQB®
2
CTAL 2012: What’s changed?
3
CTAL 2012: Exam Structure
4
Grandfathering & Equivalence
5
Key Dates
6
Meet the Team!
ISTQB® - November 2012
12
ISTQB® – Levels and Syllabi
ISTQB® - November 2012
13
Improved scoping
A principal objective of the new Advanced Level syllabus is to ensure that there is no overlap between any current ISTQB syllabus.
The Advanced Level syllabus adds to the Foundation Level and fits neatly with the topics managed at Expert Level (Test Management, Improving the Test Process, Test Automation).
In addition, consistency and clear scoping between the three Advanced Level modules has been substantially improved.
ISTQB® - November 2012
14
Clear organization of the syllabus
The Advanced Level syllabus has been created as three stand-alone syllabi (one document for each module syllabus), with an overview document. This structure makes it clearer for everybody (students, training provider and exam creation teams) what is expected and what is to be covered. This is also consistent with the modular structure of the Expert Level. An added benefit is that individual Advanced modules may evolve separately if needed. AL2012
AL2007
Overview
LO TM LO TA LO TTA Combined syllabus ISTQB® - November 2012
TM Syllabus
15
TA Syllabus
TTA Syllabus
Duration of Advanced Modules
Stakeholder feedback has been carefully considered in setting the minimum course duration. As a result of careful scoping and a policy of “no overlaps” the duration of the Test Analyst module has been reduced from 5 to 4 days and the duration of the Technical Test Analyst has been reduced from 5 to 3 days. No overlaps means no common course materials!
TM 5
TA 5
ISTQB® - November 2012
TTA
TM
AL2007
TA
5
5
16
4
AL2012 TTA 3
Business Outcomes
Business Outcomes now form the basis for the Advanced syllabi.
Each Business Outcome provides a statement of what can be expected from a person who achieves the Advanced Level in the particular subject area, (e.g. an advanced test manager).
Business Outcomes are specifically directed to the business needs of industry and will particularly benefit businesses who are considering the development of specific skills at Advanced level.
Approximately 10 Business Outcomes are defined for each Advanced syllabus and are described in the new Advanced Level Overview document.
The learning objectives of each Advanced syllabus implement (and are traceable to) the business outcomes.
ISTQB® - November 2012
17
Learning Objectives
Learning Objectives have been improved by removing potential misinterpretations and by splitting certain “compound” learning objectives into individual parts.
Learning Objectives are now uniquely numbered and placed at the start of each syllabus chapter, in line with Foundations and Expert Level syllabi.
Learning Objectives were reviewed by the Exam Working Group (EWG) in conjunction with ALWG
Sample exam questions created for EVERY Learning Objective by EWG – released with Syllabus
ISTQB® - November 2012
18
Release & Review Process
2012 Advanced Level Syllabus 2 years in the making
ALWG Piloted the new ISTQB Release Process, delivering a Release Plan.
Review process dealt with over 4,000 comments in 4 review cycles – – – –
Internal WG Review Initial Member Board Review Alpha Release to Member Boards Beta Release to public
Full accreditation required for existing 2007 Training Providers Looking ahead: – “Keeping it current” – Retrospective to be conducted in 2013 – Change Request Process
ISTQB® - November 2012
19
ISTQB® – Levels and Syllabi
ISTQB® - November 2012
20
TM Business Outcomes – Part 1
An Advanced Test Manager can… TM1 - Manage a testing project by implementing the mission, goals and testing processes established for the testing organization. TM2 - Organize and lead risk identification and risk analysis sessions and use the results of such sessions for test estimation, planning, monitoring and control. TM3 - Create and implement test plans consistent with organizational policies and test strategies. TM4 - Continuously monitor and control the test activities to achieve project objectives. TM5 - Assess and report relevant and timely test status to project stakeholders.
ISTQB® - November 2012
21
TM Business Outcomes – Part 2
An Advanced Test Manager can… TM6 - Identify skills and resource gaps in their test team and participate in sourcing adequate resources. TM7 - Identify and plan necessary skills development within their test team. TM8 - Propose a business case for test activities which outlines the costs and benefits expected. TM9 - Ensure proper communication within the test team and with other project stakeholders. TM10 - Participate in and lead test process improvement initiatives.
ISTQB® - November 2012
22
ISTQB® – Advanced Level Test Manager (CTAL - TM 2012) Testing Process
Test Management
Reviews
Defect Management
Improving the testing process
People Skills Team Composition
Testing in the Software Development Lifecycle
Risk Based Testing
Management Reviews and Audits
Defect Lifecycle
Test Improvement Process
Individual Skills
Test Planning, Monitoring and Control
Test Documentation
Managing Reviews
Defect Report Information
Improving the testing process with CMMi, TPI, CTP and STEP
Test Team Dynamics
Test Analysis, Design and Implementation
Test Estimation & Test Metrics
Metrics for reviews
Test Tool and Automation
Fitting testing within an organization
Evaluation Exit Criteria and Reporting
Business Value of Testing
Managing Formal Reviews
Tool Selection
Motivation
Test Closure Activities
Distributed, Outsourced and Insourced Testing
Tool Lifecycle
Communication
Managing the application of Industry Standards
Tool Metrics
ISTQB® - November 2012
23
Major Changes from 2007 version The principal Test Manager subjects covered remain the same. However, the content has been improved. Redundancies with FL have been removed (e.g. reviews). The Expert Level syllabi “Test Management“ and “Improving the Test Process“ are now available. Scoping and alignment with these syllabi has taken place. The defect management chapter is no longer based on IEEE-1044 and focuses more on setting up a defect management lifecycle and using defect data for process improvement.
ISTQB® - November 2012
24
ISTQB® – Levels and Syllabi
ISTQB® - November 2012
25
TA Business Outcomes – Part 1
An Advanced Test Analyst can… TA1 - Perform the appropriate testing activities based on the software development lifecycle being used. TA2 - Determine the proper prioritization of the testing activities based on the information provided by the risk analysis. TA3 - Select and apply appropriate testing techniques to ensure that tests provide an adequate level of confidence, based on defined coverage criteria. TA4 - Provide the appropriate level of documentation relevant to the testing activities. TA5 - Determine the appropriate types of functional testing to be performed.
ISTQB® - November 2012
26
TA Business Outcomes – Part 2
An Advanced Test Analyst can… TA6 - Assume responsibility for the usability testing for a given project. TA7 - Effectively participate in formal and informal reviews with stakeholders, applying knowledge of typical mistakes made in work products. TA8 - Design and implement a defect classification scheme. TA9 - Apply tools to support an efficient testing process.
ISTQB® - November 2012
27
ISTQB® – Advanced Level Test Analyst (CTAL - TA 2012) Testing Process
Test Management
Test Techniques
Testing Software Quality Characteristics
Reviews
Test Tools
Testing in the Software Development Lifecycle
Test Progress Monitoring and Control
SpecificationBased Techniques
Accuracy Testing
Using Checklist in Reviews
Test Design Tools
Test Planning, Monitoring and Control
Distributed, Outsourced and Insourced Testing
Defect-Based techniques
Suitability Testing
Defect Management
Test Data Preparation Tools
Test Analysis, Design and Implementation
Risk Based Testing
ExperienceBased Techniques
Interoperability Testing
Defect Report Fields
Automated Test Execution Tools
Evaluation Exit Criteria and Reporting
Usability Testing
Defect Classification
Test Closure Activities
Accessibility Testing
Root Cause Analysis
ISTQB® - August 2012
28
Major Changes from 2007 version The major concentration of this syllabus remains on the testing techniques and test process. Domain analysis and user stories are new to the specification-based techniques section. Content has been significantly revised to align the scope with Foundation, other Advanced Level syllabi and Expert Level Test Automation. The Test Management and Tools chapters are relatively short and cover only the specific issues relating to the Test Analyst. The defect management chapter is no longer based on IEEE-1044 and focuses more on defect categorization and performing initial root cause analysis of defects. ISTQB® - November 2012
29
ISTQB® – Levels and Syllabi
ISTQB® - November 2012
30
TTA Business Outcomes – Part 1
An Advanced Technical Test Analyst can… TTA1 - Recognize and classify the typical risks associated with the performance, security, reliability, portability and maintainability of software systems. TTA2 - Create test plans which detail the planning, design and execution of tests for mitigating performance, security, reliability, portability and maintainability risks. TTA3 - Select and apply appropriate structural design techniques to ensure that tests provide an adequate level of confidence, based on code coverage and design coverage. TTA4 - Effectively participate in technical reviews with developers and software architects applying knowledge of typical mistakes made in code and architecture.
ISTQB® - November 2012
31
TTA Business Outcomes – Part 2
An Advanced Technical Test Analyst can… TTA5 - Recognize risks in code and software architecture and create test plan elements to mitigate those risks through dynamic analysis. TTA6 - Propose improvements to the security, maintainability and testability of code by applying static analysis. TTA7 - Outline the costs and benefits to be expected from introducing particular types of test automation. TTA8 - Select appropriate tools to automate technical testing tasks. TTA9 - Understand the technical issues and concepts in applying test automation.
ISTQB® - November 2012
32
ISTQB® – Advanced Level Technical Test Analyst (CTAL - TTA 2012) Risk Based Testing
Structure-Based Testing
Analytical Techniques
Quality Characteristics for Technical testing
Reviews
Test Tools and Automation
Risk Identification
Condition Testing
Static Analysis
General Planning Issues
Using Checklist in Reviews
Integration and Information Interchange
Risk Assessment
Modified Condition / Decision Coverage (MC/DC) Testing
Dynamic Analysis
Security & Reliability Testing
Defining the Test Automation Project
Risk Mitigation
Path Testing
Performance Testing
Specific Test Tools
API Testing
Resource Utilization
Maintainability Testing
Portability Testing
ISTQB® - November 2012
33
Major Changes from 2007 Version – Part 1 A significant refocus on the technical aspects of testing has been completed. As a result it is now expected that candidates must be able to read and understand pseudocode.
The basic aspects of testing and the testing process are now covered in other syllabi.
The test management chapter is relatively short and covers only the specific issues relating to the Technical Test Analyst.
ISTQB® - November 2012
34
Major Changes from 2007 Version – Part 2
Testing techniques remains a significant part of the syllabus and accounts for approximately one third of the training time. Six techniques are covered, including basis path testing and API coverage. The LCSAJ technique has been removed from the syllabus.
Content has been significantly reduced due to scoping with the other syllabi (in particular Test Analyst). Content has been significantly reduced due to scoping with the other syllabi (in particular Test Analyst).
ISTQB® - November 2012
35
Contents 1
Introduction to ISTQB®
2
CTAL 2012: What’s changed?
3
CTAL 2012: Exam Structure
4
Grandfathering & Equivalence
5
Key Dates
6
Meet the Team!
ISTQB® - November 2012
36
Advanced 2012 Exam Structure
The exam is still multiple-choice questions, but number of questions and length of exams have changed from 2007 Version
Module Advanced Test Manager Advanced Test Analyst Advanced Technical Test Analyst 5
5
Number of Exam Length questions (in minutes)
65 60 45
Exam Length + 25% (in minutes)
180
225
180
225
120
150
5
Pass Mark is 65% for ALL exams, regardless of number of questions
ISTQB® - November 2012
37
Exam Questions
Questions are selected according to defined set of rules: – LO distribution, LO K Level, relative LO importance and points total – The Advanced Level examinations shall be based on the Advanced Level syllabus. Answers to examination questions may require the use of material from more than one section of this syllabus. The exam questions may require the knowledge of Foundation examination level – All learning objectives (on cognitive levels K1 to K4) in the syllabus are examinable.
A public version of the Exam Structure & Rules is available
ISTQB® - November 2012
38
Treatment of external reference materials
Standards (IEEE, ISO, etc.) are referenced in the syllabi. The purpose of these references is to provide a framework (as in the references to ISO 9126/ISO 25000 regarding quality characteristics) or to provide a source of additional information if desired by the reader. Please note that only the items from these standards that are referenced specifically in the syllabi are eligible for examination. The standards documents themselves are not intended for examination and are included only for reference.
ISTQB® - November 2012
39
Exam Entry Requirements
To be able to obtain an Advanced Level certification, candidates must: 1. Hold the Foundation Certificate 2. Satisfy the board which examines them that they have sufficient practical experience to be considered Advanced Level qualified. Refer to the relevant Exam Board and/or National Board to check the specific criteria used to evaluate practical experience.
ISTQB® - November 2012
40
Contents 1
Introduction to ISTQB®
2
CTAL 2012: What’s changed?
3
CTAL 2012: Exam Structure
4
Grandfathering & Equivalence
5
Key Dates
6
Meet the Team!
ISTQB® - November 2012
41
Grandfathering – Part 1
ISTQB Advanced Test Manager certificates earned by passing exams against all earlier versions of Advanced Syllabi are treated as equivalent to the Advanced Test Manager certificates earned by passing exams against CTAL2012-TM.
ISTQB Advanced Functional Tester and Advanced Test Analyst certificates earned by passing exams against all earlier versions of Advanced Syllabi are treated as equivalent to the Advanced Test Analyst certificates earned by passing exams against CTAL2012-TA.
ISTQB Advanced Technical Tester and Advanced Technical Test Analyst certificates earned by passing exams against all earlier versions of Advanced Syllabi are treated as equivalent to the Advanced Technical Test Analyst certificates earned by passing exams against CTAL2012TTA.
ISTQB® - November 2012
42
Grandfathering – Part 2
ISEB Practitioner certificates earned by passing an exam taken no later than March 31, 2008 [i.e., under the original Practitioner program] are treated as equivalent to the Advanced Test Manager, Advanced Test Analyst, and Advanced Technical Test Analyst certificates earned by passing exams against CTAL2012.
ISEB Test Management Practitioner certificates earned by passing exams against the new ISEB Practitioner Syllabus (since April 1st, 2008) are treated as equivalent to the Advanced Test Manager certificates earned by passing exams against CTAL2012-TM.
ISEB Test Analysis Practitioner certificates earned by passing exams against the new ISEB Practitioner Syllabus (since April 1st, 2008) are treated as equivalent to the Advanced Test Analyst certificates earned by passing exams against CTAL2012-TA.
ISTQB® - November 2012
43
Grandfathering - Consequences
ISTQB, the National Boards, and the Exam Boards shall not take any action, impose any pre-requisites, or pass any rule or by-law, including at the Expert level, which would favor one equivalent certificate over another. For example, suppose that Advanced Test Analyst certification is a pre-requisite to take a given Expert exam. Advanced Functional Tester or ISEB Test Analysis Practitioner certificate holders may also take the same Expert exam, and no additional burden shall be placed on them to do so. Equivalence does not mean substitution. ISTQB, the National Boards, and the Exam Boards shall only issue certificates showing certification against the CTAL2012 for candidates who have passed an exam run against CTAL2012. Treatment as equivalent does not mean that they are in fact identical in coverage. ISTQB, the National Boards, and the Exam Boards shall post on their Web sites the six statements of equivalent treatment listed above.
ISTQB® - November 2012
44
Contents 1
Introduction to ISTQB®
2
CTAL 2012: What’s changed?
3
CTAL 2012: Exam Structure
4
Grandfathering & Equivalence
5
Key Dates
6
Meet the Team
ISTQB® - November 2012
45
Key Dates
Earliest date for 2012 exams – 1st December 2012 (Check with your local board)
Sunset dates for courses - no further 2007 courses allowed to start : – April 19th 2013 (English), July 19th 2013 (non-English)
Sunset date for exams - no further 2007 exams allowed : – July 19th 2013 (English), October 19th 2013 (non-English)
ISTQB® - November 2012
46
Contents 1
Introduction to ISTQB®
2
CTAL 2012: What’s changed?
3
CTAL 2012: Exam Structure
4
Grandfathering & Equivalence
5
Key Dates
6
Meet the Team!
ISTQB® - November 2012
47
Advanced Level Working Group 2012 ISTQB WG Chair: Mike Smith, Vice: Bernard Homes Test Manager Authoring Team
Test Analyst Authoring Team
Co-ordinator: Rex Black
Co-ordinator: Judy McKay
Technical Test Analyst Authoring Team Co-ordinator: Graham Bath
Advanced Level Working Group: Review Team
ISTQB® - November 2012
48
Advanced Level 2012 Authoring Team
Tsuyoshi Yumoto Graham Bath Kenji Onishi
Rex Black Mike Smith
Bernard Homes Jamie Mitchell
Paul Jorgensen (Not in Picture) ISTQB® - November 2012
49
Judy McKay
