Post. Release. Page 5 of 39. OOW13 - Testing Oracle E-Business Suite -Best Practices.pdf. OOW13 - Testing Oracle E-Busin
Testing Oracle E-Business Suite: Best Practices Srikanth Krishnan Senior Director, Oracle Mazen Arar Senior Director, Oracle
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
2
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Program Agenda E-Business Suite Testing Approach Recommended Approach Leveraging Automation for E-Business Suite
Applications
3
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
E-Business Suite Testing Approach Testing accounts for 3050% of the effort in a typical upgrade project. Of that, the effective testing time is usually only about a third.
Coding
4
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Design
Testing
E-Business Suite Testing Approach Cost to fix an error goes up at each stage of the project.
120 100 80 60 40
5
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Post Release
Beta Testing/Pi lot
Functional / System Testing
Coding and Unit Testing
0
Requirem ents and Design
20
E-Business Testing Approach Software Development Lifecycle Strategy
Maintenance
Requirements
Launch
Design
Test
6
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Construct
Insert Information Protection Policy Classification from Slide 12
E-Business Testing Approach When do we test
What do we test
New releases
System and regression testing
RUPs & Consolidations
Integration testing
New Features & bug fixes
Upgrade testing
Technology changes
Accessibility testing
Compliance and Statutory
Security testing
and more ..
Interface testing and more ..
7
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
E-Business Testing Approach How Do We Scope Testing Impacted Areas
New Features
Code Change
Baseline
8
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Use Cases
Test Scoping
Insert Information Protection Policy Classification from Slide 12
Exploratory
E-Business Testing Approach Stakeholder Testing Customers
Support Consulting
Partners
9
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Recommended Approach
Prepare
10
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Plan
Insert Information Protection Policy Classification from Slide 12
Perform
Patch Uptakes One-offs & Consolidations Patch Readme Specific notes on Oracle MOS Review Release Content
Document Functional Impact Document
11
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Upgrades Tools and Documents Upgrade advisor Migration checklist Migration best practices Migration messages and
technical reference Migration reference guide
12
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Plan for Testing
13
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Generate
Refine
Prioritize
Measure
Insert Information Protection Policy Classification from Slide 12
Generate Generate Test Cases Using Mind Map Mind Map Tool Visual Ideation Organization
14
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Refine Refine Test Cases Using Pair Wise Algorithm Parameter
Data Values
Course Offering
Online, In a Class, Web Conference, Self Study (4)
Course Type
Normal Content, Assessment, Both (3)
Learner Access
Self, Approval, Mandatory (3)
Enrollment Limit
Limited, Unlimited (2)
Waitlist
Allowed, Not Allowed (2)
Cost
Free Course, Priced Course (2)
Total combinations to create a new training course: 4*3*3*2*2*2 = 288 15
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Refine Refine Test Cases Using Pair Wise Algorithm
16
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Measure Measure Coverage with Attribute Coverage Tool
Feature Sub-Feature
Test Cases
17
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Prioritize
Identify Impacted Areas
Prioritize Test Cases
Submit
18
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Prioritize Prioritize Test Cases at Each Level Level 1: Baseline Coverage Basic flows Sanity checks of key features Recommended for technology changes, infrastructure changes and security patches uptake
19
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Level 2: Intermediate Coverage
Level 3: Detailed Coverage
Specific flows Covers key features for impacted products Bug fix analysis for inputs on specific areas to test Recommended for product fixes and consolidations uptake
Detailed flows Full feature tests for implemented products Include checks for flow and data variations End to End flows cutting across products Recommended for RUPs, upgrades, new release and deployment of new modules.
Insert Information Protection Policy Classification from Slide 12
Validate Pre-requisites Diagnostic Reports Options – Profiles, Financial, Receiving
Key Flexfields Several Diagnostic Reports
available across all product families in EBS
20
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Validate Pre-requisites
21
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Validate Results Test Oracles Include data variants Validate complex transactions – Ex: Financial validations,
Costing validations Compare intended with actual
results
22
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Testing Techniques Pair Testing Session Based Testing
Theme Based Testing Exploratory Testing
Scripted Testing
Exploratory Testing Bug Discovery
23
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Automation Challenges Web Services Based UI Based
24
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Web Services Testing Advantages Reduction in cost of
development for huge number of transactions and data variants Drastic reduction in execution
time No impact due to UI changes
25
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Automation Challenges Web Services Based UI Based ‾ Maintainability ‾ Reuse ‾ High initial investment
ROI 40 20 +
00 -20 -
-40 -60
26
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Leveraging Automation for E-Business Suite Applications
27
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Oracle Application Testing Suite (OATS) Powerful, integrated Oracle Functional Testing
Oracle Test Manager
28
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
solution for ensuring application quality.
Oracle Load Testing
Insert Information Protection Policy Classification from Slide 12
Oracle Application Testing Suite (OATS) Oracle’s Solution for Testing Oracle Applications
Oracle Functional Testing Suite for Oracle Applications
• Functional and Regression Testing • Web and Oracle Application Testing Accelerators • Oracle Flow Builder
Oracle Load Testing Suite for Oracle Applications
• Load and Performance Style Testing • Web and Oracle Application Testing Accelerators • Smart Integration with EM Diagnostics
Oracle Test Manager
29
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
• Test Planning, Requirements and Test Cases • Defects Tracking • Reporting
Insert Information Protection Policy Classification from Slide 12
Oracle Functional Testing Suite for Oracle Applications Optimized Solution for Automating EBS Testing
OpenScript: Traditional Record/Playback
Flow Builder: Test Script Generation – Data Independent – Easy Maintenance – For Non-Technical People
30
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Functional Testing Suite for Oracle Applications
– With Accelerators for Oracle Applications
Insert Information Protection Policy Classification from Slide 12
Flow Builder
Generate
Framework to combine flows and data to generate test scripts
OpenScript Record & Playback + Advanced Scripting
Record Manually
Test Automation Scripts
Oracle Functional Testing Suite for Oracle Applications Reduce Testing Effort with Flow Builder & EBS Pre-Built Test Content Your Flows
Use Flow Builder to Generate Test Scripts
Your Data
– 2000+ Components and 200+ Flows
Create and Maintain Your Test Scripts – Add Your Flows & Data – Extend with More Components
EBS Quality Assurance Team Reduced Automation Time by 60%
31
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Functional Testing Suite for Oracle Applications
Start with EBS Pre-Built Test Content
Insert Information Protection Policy Classification from Slide 12
EBS Pre-Built Test Content Flow Builder
Generate
Framework to combine flows and data to generate test scripts
OpenScript Record & Playback + Advanced Scripting
Record Manually
Test Automation Scripts
Oracle Flow Builder: EBS Pre-Built Test Content Jump Start Your Testing
2000+ Components and 200+ Flows Across EBS
Financials
Logistics
32
Procurement
Projects
Human Capital Management
Order Management
Manufacturing
Asset Lifecycle Management
Service
Master Data Management
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Oracle Flow Builder Keyword Driven Componentized Framework
Keywords Mimic a user action. Ex: ‒Click ‒SetText ‒SelectLOV 66 Keywords available to perform various actions within an EBS application
33
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Components Sequence of keywords to perform a transaction. Ex: ‒Create order header ‒Approve order Can be reused across multiple flows Group transactions performed together into Component Sets
Insert Information Protection Policy Classification from Slide 12
Flows Assemble Components / Component Sets in a sequence to orchestrate a business process. Ex ‒Order to cash ‒Procure to pay Populate test data
Graphic Section Divider
34
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Summary
35
Post Release
Testing
Beta Testing/Pil ot
Functional / System Testing
Requirem ents and Design
150 100 50 0
Design
Coding and Unit Testing
Coding
Increase in effective testing time Reduce cost to fix an error
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Questions
[email protected]
[email protected]
36
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
References
Functional Impact Documents on MOS – ALM Doc Id: 1539532.1 – OPM Doc Id: 1585010.1
37
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
38
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
39
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
