Test documentation and Reporting
|
|
- Helen French
- 5 years ago
- Views:
Transcription
1 T Software Testing and Quality Assurance Test documentation and Reporting SoberIT
2 IEEE 829 Standard for Software Test Documentation Test Planning Test plan Project level Phase level Test Specification Test design Specification Test case specification Test procedure specification Test Reporting Transmittal report Test log Incident report Test summary report Number of needed test documents, their format, thoroughness and level of detail depends on context. 2
3 IEEE 829 Standard for Software Test Documentation Test Planning Test plan Project level Phase level Test Specification Test design Specification Test case specification Test procedure specification Test Reporting Transmittal report Test log Incident report Test summary report 3
4 Test plan a project plan for testing A document describing the scope, approach, resources, and schedule of intended testing activities. It identifies test items, the features to be tested, the testing tasks, responsibilities, schedules, and risks Test plan can be either product or tool Test plan as a product: structure, format and level of detail are determined not only what s best for the effectiveness of the testing effort but also by what customer or regulating agency requires. Test plan as a tool: Creating long, impressive, or detailed test planning documents is not the best use of your limited time. A test plan is a valuable tool to the extent that it helps you manage your testing project and achieve your testing goals. 4
5 Test Plan (IEEE Std 829) 1/5 1 Test plan identifier 2 Introduction Product to be tested, objectives, scope of the test plan Software items and features to be tested References to project authorization, project plan, QA plan, CM plan, relevant policies & standards 3 Test items Test items including version/revision level Items include end-user documentation Bug fixes How transmitted to testing References to software documentation 5
6 Test Plan (IEEE Std 829) 2/5 4 Features to be tested Identify test design / specification techniques Reference requirements or other specs 5 Features not to be tested Deferred features, environment combinations, Reasons for exclusion 6 Approach How you are going to test this system Activities, techniques and tools Detailed enough to estimate Completion criteria Specify degree of comprehensiveness (e.g. coverage) and other criteria (e.g faults) Identify constraints (environment, staff, deadlines) 6
7 Test Plan (IEEE Std 829) 3/5 7 Item pass/fail criteria What constitutes success of the testing E.g. coverage, bug count, bug rate, number of executed tests, Is NOT product release criteria 8 Suspension and resumption criteria For all or parts of testing activities Which activities must be repeated on resumption 9 Test deliverables Test plan Test design specification Test case specification Test procedure specification Test item transmittal report Test logs Test incident reports Test summary reports 7
8 Test Plan (IEEE Std 829) 4/5 10 Testing tasks Including inter-task dependencies & special skills Estimates 11 Environment Physical, hardware, software, tools Mode of usage, security, office space Test environment set-up 12 Responsibilities To manage, design, prepare, execute, witness, check, resolve issues, providing environment, providing the software to test 13 Staffing and Training needs 8
9 Test Plan (IEEE Std 829) 5/5 14 Schedule Test milestones in project schedule Item transmittal milestones Additional test milestones (environment ready) What resources are needed when 15 Risks and Contingencies Testing project risks Contingency and mitigation plan for each identified risk 16 Approvals Names and when approved 9
10 Course Test Plan Template for the exercise phase 3 The high level structure for your test plan Details below each chapter give you the idea of the contents of each chapter You should apply information from your course book, lectures, and IEEE standard to make as good test plan as possible Remember: Content or nothing Grading is not based on word count 1. Introduction 2. Tested items and features 3. Testing Approach 4. Resources 5. Tasks and Schedule 6. Risks and contingencies 7. Approvals 10
11 Test plan quality criteria Usefulness: Will the test plan effectively serve its intended functions? Clarity: Is the test plan self-consistent and sufficiently unambiguous? Accuracy: Is the test plan document accurate with respect to any statements of fact? Adaptability: Will it tolerate reasonable change and unpredictability in the project? Efficiency: Does it make efficient use of available resources? Usability: Is the test plan document concise, maintainable, and helpfully organized? Compliance: Does the test plan meet externally imposed requirements? Foundation: Is the test plan the product of an effective test planning process? Feasibility: Is the test plan within the capability of the organization that must use it? Source: Kaner, Bach, Pettichord. Lessons Learned in Software Testing
12 IEEE 829 Standard for Software Test Documentation Test Planning Test plan Project level Phase level Test Specification Test design Specification Test case specification Test procedure specification Test Reporting Transmittal report Test log Incident report Test summary report 12
13 Test Case Specification (IEEE Std 829) 1. Test-case-specification identifier: specifies the unique identifier. 2. Test items: detailed feature, code module, etc. to be tested; references to product specifications or other design docs 3. Input specifications: Each input required to execute the test case (by value with tolerances or by name); identifies all appropriate databases, files, terminal messages, etc.; specifies all required relationships between inputs (for example, timing) 4. Output specifications: result expected from executing the test case; outputs and features (for example, response time) required of the test items; exact value (with tolerances where appropriate) for each required output or feature 5. Environmental needs: hardware, software, test tools, facilities, staff, etc. 6. Special procedural requirements: special constraints 7. Intercase dependencies: lists the identifiers of test cases which must be executed prior to this test case; the nature of the dependencies 13
14 Test design specification Specifies a one set of tests and refines the test plan information Specific methods, tools and techniques Groups together tests that test a certain set of features References to test procedures and test cases Pass/fail criteria 14
15 Test procedure specification Used if needed Test plan and test design specification are not enough Specifies the steps for executing a set of test cases Special requirements for executing the tests References to test cases Steps and any measurements to be made 15
16 IEEE 829 Standard for Software Test Documentation Test Planning Test plan Project level Phase level Test Specification Test design Specification Test case specification Test procedure specification Test Reporting Transmittal report Test log Incident report Test summary report 16
17 Reporting test results Evaluation of the tested software Found defects and issues Testers assessment of the quality Risk assessment based on test results and gained knowledge Comparison of planned vs. actual Testing project management report A post mortem for tests to come Weak and omitted areas Ideas for new tests Risks 17
18 Test record (log) contains Chronological record of relevant details about the tests execution Identities and versions (unambiguously) of Software under test (exact build, versions of components, ) Test specifications Testing environment Identify the attributes of the environments in which the testing is conducted Include hardware being used (e.g., amount of memory being used, CPU model, mass storage devices) system software used resources available Activity entries Date and time for beginning and end of activities Identity of the tester Execution description Results Anomalous events Defect ID:s References to other documents (test case, test design specification, ) 18
19 Check the results Follow the plan and mark off progress on test script Note that these records are used to establish that all test activities have been carried out as specified Document actual outcomes from the test Capture any other ideas you have for new test cases Compare actual outcome with expected outcome. Log discrepancies accordingly Software fault Test fault (e.g. expected results wrong) Environment or version fault Test run incorrectly Log coverage and other planned metrics for measures specified as test completion criteria 19
20 Defect reporting Defect report A technical document written to describe the symptoms of a defect to Communicate the impact and circumstances of a quality problem Prioritize the defect for repair Help a programmer to locate and fix the underlying fault Defect reports are the most frequent and visible results of testing work Defect reports are an important communication channel from testing to development Defect reports are challenging to write Bearing bad news Explaining complicated behaviour Communicating to people with different mindset using as few words as possible Goal is to make people fix their mess instead of creating some new fancy functionality 20
21 Reporting the found defects Report the defects immediately Don t leave it until the end of test session Make sure the defect has not been previously reported Find out how to reproduce the defect Easier to isolate and get fixed Write specific and clear defect reports Spend some time to find out what is the actual defect and under which conditions it occurs What were the specific expected outcome and the actual outcome Be non-judgmental in reporting bugs. Bug reports need to be non-judgmental and non-personal Reports should be written against the product, not the person, and state only the facts. 21
22 An effective bug description Useful bug reports are ones that get bugs fixed! Minimal Just the facts and details necessary An exact sequence of steps that shows the problem Singular Only one bug per report only one report per bug Obvious and general Use steps that are easily performed and show the bug to be as general as possible and readily seen by users If a programmer or tester has to decipher a bug, they may spend more time cursing the submitter than solving the problem Reproducible Isolate and reproduce what seems like random software behavior If an engineer can't see it or conclusively prove that it exists, the engineer will probably stamp it "WORKSFORME" or "INVALID", and move on to the next bug. Severity Show clearly how severe are the consequences if this defect is delivered to operation 22
23 10 steps to great defect reports 1. Structure Testing must be structured, to understand what you are doing. 2. Reproduce Clear steps. Three tries. 3. Isolate Which factors affect the defect and how. 4. Generalize Try to find out the more general case when the defect occurs. 5. Compare Does the same defect exist in other versions, and other parts of the product. 6. Summarize Communicate with a single sentence the essence and significance of the defect. 7. Condense Remove any excess information. Use just the words you need and describe only the necessary steps. 8. Disambiguate Remove confusing or misleading words be clear. 9. Neutralize As a bearer of bad news, express yourself calmly, don t attack programmer or use unnecessary humour or sarcasm. 10. Review E.g. informal check by another tester, or pair testing. Rex Black, Critical Testing Processes. 23
24 Motivate fixing the defect Make the defect look more serious Find a credible scenario that demonstrates the impact of the defect E.g., a realistic story that describes how a user can lose data when this defect occurs Make the defect look more general You discovered the defect in some specific case What is the most general case the defect occurs E.g., if you first found out that the system cannot cope with ~ and \ you might be able to generalize the defect into the system only accepts characters a-z, A-Z and 0-9 and not any special characters including -, ä, and ö. 24
25 Defect report 1. Defect-report identifier 2. Title: A short description of the defect 3. Bug description: A detailed description of the defect Date, time and finder Test item and environment including version and build numbers Expected results Actual results Repeatability (whether repeated; whether occurring always, occasionally or just once) Additional information that may help to isolate and correct the cause of the incident 4. Severity of the bug 25
26 Reporting a bug an exercise Suppose that you are running tests on the Windows Calculator and find following results: 1+1=2 2+2=5 3+3=6 4+4=9 5+5=10 6+6=13 4+6=10 4+5=9 Write a bug title and bug description that effectively describes the problem. 26
27 Reporting a bug one solution Title: Adding a pair of equal even numbers gives too big result (by one) Description: Setup: start Version 1.0 of Calculator Repro steps: Try adding pairs of equal even number such as 2+2, 4+4, and Also try adding pairs of equal odd numbers such as 3+3, 5+5, and and pairs of unequal numbers such as 1+2, 4+6, and Expected result: Correct answer for all pairs 2+2=4, 4+4=8 Actual result: For pairs of equal even numbers, the answer is one too big: 2+2=5, 4+4=9, 10+10=21 and so on. Other info: This wasn t tried exhaustively, but the bug occurred on many instances from 2+2 to The bug doesn t seem to occur with odd numbers or unequal pairs. Environment: Windows 2000, , Service Pack 4 Reporter: Jack Debugger 27
28 Test Summary Report (IEEE Std 829) 1/2 1. Test-summary-report identifier 2. Summary summarizes the evaluation of the test items identifies the items tested (including their version/revision level) indicates the environments in which the testing took place supplies references to the documentation over the testing process 3. Variances indicates any variances of the actual testing process from the test plan or test procedures specifies the reason for each variance 4. Comprehensiveness assessment evaluates the comprehensiveness of the actual testing process against the criteria specified in the test plan identifies features or feature combinations which were not sufficiently tested and explains the reasons for omission 28
29 Test Summary Report (IEEE Std 829) 2/2 5. Summary of results summarizes the success of testing (such as coverage, numbers of defects, severities, etc.), identifies all resolved and unresolved incidents 6. Evaluation provides an overall evaluation of each test item including its limitations based upon the test results and the item-level pass/fail criteria 7. Summary of activities the major testing activities and events resource consumption (total staffing level, total person-hours, total machine time, total elapsed time used for each of the major testing activities, ) 8. Approvals specifies the persons who must approve this report (and the whole testing phase) 29
30 Meetings, reports and project control issues Test manager should collect and track the metrics regularly (weekly) and direct the testing groups efforts by status meetings Test results must be reported regularly to the whole project group (or development team) Depending on the used sw development model, the required pace of feedback (test results) varies from 1 day to over a month The mission of a testing team is to produce, for the rest of the organisation, relevant information about the quality status of the system promptly and in a useful form Summary reports are provided to upper management at least in every milestone 30
31 Status reports to management Reports should be brief and contain (J. Rakos) Activities and accomplishments during the reporting period Problems encountered since the last meeting/report Problems solved Outstanding problems Current state versus plan Expenses versus budget Plans for the next time period What is the most important information for upper management from a testing project? 31
32 The most important information (my answer) 1. Evaluation of quality and status of the software development (project) Brief Easy and quick to understand Brings clearly forth the relevant information Risks 2. Problems that require management actions 3. Status of testing versus plans Accomplishments, coverage, defect counts and rates Expenses Required changes to plans 32
33 Testing Dashboard Build Functional Area Activity Coverage Quality Comments Perfect File management low 2 Hmm Main hierarchy high 2 Some weird behavior, still testing Aargghhh! Formatting high 2 Some critical bugs found Drag and drop pause 1 Don't work with other applications 3 Its tested Imports Ready 3 2 Features checked Exports blocked 0 Can't test: no specs for exprt formats 1 We tried it (once) Overall GUI blocked 3 A lot of small bugs 0 Nothing Editing area pause 2 Looks good Clipboard 0 Not delivered Property tables 0 Not implemented Preferences high 1 Nothing serious yet Help pause 2 Mainly spelling and grammatic issues Kaner et al Lessons Learned in Software testing. 33
34 Risk-based reporting All identified risks open at the beginning Start Today Planned End Residual risks of releasing to d a y Residual Risks Progress through the Planned Testing Gerrard, P. & Thompson, N Riskbased E-business Testing. 34
35 Risk based testing Risk based test case design techniques Goal is to analyse product risks and use that information to design good tests (test-cases) How this system could fail? Error guessing Failure models Experience Risk based test management Estimating risks for each function or feature Using risk analysis to prioritise testing Choosing what to test first Choosing what to test most 35
36 Qualitative vs. quantitative Technical Incompatibility Technical Incompatibility Very likely 70% likelihood Could affect many users may affect 80 % of users System facilities not fully available or usable 7 facilities could be unusable, 3 difficult to use Funding withdrawn Funding withdrawn Unlikely 5 % probability Severe impact 95 % chance of project cancellation (5 % find other sponsors) 36
37 Qualitative risk analysis Nightmares Severe impact Some impact Severe impact, unlikely Some impact, unlikely Severe impact, midlikely Some impact, mid-likely Severe impact, likely Some impact, likely Most benefits in addressing these risks Low impact Insignificant Low impact, unlikely Low impact, mid-likely Low impact, likely unlikely mid-likely likely Nuisances 37
38 Example Statistical Risk Analysis Matrix Cost * Probability = Re Dev Cust Avrg. New Func. Design Qual. Size Complexity Weigh. Sum Risk Exposure Weight Interest Calculation Close Account Idea is to get the features into 1 3 priority order - somehow Create Account 2 1 1, ,5 Modified slide, originally from Ståle Amland 38
39 Test catalogs can be helpful Collections an empty collection exactly one element (this is somewhat low-yield) more than one element the maximum number of elements (if that's not reasonable, try it at least once with more than just a few elemen duplicate elements Searching Collections match not found. (If searching a limited subset of a collection, arrange for there to be a match outside that subset. Example below.) one match (The best possible place to put it is probably just before the end bounds, if such a thing makes sense. Example below.) more than one match Finding subsets (filtering out elements) Filtering out no elements (subset is the same as the original) Filtering out one element Filtering out all but one element Filtering out all elements (subset is empty) Special collection elements the collection contains itself (redundant with next one, but the first one to try). indirect containment: the collection contains a collection that contains the original collection Pairs of collections Both collections empty First collection has one element, second has none. First collection has no elements, second has one. Both collections have more than one elements. 39
40 Containers Appending to a container's contents Container initially empty. Container initially not empty. Adding just enough elements to fill it. A full container, adding one element. A partially full container, add one too many elements Add zero new elements Overwriting a container's contents New contents have one more element than will fit New contents just fit. Zero elements used. Is the container correctly emptied? Some elements added, but fewer than in original (are old contents correctly cleared?) Deleting elements The container has one element (low yield) The container is already empty. Files Ability to operate on the file the file exists it's readable it's not readable it's writeable it's not writeable the file does not exist it doesn't exist, but it can be created it doesn't exist, and it can't be created File types An ordinary file A directory/folder An alias or symbolic link (note that both exist on Mac OS X) A special file (Unix) 40
41 Names Whatever the name names does not exist Two different names name the same thing. Pathnames POSIX / Mac OS X Empty. (For example, in a Unix shell, give it the argument "", which is equivalent to ".".) Absolute Example: /tmp/foo Relative Example: tmp/foo If the program is likely to take the pathname apart (to use one of its parts, or to build a new pathname): Containing the component "..", as in../../dir/x Slash at end: foo/ No slash: foo Slash in the middle: foo/bar More than one slash: foo/bar/baz Duplicate slashes: foo//bar (should be equivalent to foo/bar) Pathname as argument to command-line command: Pathname begins with dash. (How do you get the command to work on -file?) Percentage If the percentage is calculated from some Count, try to make the count be zero. 41
42 Textual Input/Quoted Unpaired Quotes Like Unix's use of \ to quote many special characters, or comments that apply from comment character like # or // to the end of the line. In the Quote mark as first character in text. Example: \abcd Quote mark somewhere in the middle of the text. Example: ab\cd Quote mark as the last character (quoting nothing). Example: abcd\ Paired Quotes Like double quotes (") around strings, or /* */ around Java comments. I'll use /* and */ for start-of-quote and end-of-quote. Quote everything - no unquoted text. A quote in the middle - with "real" text before and after it. Example: ab/*de*/fg No closing quote mark. Example: ab/*de Opening quote as last character in the text. Example: /* Nested quotes. Example: /*/*hi*/*/ Nothing inside the quote. (low yield) Example: /**/ Open quote without close quote. Example: /*no end Close quote without open quote. Example: no beginning */ Combinations Single-quoted double-quote mark. Example: \"some text without closing quote Double quote, where close-quote immediately follows a single-quote mark. Example: \/*Not quoted. 42
43 Textual input Nothing Empty (clear default) 0 LB-1 LB = Lower boundary LB UB = Upper boundary UB UB+1 Far below LB Far above UB UB number of chars UB+1 number of chars Far beoynd UB chars Negative Non-digit (/ ASCII 47) Non-digit (: ASCII 58 Upper ASCII ( ) characters ASCII 255 Wrong data type Expressions Leading zeros Leading spaces Non-printing char O/S file name Upper ASCII Upper case Lower case Modifiers (ctrl, alt, etc.) Function keys Edited with backspace and delete Input while processing Language reserved characters 43
Advanced Software Engineering: Software Testing
Advanced Software Engineering: Software Testing COMP 3705(L4) Sada Narayanappa Anneliese Andrews Thomas Thelin Carina Andersson Web: http://www.megadatasys.com Assisted with templates News & Project News
More informationBlack-box Testing Techniques
T-76.5613 Software Testing and Quality Assurance Lecture 4, 20.9.2006 Black-box Testing Techniques SoberIT Black-box test case design techniques Basic techniques Equivalence partitioning Boundary value
More informationTesting. Topics. Types of Testing. Types of Testing
Topics 1) What are common types of testing? a) Testing like a user: through the UI. b) Testing like a dev: through the code. 2) What makes a good bug report? 3) How can we write code to test code (via
More informationStandard Glossary of Terms used in Software Testing. Version 3.2. Foundation Extension - Usability Terms
Standard Glossary of Terms used in Software Testing Version 3.2 Foundation Extension - Usability Terms International Software Testing Qualifications Board Copyright Notice This document may be copied in
More informationQuestion 1: What is a code walk-through, and how is it performed?
Question 1: What is a code walk-through, and how is it performed? Response: Code walk-throughs have traditionally been viewed as informal evaluations of code, but more attention is being given to this
More informationBusiness Requirements Document (BRD) Template
Business Requirements Document (BRD) Template Following is a template for a business requirements document (BRD). The document includes many best practices in use today. Don t be limited by the template,
More informationPreview from Notesale.co.uk Page 4 of 186
Basic of software Software:- Set of programs to perform a specific task for the user is known as Software. Computer software, or simply software, also known as computer programs, is the Or non-tangible
More informationBug tracking. Second level Third level Fourth level Fifth level. - Software Development Project. Wednesday, March 6, 2013
Bug tracking Click to edit Master CSE text 2311 styles - Software Development Project Second level Third level Fourth level Fifth level Wednesday, March 6, 2013 1 Prototype submission An email with your
More information1 of 5 3/28/2010 8:01 AM Unit Testing Notes Home Class Info Links Lectures Newsgroup Assignmen [Jump to Writing Clear Tests, What about Private Functions?] Testing The typical approach to testing code
More informationUnderstanding and Exploring Memory Hierarchies
Understanding and Exploring Memory Hierarchies Issued : Thursday 27th January 2011 Due : Friday 11th March 2011 at 4.00pm (at the ITO) This assignment represents the total practical component of the Computer
More informationSoftware Testing Interview Question and Answer
Software Testing Interview Question and Answer What is Software Testing? A process of analyzing a software item to detect the differences between existing and required conditions (i.e., defects) and to
More informationQA Best Practices: A training that cultivates skills for delivering quality systems
QA Best Practices: A training that cultivates skills for delivering quality systems Dixie Neilson QA Supervisor Lynn Worm QA Supervisor Maheen Imam QA Analyst Information Technology for Minnesota Government
More informationIntroduction To Software Testing. Brian Nielsen. Center of Embedded Software Systems Aalborg University, Denmark CSS
Introduction To Software Testing Brian Nielsen bnielsen@cs.aau.dk Center of Embedded Software Systems Aalborg University, Denmark CSS 1010111011010101 1011010101110111 What is testing? Testing Testing:
More informationHigher-order Testing. Stuart Anderson. Stuart Anderson Higher-order Testing c 2011
Higher-order Testing Stuart Anderson Defining Higher Order Tests 1 The V-Model V-Model Stages Meyers version of the V-model has a number of stages that relate to distinct testing phases all of which are
More informationRapid Software Testing Guide to Making Good Bug Reports
Rapid Software Testing Guide to Making Good Bug Reports By James Bach, Satisfice, Inc. v.1.0 Bug reporting is a very important part of testing. The bug report, whether oral or written, is the single most
More informationExamination Questions Time allowed: 1 hour 15 minutes
Swedish Software Testing Board (SSTB) International Software Testing Qualifications Board (ISTQB) Foundation Certificate in Software Testing Practice Exam Examination Questions 2011-10-10 Time allowed:
More informationCPSC 444 Project Milestone III: Prototyping & Experiment Design Feb 6, 2018
CPSC 444 Project Milestone III: Prototyping & Experiment Design Feb 6, 2018 OVERVIEW... 2 SUMMARY OF MILESTONE III DELIVERABLES... 2 1. Blog Update #3 - Low-fidelity Prototyping & Cognitive Walkthrough,
More informationClient-server application testing plan
Client-server application testing plan 1. INTRODUCTION The present plan contains and describes testing strategy principles applied for remote access system testing. The plan is intended to be used by project
More informationMONIKA HEINER.
LESSON 1 testing, intro 1 / 25 SOFTWARE TESTING - STATE OF THE ART, METHODS, AND LIMITATIONS MONIKA HEINER monika.heiner@b-tu.de http://www.informatik.tu-cottbus.de PRELIMINARIES testing, intro 2 / 25
More informationAdvanced Security Tester Course Outline
Advanced Security Tester Course Outline General Description This course provides test engineers with advanced skills in security test analysis, design, and execution. In a hands-on, interactive fashion,
More informationComputational Systems COMP1209
Computational Systems COMP1209 Testing Yvonne Howard ymh@ecs.soton.ac.uk A Problem A café wants to build an automated system to provide breakfasts. The robot waiter greets people before taking their order
More informationChapter 2 Example Modeling and Forecasting Scenario
Chapter 2 Example Modeling and Forecasting Scenario This scenario is for a hypothetical project that aims to re-launch a website. It demonstrates the thinking process and practical implementation of using
More informationLearning objectives. Documenting Analysis and Test. Why Produce Quality Documentation? Major categories of documents
Learning objectives Documenting Analysis and Test Understand the purposes and importance of documentation Identify some key quality documents and their relations Understand the structure and content of
More informationTesting Mission Critical Applications MCP UNITE 2012
Testing Mission Critical Applications MCP 4011 UNITE 2012 Who is MGS, Inc. Software Engineering, Product Development and Professional Services firm founded in 1986 We solve business problems with: Products,
More informationXP: Planning, coding and testing. Planning. Release planning. Release Planning. User stories. Release planning Step 1.
XP: Planning, coding and testing Annika Silvervarg Planning XP planning addresses two key questions in software development: predicting what will be accomplished by the due date determining what to do
More informationSoftware Testing and Maintenance
Software Testing and Maintenance Testing Strategies Black Box Testing, also known as Behavioral Testing, is a software testing method in which the internal structure/ design/ implementation of the item
More informationMoving from a Paper to Paperless validation effort and how to get the most efficient mix of Manual vs. Automated testing.
Moving from a Paper to Paperless validation effort and how to get the most efficient mix of Manual vs. Automated testing. Overview The desire to use tools to increase validation productivity with the consequent
More informationIntegration and Testing. Uses slides from Lethbridge & Laganiere, 2001
Integration and Testing Uses slides from Lethbridge & Laganiere, 2001 Testing phases: V model Requirements Acceptance Testing Specifications System Testing Design Integration Testing Detailed Design Unit
More informationOn Premise. Service Pack
On Premise Service Pack 02.0.01 - This Documentation, which includes embedded help systems and electronically distributed materials, (hereinafter referred to as the Documentation ) is for your informational
More informationDeployment Planning and Risk Analysis
MEETING NOTES APRIL 26, 2000 Deployment Planning and Risk Analysis How do we deploy Waterfall II safely These are the notes from a meeting held from 4-8pm on April 26 th. The primary purposes of this meeting
More informationOn Premise. Service Pack
On Premise Service Pack 02.0.01 - This Documentation, which includes embedded help systems and electronically distributed materials, (hereinafter referred to as the Documentation ) is for your informational
More informationXP: Planning, coding and testing. Practice Planning game. Release Planning. User stories. Annika Silvervarg
XP: Planning, coding and testing Annika Silvervarg Practice Planning game Goal: schedule the most important tasks Which features to implement in what order Supports: simple design, acceptance testing,
More informationIn this Lecture you will Learn: Testing in Software Development Process. What is Software Testing. Static Testing vs.
In this Lecture you will Learn: Testing in Software Development Process Examine the verification and validation activities in software development process stage by stage Introduce some basic concepts of
More informationSample Exam Syllabus
ISTQB Foundation Level 2011 Syllabus Version 2.9 Release Date: December 16th, 2017. Version.2.9 Page 1 of 46 Dec 16th, 2017 Copyright 2017 (hereinafter called ISTQB ). All rights reserved. The authors
More informationVolume. User Manual and Resource Guide
Volume 1 User Manual and Resource Guide User Manual and Resource Guide Game Gurus United States Telephone: (415) 800-3599 Brazil Telephone: 55 84-8723-2557 Email: info@gamegurus.com Table of Contents What
More informationLecture 5: Requirements Specifications
Lecture 5: Requirements Specifications Why we need to write specifications Purpose and audience Choosing an appropriate size and formality Desiderata for Specifications Properties of good specifications
More informationAbout HP Quality Center Upgrade... 2 Introduction... 2 Audience... 2
HP Quality Center Upgrade Best Practices White paper Table of contents About HP Quality Center Upgrade... 2 Introduction... 2 Audience... 2 Defining... 3 Determine the need for an HP Quality Center Upgrade...
More informationCompTIA Project+ (2009 Edition) Certification Examination Objectives
CompTIA Project+ (2009 Edition) Certification Examination Objectives DRAFT INTRODUCTION The Project + examination is designed for business professionals involved with projects. This exam will certify that
More informationSoftware Quality. Richard Harris
Software Quality Richard Harris Part 1 Software Quality 143.465 Software Quality 2 Presentation Outline Defining Software Quality Improving source code quality More on reliability Software testing Software
More informationThis assignment requires that you complete the following tasks (in no particular order).
Construction Objectives The objectives of this assignment are: (1) Implement your FCS design with high-quality code and thorough unit tests (2) Gain experience doing a task breakdown (3) Gain experience
More informationBPS Suite and the OCEG Capability Model. Mapping the OCEG Capability Model to the BPS Suite s product capability.
BPS Suite and the OCEG Capability Model Mapping the OCEG Capability Model to the BPS Suite s product capability. BPS Contents Introduction... 2 GRC activities... 2 BPS and the Capability Model for GRC...
More informationSoftware Engineering Fall 2015 (CSC 4350/6350) TR. 5:30 pm 7:15 pm. Rao Casturi 11/10/2015
Software Engineering Fall 2015 (CSC 4350/6350) TR. 5:30 pm 7:15 pm Rao Casturi 11/10/2015 http://cs.gsu.edu/~ncasturi1 Class announcements Final Exam date - Dec 1 st. Final Presentations Dec 3 rd. And
More informationThree General Principles of QA. COMP 4004 Fall Notes Adapted from Dr. A. Williams
Three General Principles of QA COMP 4004 Fall 2008 Notes Adapted from Dr. A. Williams Software Quality Assurance Lec2 1 Three General Principles of QA Know what you are doing. Know what you should be doing.
More informationSoftware Engineering 2 A practical course in software engineering. Ekkart Kindler
Software Engineering 2 A practical course in software engineering Quality Management Main Message Planning phase Definition phase Design phase Implem. phase Acceptance phase Mainten. phase 3 1. Overview
More informationTool Selection and Implementation
Tool Selection and Implementation Paul Gerrard Systeme Evolutif Limited email: paulg@evolutif.co.uk http://www.evolutif.co.uk 2000 Systeme Evolutif Ltd Slide 1 Agenda What Can Test Execution Tools Do For
More information6.001 Notes: Section 6.1
6.001 Notes: Section 6.1 Slide 6.1.1 When we first starting talking about Scheme expressions, you may recall we said that (almost) every Scheme expression had three components, a syntax (legal ways of
More informationSoftware Engineering Fall 2014
Software Engineering Fall 2014 (CSC 4350/6350) Mon.- Wed. 5:30 pm 7:15 pm ALC : 107 Rao Casturi 11/10/2014 Final Exam date - Dec 10 th? Class announcements Final Presentations Dec 3 rd. And Dec 8 th. Ability
More informationPart 5. Verification and Validation
Software Engineering Part 5. Verification and Validation - Verification and Validation - Software Testing Ver. 1.7 This lecture note is based on materials from Ian Sommerville 2006. Anyone can use this
More informationQuality Assurance in Software Development
Quality Assurance in Software Development Qualitätssicherung in der Softwareentwicklung A.o.Univ.-Prof. Dipl.-Ing. Dr. Bernhard Aichernig Graz University of Technology Austria Summer Term 2017 1 / 47 Agenda
More informationPK0-003 Q&As. Project+ (2009) Pass CompTIA PK0-003 Exam with 100% Guarantee. Free Download Real Questions & Answers PDF and VCE file from:
PK0-003 Q&As Project+ (2009) Pass CompTIA PK0-003 Exam with 100% Guarantee Free Download Real Questions & Answers PDF and VCE file from: 100% Passing Guarantee 100% Money Back Assurance Following Questions
More informationSTUDY ON VARIOUS PHASES OF SOFTWARE TESTING LIFE CYCLE
STUDY ON VARIOUS PHASES OF SOFTWARE TESTING LIFE CYCLE Prof. Swati Dubey 1, Prof. Shubhangi Takwane 2, Prof.Dipti Dighe 3 1,2,3 Electronics and telecommunication Engineering Department, G.S. Moze College
More informationCertified Tester Foundation Level(CTFL)
Certified Tester Foundation Level(CTFL) ISTQB : International Software Testing Qualifications Board Heading: The International Software Testing Qualifications Board (ISTQB) is an internationally recognized
More informationASTQB Advance Test Analyst Sample Exam Answer Key and Rationale
ASTQB Advance Test Analyst Sample Exam Answer Key and Rationale Total number points = 120 points Total number points to pass = 78 points Question Answer Explanation / Rationale Learning 1 A A is correct.
More informationChapter 11, Testing. Using UML, Patterns, and Java. Object-Oriented Software Engineering
Chapter 11, Testing Using UML, Patterns, and Java Object-Oriented Software Engineering Outline Terminology Types of errors Dealing with errors Quality assurance vs Testing Component Testing! Unit testing!
More informationCUBE. Configuration Management Report. Hakan Nizamoğlu Yiğitalp Ertem Murat Toprak Saim Güveloğlu
CUBE Configuration Management Report Configuration Management Report Hakan Nizamoğlu Yiğitalp Ertem Murat Toprak Saim Güveloğlu 2010 C U B E C O N F I G U R A T I O N M A N A G E M E N T R E P O R T Table
More informationObjectives. Chapter 19. Verification vs. validation. Topics covered. Static and dynamic verification. The V&V process
Objectives Chapter 19 Verification and Validation Assuring that a software system meets a user s need are to introduce software verification and validation (V&V) and to discuss the distinction between
More informationDataworks Development, Inc. P.O. Box 174 Mountlake Terrace, WA (425) fax (425)
Dataworks Development, Inc. P.O. Box 174 Mountlake Terrace, WA 98043 (425) 673-1974 fax (425) 673-2506 The Freezerworks Validation Verification Package Dataworks Development, Inc. has over 20 years of
More informationCS 307: Software Engineering. Lecture 10: Software Design and Architecture
CS 307: Software Engineering Lecture 10: Software Design and Architecture Prof. Jeff Turkstra 2017 Dr. Jeffrey A. Turkstra 1 Announcements Discuss your product backlog in person or via email by Today Office
More informationMicroSurvey Users: How to Report a Bug
MicroSurvey Users: How to Report a Bug Step 1: Categorize the Issue If you encounter a problem, as a first step it is important to categorize the issue as either: A Product Knowledge or Training issue:
More informationShree.Datta Polytechnic College,Dattanagar, Shirol. Class Test- I
Shree. Datta S.S.S.K. Charitable Trust s Shree.Datta Polytechnic College,Dattanagar, Shirol Class Test- I Course Code:CO6E Subject:-SOFTWARE TESTING Marks:-25 Semester:-VI Subject code:-12258 Date:- Institute
More informationSkybox Security Vulnerability Management Survey 2012
Skybox Security Vulnerability Management Survey 2012 Notice: This document contains a summary of the responses to a June 2012 survey of 100 medium to large enterprise organizations about their Vulnerability
More informationDarshan Institute of Engineering & Technology Unit : 9
1) Explain software testing strategy for conventional software architecture. Draw the spiral diagram showing testing strategies with phases of software development. Software Testing: Once source code has
More informationExpert Test Manager: Operational Module Course Outline
Expert Test Manager: Operational Module Course Outline General Description A truly successful test organization not only has solid, relevant test objectives and a test strategy, but it also has the means
More informationSoftware Engineering Software Testing Techniques
Software Engineering Software Testing Techniques 1 Testability Operability it it operates cleanly Observability the the results of each test case are readily observed Controllability the the degree to
More informationTesting User Guide. Prepared By: Neville Turbit Version Feb 09
User Guide Prepared By: Neville Turbit Version 1.0 1 Feb 09 Table of Contents Document History... 2 Overview... 3 Definitions - Types of testing... 4 Activities... 6 Test Strategy... 7 Test Plan... 9 Test
More informationOracle. Risk Management Cloud Using Financial Reporting Compliance. Release 13 (update 17D)
Oracle Risk Management Cloud Using Financial Reporting Compliance Release 13 (update 17D) Release 13 (update 17D) Part Number E89265-01 Copyright 2011-2017, Oracle and/or its affiliates. All rights reserved.
More informationRequirements Engineering: Specification & Validation. Software Requirements and Design CITS 4401 Lecture 18
Requirements Engineering: Specification & Validation Software Requirements and Design CITS 4401 Lecture 18 The Problems of Requirements What goal(s) are we trying to satisfy? How do we identify the scope
More informationBDD and Testing. User requirements and testing are tightly coupled
BDD and Testing User requirements and testing are tightly coupled 1 New Concept: Acceptance Tests Customer criteria for accepting a milestone Get paid if pass! Black-box tests specified with the customer
More informationRace Catcher. Automatically Pinpoints Concurrency Defects in Multi-threaded JVM Applications with 0% False Positives.
Race Catcher US and International Patents Issued and Pending. Automatically Pinpoints Concurrency Defects in Multi-threaded JVM Applications with 0% False Positives. Whitepaper Introducing Race Catcher
More informationSurprisingly Successful: What Really Works in Cyber Defense. John Pescatore, SANS
Surprisingly Successful: What Really Works in Cyber Defense John Pescatore, SANS 1 Largest Breach Ever 2 The Business Impact Equation All CEOs know stuff happens in business and in security The goal is
More information6.001 Notes: Section 7.1
6.001 Notes: Section 7.1 Slide 7.1.1 In the past few lectures, we have seen a series of tools for helping us create procedures to compute a variety of computational processes. Before we move on to more
More informationCS 160: Evaluation. Outline. Outline. Iterative Design. Preparing for a User Test. User Test
CS 160: Evaluation Professor John Canny Spring 2006 2/15/2006 1 2/15/2006 2 Iterative Design Prototype low-fi paper, DENIM Design task analysis contextual inquiry scenarios sketching 2/15/2006 3 Evaluate
More informationSample Question Paper. Software Testing (ETIT 414)
Sample Question Paper Software Testing (ETIT 414) Q 1 i) What is functional testing? This type of testing ignores the internal parts and focus on the output is as per requirement or not. Black-box type
More informationChapter 3: The IF Function and Table Lookup
Chapter 3: The IF Function and Table Lookup Objectives This chapter focuses on the use of IF and LOOKUP functions, while continuing to introduce other functions as well. Here is a partial list of what
More informationHP Application Lifecycle Management. Upgrade Best Practices
HP Application Lifecycle Management Upgrade Best Practices Document Release Date: October 2010 Legal Notices Warranty The only warranties for HP products and services are set forth in the express warranty
More informationSTRUCTURED SYSTEM ANALYSIS AND DESIGN. System Concept and Environment
STRUCTURED SYSTEM ANALYSIS AND DESIGN Definition: - System Concept and Environment A system is an orderly grouping of independent components linked together according to plan to achieve a specific objective.
More informationWhite-Box Testing Techniques
T-76.5613 Software Testing and Quality Assurance Lecture 3, 18.9.2006 White-Box Testing Techniques SoberIT Content What are white-box testing techniques Control flow testing Statement coverage Branch coverage
More informationAssignment Kit for Program 1
Assignment Kit for Program 1 PSP Fundamentals The Software Engineering Institute (SEI) is a federally funded research and development center sponsored by the U.S. Department of Defense and operated by
More informationRequirement Engineering within an Agile Environment BY KEJI GIWA. Digital Bananas Technology
Requirement Engineering within an Agile Environment BY KEJI GIWA HLR Workshop Requirement Catalogue Product Planning Sprint Planning Meeting Keyscreens Use Case / Epic Stories Implement Wireframes DBT
More informationTestCenter User Manual. User Manual. v
TestCenter User Manual User Manual v1.0 2017-03-31 Table of Content 1 Introduction... 4 2 Getting started... 5 2.1 TestCenter User Interface... 5 2.2 Menu bar... 6 2.3 Message bar... 6 2.4 Forms for record
More informationSoftware Engineering (CSC 4350/6350) Rao Casturi
Software Engineering (CSC 4350/6350) Rao Casturi Testing Software Engineering -CSC4350/6350 - Rao Casturi 2 Testing What is testing? Process of finding the divergence between the expected behavior of the
More informationLecture 20: SW Testing Presented by: Mohammad El-Ramly, PhD
Cairo University Faculty of Computers and Information CS251 Software Engineering Lecture 20: SW Testing Presented by: Mohammad El-Ramly, PhD http://www.acadox.com/join/75udwt Outline Definition of Software
More informationPROJ 302. Project Report, Poster and Digest Guidelines. for Industrial Engineering Students. Summer 2017
PROJ 302 Project Report, Poster and Digest Guidelines for Industrial Engineering Students Summer 2017 General Notes - Read this document carefully before writing your internship report, poster, and digest.
More informationMITOCW watch?v=zm5mw5nkzjg
MITOCW watch?v=zm5mw5nkzjg The following content is provided under a Creative Commons license. Your support will help MIT OpenCourseWare continue to offer high quality educational resources for free. To
More informationTEL2813/IS2820 Security Management
TEL2813/IS2820 Security Management Security Management Models And Practices Lecture 6 Jan 27, 2005 Introduction To create or maintain a secure environment 1. Design working security plan 2. Implement management
More informationD50: Advances in Software Engineering. Case Study: Defining an Object-Oriented Development Process. Why Define Process?
D50: Advances in Software Engineering Case Study: Defining an Object-Oriented Development Process Wolfgang Emmerich 1 Why Define Process? Introduction of good practice Tailoring towards DG Bank & MRS/CAD
More informationVerification and Validation. Ian Sommerville 2004 Software Engineering, 7th edition. Chapter 22 Slide 1
Verification and Validation Ian Sommerville 2004 Software Engineering, 7th edition. Chapter 22 Slide 1 Verification vs validation Verification: "Are we building the product right?. The software should
More informationChapter 8. Achmad Benny Mutiara
Chapter 8 SOFTWARE-TESTING STRATEGIES Achmad Benny Mutiara amutiara@staff.gunadarma.ac.id 8.1 STATIC-TESTING STRATEGIES Static testing is the systematic examination of a program structure for the purpose
More informationMTAT : Software Testing
MTAT.03.159: Software Testing Lecture 03: Black-Box Testing (advanced) Part 2 Dietmar Pfahl Spring 2018 email: dietmar.pfahl@ut.ee Black-Box Testing Techniques Equivalence class partitioning (ECP) Boundary
More informationFederal Plain Language Guidelines
Federal Plain Language Guidelines March 2011 Revision 1, May 2011 Table of Contents Introduction... i Revision 1 Changes... ii Table of Contents... iii I. Think about your audience... 1 a. Identify and
More informationSOLUTION BRIEF CA TEST DATA MANAGER FOR HPE ALM. CA Test Data Manager for HPE ALM
SOLUTION BRIEF CA TEST DATA MANAGER FOR HPE ALM CA Test Data Manager for HPE ALM Generate all the data needed to deliver fully tested software, and export it directly into Hewlett Packard Enterprise Application
More informationBTEC Nationals IT - Unit2 FAQs
BTEC Nationals IT - Unit2 FAQs Q1 Q2 I need more clarity on what is required in the design task Is it expected that the race officials are entering times as raw times and then the table is set up so it
More informationSaving the Project Brief document under its own name
HOW TO USE THIS TEMPLATE: Introduction The template reflects the steps set out in the PRINCE2 Method and is designed to prompt the Project Manager and help in the creation of the. The information for the
More informationPPM Essentials Accelerator Product Guide - On Premise. Service Pack
PPM Essentials Accelerator Product Guide - On Premise Service Pack 02.0.02 This Documentation, which includes embedded help systems and electronically distributed materials (hereinafter referred to as
More informationProject Management Pre-Implementation Project status reporting Post Implementation Assessment Phase Solidify Project Scope
Project Management 321 days 10/22/01 01/30/03 Pre-Implementation 14 days 10/22/01 11/08/01 Detailed Scope / Deliverable definition 5 days 10/22/01 10/26/01 Complete Work Breakdown Structure 1 day 10/22/01
More informationAppraisal Module. 1. Introduction 1.01 Changes in this Version. 2. Start Page 2.1 Survey details.
Appraisal Module 1. Introduction 1.01 Changes in this Version 2. Start Page 2.1 Survey details. 3. Manage Appraisal Users 3.1 Initial setup 3.2 New User 3.3 Setting Appraisal Permissions 4. User Preferences
More informationCS 160: Evaluation. Professor John Canny Spring /15/2006 1
CS 160: Evaluation Professor John Canny Spring 2006 2/15/2006 1 Outline User testing process Severity and Cost ratings Discount usability methods Heuristic evaluation HE vs. user testing 2/15/2006 2 Outline
More informationVerification and Validation
Steven Zeil February 13, 2013 Contents 1 The Process 3 1 2 Non-Testing V&V 7 2.1 Code Review....... 8 2.2 Mathematically-based verification......................... 19 2.3 Static analysis tools... 23 2.4
More informationVerification and Validation
Steven Zeil February 13, 2013 Contents 1 The Process 2 2 Non-Testing V&V 3 2.1 Code Review........... 4 2.2 Mathematically-based verification.................................. 8 2.3 Static analysis tools.......
More informationInteractr: an interaction diagram drawing tool
Interactr: an interaction diagram drawing tool Software-ontwerp 2017-2018 Iteration 3 Contents 1 Introduction 2 2 General Information 2 2.1 Team Work............................... 2 2.2 Iterations................................
More information