COPYRIGHTED MATERIAL. Index

Transcription

1 BINDEX 08/25/ :31:44 Page 233 Index A Acceptance testing, 131 extreme, 184, 186 Agile development, 175 manifesto, 176 table-methodologies, 177 Agile testing, 175, 178 Application server, 205 Automated debugging tools, 159 B Backtract debugging, 167 Beck, Kent, 176 Beedle, Mike, 176 Big-bang testing, 98 Black-box testing, 8 equivalence partitioning, 49 usability testing, 145 Black box white box comparison, 42 Bottom-up testing, 107 compared with top-down testing, 108 Boundary value analysis, 55 guidelines for, 56 MTEST program for, 57 Branch coverage testing, 44 Browser compatibility testing, 204 Brute force debugging, Business layer, 196, 201 Business layer testing, 205 Business tier table-testing criteria, 198 C C/S architecture, 195 C++ black-box testing of, 9 Carrier network infrastructure, 217 Cause effect graphing constraint symbols for, 65 logic diagram for, 64 sample, 64 sample-without constraints, 71 symbols for, 63 with exclusive constraint, 66 Cause effect graphing, 61 test cases for, 62 CDMA, 218 CGI, 196, 205 Client server architecture, 195 COBOL history of, 26 Cockburn, Alistair, 176 Code division multiple access, 218 Code inspections, 22 Common Business Oriented Language. See COBOL COPYRIGHTED MATERIAL

2 BINDEX 08/25/ :31:45 Page Index Common gateway interface, 196 Comparison errors, 29 Compatibility/conversion testing, 127 Component tests, 153 Computation errors, 28 Computer definition, 1 Condition coverage testing, 45 Condition masking, 46 Configuration testing, 126 Control-flow graph, 11 Control-flow errors, 31 Cunningham, Ward, 176 D Data-declaration errors, 28 Data-gathering methods usability testing, 150 Data-integrity testing, 210 Data layer, 201 Data-layer testing, 208 Data-reference errors, 25 Data tier table-testing criteria, 198 Data validation, 207 Data-driven testing. See Black-box testing Debugging, 157 automated tools for, 159 by backtracking, 167 by brute force, 158 by deduction, 163 by induction, 160 clue structuring example, 163 error analysis, 172 inductive flowchart, 160 principals of, 168 programmer resistance, 157 with test cases, 167 Debugging principals error locating, 168 error repairing, 170 Decision coverage testing, 44 Decision/condition coverage testing, 46 Deductive debugging, 163 the process flowchart, 164 the steps, 164 Desk checking, 21, 37 DISPLAY command cause-effect graph for, 72 graph for, 70 Diversity mobile devices, 216 Documentation software flowchart, 116 Driver module, 98 E E-Commerce basic architecture of, 195 Economics of testing, 8 Equivalence class form, 51 Equivalence classes identifying, 51 table-classes list, 54 test cases for, 52 Equivalence partitioning, 49, 50 Error analysis with debugging, 172 Error checklist, 25 Error guessing, 80 Errors comparison, 29 computation, 28

3 BINDEX 08/25/ :31:45 Page 235 Index 235 control flow, 31 data declaration, 28 estimating by plotting, 140 estimating number, 136 input/output, 33 interface, 32 rounding, 29 table-when errors found, 138 Essential unified process, 178 EssUP. See Essential unified process Exhaustive input testing, 9 Extreme acceptance testing, 186 Extreme programming, 179 table-12 practices, 182 Extreme programming basics, 180 Extreme testing, 179, 180 acceptance testing with, 184 applied, 187 concepts of, 184 JUnit test driver, 190 test case design, 188 unit testing with, 184 Extreme unit testing, 185 Eye tracking, 151 F Facility testing, 123 Fault tolerant testing, 210 Form equivalence class, 51 Formula Translating System. See Fortran Fortran history of, 26 Fowler, martin, 176 Function test purpose of, 116 Function testing, 119 G Global system for mobile, 218 Graphical User Interface, 2 Graphing cause effect, 61 Grenning, James, 176 GSM, 218 GUI. See Graphical User Interface H Hallway testing, 147 Higher order testing, 113 performing the test, 130 test plan components, 133 test planning and control, 132 Highsmith, Jim, 176 HTML, 196 Human testing, 19 Hunt, Andrew, 176 Hypertext markup language, 196 I Incremental testing, 96 Independent test agency, 141 Induction debugging, 160 Inductive debugging steps for, 161 structuring the clues, 161 Inductive flowchart for program debugging, 160 Input/Output errors, 33 Input/output testing. See Black-box testing Inspection error checklist summary table, 35 Inspections agenda for, 23 effectiveness of, 21

4 BINDEX 08/25/ :31:45 Page Index Inspections (continued) error checklist, 25 side benefits of, 24 team description, 22 time required, 24 Inspections and walkthroughs, 20 Installation testing, 127, 132 Interface errors, 32 Internet applications data integrity testing in, 210 data layer testing in, 208 data validation in, 207 fault tolerant testing in, 210 illustration-architecture, 201 performance testing, 206 recoverability testing in, 210 response time testing in, 209 table-test criteria, 202 testing of, 193 testing strategies, 200 transactional testing in, 207 Internet testing challenges of, 196 J JBoss, 205 Jeffries, Ron, 176 JUnit, 187 test driver, 190 K Kern, Jon, 176 L LDAP, 196 Lightweight directory application protocol, 196 Logic coverage testing, 43 Logic-driven testing. See White-box testing M Marick, Brian, 176 Martin, Robert C., 176 Mean Time Between Failures, 128, 200 Mean Time to Repair, 129, 200 Mellor, Steve, 176 Mobile application definition, 214 Mobile application testing, 213 approaches to, 219 challenges, 215 scripting in, 219 table-categories, 221 table-devices versus emulators, 222 table-generic test script, 224 usibility testing in, 219 with emulators, 224 with real devices, 222 Mobile device definition, 214 Mobile device diversity, 216 Mobile environment, 214 table-test design considerations, 215 Module driver, 98 input tables for, 87 stub, 98 Module test purpose of, 116 Module testing, 85 performing the test, 109 test case design, 86

5 BINDEX 08/25/ :31:45 Page 237 Index 237 MTBF, 200, 210, See Mean Time Between Failures MTEST program input chart, 58 program specifications, 57 MTTR, 200, 210, See Mean Time To Repair Multiple-condition coverage testing, 47, 48 N Nielsen, Jakob, 148 Nonincremental testing, 98 P Palo Alto Research Center, 143 PARC. See Palo Alto Research Center Path sensitizing, 73 Peer ratings, 38 Performance testing, 126, 206 Performing the test higher order testing, 130 PL/1 background, 88 Presentation layer, 196, 201 Presentation layer testing, 203 Presentation tier table-testing criteria, 198 Principals of debugging error locating, 168 error repairing, 170 Procedure testing, 130 Program 12 module sample, 102 Agile development, 175 breakpoints in, 159 control flow graph, 11 error checklist, 25 inspections, walkthroughs and reviews, 19 Java sample, 43 module input tables, 87 regression testing, 16 sample flowchart, 43 six module diagram, 98 testing principals, 13 Program testing definition, 17 successful criteria, 18 Program testing guidelines, 13 Psychology of testing, 5 Q Questionnaire usability testing, 152 R Random input testing, 41 Rapid application development, 179 Rational unified process, 178 RDBMS, 196, 209, 210 Recoverability testing, 210 Recovery testing, 129 Regression testing, 16 Relational database management system, 196 Reliability testing, 127 Remote user testing, 151 Response time testing, 209 Resultant decision table, 76 Rounding error Java code sample, 29 RUP. See Rational unified process

6 BINDEX 08/25/ :31:45 Page Index S Schwaber, Ken, 176 Scripting in mobile application testing, 219 Security testing, 125 Serviceability/maintenance testing, 129 Software documentation flowchart, 116 documentation of, 115 external specification, 114 testing versus development, 117 Software development process flowchart, 114 Software reliability engineering (SRE), 128 Software testing correct definition, 6 economics of, 8 wrong definition, 5 Software testing principals, 12 SQL, 209 SRE. See Software Reliability Engineering Storage testing, 126 Stress testing, 123, 206 Stub module, 98 Sutherland, Jeff, 176 System test flowchart for, 121 purpose of, 116 System testing, 119 facility, 123 stress, 123 volume, 123 T TDMA, 218 Test-case for extreme testing, 188 Test-case debugging, 167 Test-case design, 41 module testing, 86 unit testing, 86 Test-case exam, 2 Test-case strategy, 82 Test cases table-categories of, 122 types of, 167 Test completion criteria, 135 Test planning and control, 132 Test user selection usability testing, 147 Testing, 13, 44 acceptance, 131 agile, 178 agile environment, 175 big-bang, 98 branch coverage, 44 browser compatibility, 204 business layer, 205 code-oriented, 20 compatibility/conversion, 127 completion-criteria, 135 condition-coverage, 45 condition-masking, 46 configuration, 126 debugging, 157 decision-coverage, 44 decision/condition-coverage, 46 desk-testing, 21 estimating-errors, 136 human, 19 installation, 127, 132

7 BINDEX 08/25/ :31:45 Page 239 Index 239 Internet applications, 193 mobile applications, 213 multiple-condition coverage, 47 nonincremental, 98 performance, 126 presentation layer, 203 procedure-testing, 130 recovery, 129 reliability, 127 security, 125 serviceability/maintenance, 129 storage, 126 top-down, 101 usability, 125, 143 usability questionnaire, 152 Web applications, 194 Testing approaches mobile applications, 219 Testing principals, 13 Testing strategies Internet applications, 200 Think aloud protocol, 150 Thomas, Dave, 176 Time-division multiple access, 218 Top-down design, 101 Top-down development, 101 Top-down testing, 101 compared with bottom up testing, 108 Transactional testing, 207 Triangle Definition, 2 U UI, 218 Unit testing, 85 extreme, 185 test case design, 86 with extreme testing, 184 Uptime requirements table-hours per year, 129 Usability in mobile application testing, 219 Usability testing, 125, 143 component tests, 153 conducting sufficient tests, 153 data gathering methods, 150 determining number of testers, 148 eye tracking, 151 graph-errors versus testers, 149 hallway testing, 147 questionnaire, 152 remote user testing, 151 test user selection, 147 testing considerations, 144 the process, 146 think aloud protocol, 150 User interface, 218 User testing, 143 V Van Bennekum, Arie, 176 Volume testing, 123 W Walkthroughs, 34 effectiveness of, 21 WAP, 218 Web applications browser compatibility, 195 testing of, 194 testing strategies, 200 White-box testing, 10, 42 White box black box comparison, 42 Wide Area Network. See

8 BINDEX 08/25/ :31:45 Page Index Wireless application protocol, 218 Wireless markup language, 218 WML, 218 X Xerox, 143 XP, 179, 180 planning, 181 project flow example, 183 testing, 183 XP Planning, 181 XP Project flow, 183 XP Testing, 183 XT, 180

9 BINDEX 08/25/ :31:45 Page 241

10 BINDEX 08/25/ :31:45 Page 242

11 BINDEX 08/25/ :31:45 Page 243

12 BINDEX 08/25/ :31:45 Page 244