Proactive Detection of Inadequate Diagnostic Messages for Software Configuration Errors
|
|
|
- Allan Abel Farmer
- 6 years ago
- Views:
Transcription
1 Proactive Detection of Inadequate Diagnostic Messages for Software Configuration Errors Sai Zhang Google Research Michael D. Ernst University of Washington
2 Goal: helping developers improve software error diagnostic messages Users Input data Configuration Software Errors - Crashing - Silent failures --port_num = (should be an integer) A bad diagnostic message: unexpected system failure Our technique: detecting such inadequate diagnostic messages caused by configuration errors 2
3 Goal: helping developers improve software error diagnostic messages Software Our technique: ConfDiagDetector Developers Software (with improved diagnostic message) 3
4 Goal: helping developers improve software error diagnostic messages Users Configuration --port_num = (should be an integer) Software (with improved diagnostic message) A good diagnostic message: wrong value in port_num
5 Why configuration errors? Software systems often require configuration 5
![major storage company [Yin et al, SOSP 11]](/docs-images/78/76780680/images/6-2.jpg "Configuration errors can have disastrous impacts")
6 Why configuration errors? Software systems often require configuration Software configuration errors are common and severe Root causes of high-severity issues in a major storage company [Yin et al, SOSP 11] Configuration errors can have disastrous impacts (downtime costs 3.6% of revenue) 6
7 Why diagnostic messages? Often the sole data source available to understand an error Many diagnostic messages in practice are inadequate Missing Ambiguous
8 Why diagnostic messages? Often the sole data source available to understand an error Many diagnostic messages in practice are inadequate Missing Ambiguous A misconfiguration in Apache JMeter output_format = XYZ (an unsupported format) No diagnostic message, but JMeter saves output in the default XML format
9 Why diagnostic messages? Often the sole data source available to understand an error Many diagnostic messages in practice are inadequate Missing Ambiguous A misconfiguration in Apache Derby derby.stream.error.method = hello Diagnostic message: IJ ERROR: Unable to establish connection
10 Why diagnostic messages? Often the sole data source available to understand an error Many diagnostic messages in practice are inadequate Missing Ambiguous Our technique: detecting those inadequate messages before they arise in the field.
11 Outline Motivation The ConfDiagDetector technique Evaluation Related work Contributions 11
12 Challenges of proactive detection of inadequate diagnostic messages How to trigger a configuration error? How to determine the inadequacy of a diagnostic message? 12
13 ConfDiagDetector s solutions How to trigger a configuration error? Configuration mutation + checking system tests results configuration + system tests failed tests triggered errors How to determine the inadequacy of a diagnostic message? Use a NLP technique to check its semantic meaning Similar semantic meanings? Diagnostic messages output by failed tests Use manual 13
14 ConfDiagDetector workflow An example configuration System tests All tests pass! Software (binary)
15 ConfDiagDetector workflow An example configuration Configuration mutation Mutated configurations System tests Software (binary) Run tests under each Mutated configuration Use manual Diagnostic messages issued by failed tests Message analysis Inadequate Diagnostic messages
16 Configuration mutation Randomly mutates option values One mutated option in each mutated configuration A configuration Mutated configurations 16
17 Configuration mutation Randomly mutates option values One mutated option in each mutated configuration Mutation rules for one configuration option Delete existing value format=xml format= Using a random value format=xml format= xyz Injecting spelling mistakes format=xml format= xmk Change the case of text format=xml format= XML 17
18 Running tests Run the all tests under each mutated configuration + Mutated configurations System tests Test results Parse each failed test s log file or console to get the diagnostic message 18
19 Running tests Run the all tests under each mutated configuration + Mutated configurations System tests Test results Parse each failed test s log file or console to get the diagnostic message Failed tests Diagnostic messages 19
20 Message analysis A message is adequate, if it contains the mutated option name or value OR has a similar semantic meaning with the manual description 20
21 Message analysis A message is adequate, if it contains the mutated option name or value OR has a similar semantic meaning with the manual description Example: Mutated option: --percentage-split Diagnostic message: the value of percentage-split should be > 0 21
22 Message analysis A message is adequate, if it contains the mutated option name or value OR has a similar semantic meaning with the manual description Example: Mutated option: --fnum Diagnostic message: Number of folds must be greater than 1 User manual description of --fnum: Sets number of folds for cross-validation 22
23 Message analysis A message is adequate, if it contains the mutated option name or value OR has a similar semantic meaning with the manual description A NLP technique [Mihalcea 06] 23
24 Key idea of the employed NLP technique A message Manual description Has similar semantic meanings, if many words in them have similar meanings Example: The program goes wrong The software fails Remove all stop words For each word in the diagnostic message, tries to find the similar words in the manual Two sentences are similar, if many words are similar between them. 24
25 Outline Motivation The ConfDiagDetector technique Evaluation Related work Contributions 25
26 Research questions ConfDiagDetector s effectiveness The detected inadequate messages Time cost in inadequate message detection Comparison with two existing techniques 26
27 4 mature configurable software systems Subject LOC #Options #System Tests Weka 274, JMeter 91, Jetty 123, Derby 645, Converted from usage examples in the user manual. 27
28 Detected inadequate diagnostic messages 50 distinct diagnostic messages 28
29 Detected inadequate diagnostic messages 7 adequate messages 50 distinct diagnostic messages 18 ambiguous messages 25 missing messages 29
30 Detected inadequate diagnostic messages 7 adequate messages 50 distinct diagnostic messages 18 ambiguous messages 25 Validating missing each message s messages Adequacy by user study 30
31 User study User manual 3 grad students Adequate or not? Diagnostic message Each with 10 years coding experience 31
32 User study results Differs only in 1 message 7 adequate messages 50 distinct diagnostic messages 18 ambiguous messages 25 missing messages 8 adequate messages 17 ambiguous messages ConfDiagDetector s results User s judgment Zero false negative, and 2% false positive rate 32
33 Time cost Manual effort 3.5 hours in total (4.2 minutes per message) Converting usage examples into tests Extract configuration option description from the user manual ConfDiagDetector s efficiency 3 minutes per message, on average 33
34 Comparison with two existing techniques No Text Analysis Implemented in ConfErr [Keller 08] and Spex-INJ [Yin 11] A message is adequate if the misconfiguration option name or value appears in it False positive rate: 16% (ConfDiagDetector rate: 2%) Internet search Search the diagnostic message in Google A message is adequate if the misconfiguration option appears in the top 10 entries False positive rate: 12% (ConfDiagDetector rate: 2%) 34
35 Outline Motivation The ConfDiagDetector technique Evaluation Related work Contributions 35
36 Related work Configuration error diagnosis techniques Dynamic tainting [Attariyan 08], static tainting [Rabkin 11], Chronus [Whitaker 04] Troubleshooting an exhibited error rather than detecting inadequate diagnostic messages Software diagnosability improvement techniques PeerPressure [Wang 04], RangeFixer [Xiong 12], ConfErr [Keller 08] and Spex-INJ [Yin 11], EnCore [Zhang 14] Requires source code, usage history, or OS-level support 36
37 Outline Motivation The ConfDiagDetector technique Evaluation Related work Contributions 37
38 Contributions Software (binary) ConfDiagDetector Inadequate diagnostic messages A technique to detect inadequate diagnostic messages Combine configuration mutation and NLP techniques Requires no source code and prior knowledge Analyzes diagnostic messages in natural language Requires no OS-level support Accurate and fast An evaluation on 4 mature, configurable systems Identify 25 missing and 18 inadequate messages No false negative, 2% false positive rate 38
Which Configuration Option Should I Change?
Which Configuration Option Should I Change? Sai Zhang, Michael D. Ernst University of Washington Presented by: Kıvanç Muşlu I have released a new software version Developers I cannot get used to the UI
Natural language is a programming language
Natural language is a programming language Michael D. Ernst UW CSE Joint work with Arianna Blasi, Juan Caballero, Sergio Delgado Castellanos, Alberto Goffi, Alessandra Gorla, Victoria Lin, Deric Pang,
Probabilistic Automated Language Learning for Configuration Files
Probabilistic Automated Language Learning for Configuration Files Mark Santolucito, Ennan Zhai, and Ruzica Piskac (B) Yale University, New Haven, USA ruzica.piskac@yale.edu Abstract. Software failures
Simple testing can prevent most critical failures -- An analysis of production failures in distributed data-intensive systems
Simple testing can prevent most critical failures -- An analysis of production failures in distributed data-intensive systems Ding Yuan, Yu Luo, Xin Zhuang, Guilherme Rodrigues, Xu Zhao, Yongle Zhang,
Automatically Repairing Broken Workflows for Evolving GUI Applications
Automatically Repairing Broken Workflows for Evolving GUI Applications Sai Zhang University of Washington Joint work with: Hao Lü, Michael D. Ernst End-user s workflow A workflow = A sequence of UI actions
Understanding Customer Problem Troubleshooting from Storage System Logs
Understanding Customer Problem Troubleshooting from Storage System s Weihang Jiang (wjiang3@uiuc.edu) Weihang Jiang * +, Chongfeng Hu *+, Shankar Pasupathy +, Arkady Kanevsky +, Zhenmin Li #, Yuanyuan
CSE 505: Concepts of Programming Languages
CSE 505: Concepts of Programming Languages Dan Grossman Fall 2009 Lecture 4 Proofs about Operational Semantics; Pseudo-Denotational Semantics Dan Grossman CSE505 Fall 2009, Lecture 4 1 This lecture Continue
Applications. Cloud. See voting example (DC Internet voting pilot) Select * from userinfo WHERE id = %%% (variable)
Software Security Requirements General Methodologies Hardware Firmware Software Protocols Procedure s Applications OS Cloud Attack Trees is one of the inside requirement 1. Attacks 2. Evaluation 3. Mitigation
Distributed Diagnosis of Failures in a Three Tier E-Commerce System. Motivation
Distributed Diagnosis of Failures in a Three Tier E-ommerce System Gunjan Khanna, Ignacio Laguna, Fahad A. Arshad, and Saurabh agchi Dependable omputing Systems Lab (DSL) School of Electrical and omputer
Automated Documentation Inference to Explain Failed Tests
Automated Documentation Inference to Explain Failed Tests Sai Zhang University of Washington Joint work with: Cheng Zhang, Michael D. Ernst A failed test reveals a potential bug Before bug-fixing, programmers
Which Configuration Option Should I Change?
Which Configuration Option Should I Change? Sai Zhang Michael D. Ernst Department of Computer Science & Engineering University of Washington, USA {szhang, mernst}@cs.washington.edu ABSTRACT Modern software
White Box Testing III
White Box Testing III Outline Today we continue our look at white box testing methods, with mutation testing We will look at : definition and role of mutation testing what is a mutation? how is mutation
Tolerating Hardware Device Failures in Software. Asim Kadav, Matthew J. Renzelmann, Michael M. Swift University of Wisconsin Madison
Tolerating Hardware Device Failures in Software Asim Kadav, Matthew J. Renzelmann, Michael M. Swift University of Wisconsin Madison Current state of OS hardware interaction Many device drivers assume device
An Empirical Study on Configuration Errors in Commercial and Open Source Systems
An Empirical Study on Configuration Errors in Commercial and Open Source Systems Zuoning Yin,XiaoMa, Jing Zheng, Yuanyuan Zhou, Lakshmi N. Bairavasundaram, and Shankar Pasupathy Univ. of Illinois at Urbana-Champaign,
5 REASONS YOUR BUSINESS NEEDS NETWORK MONITORING
5 REASONS YOUR BUSINESS NEEDS NETWORK MONITORING www.intivix.com (415) 543 1033 NETWORK MONITORING WILL ENSURE YOUR NETWORK IS OPERATING AT FULL CAPACITY 5 Reasons Your Business Needs Network Monitoring
What is Mutation Testing? Mutation Testing. Test Case Adequacy. Mutation Testing. Mutant Programs. Example Mutation
What is Mutation Testing? Mutation Testing Breaking the application to test it n Mutation Testing is a testing technique that focuses on measuring the adequacy of test cases n Mutation Testing is NOT a
Troubleshooting Notification Devices
, on page 1 Overview Cisco Unity Connection can be configured to call a phone or pager or send text or SMS messages to notify users of new messages and calendar events. See the following sections for information
Hebei University of Technology A Text-Mining-based Patent Analysis in Product Innovative Process
A Text-Mining-based Patent Analysis in Product Innovative Process Liang Yanhong, Tan Runhua Abstract Hebei University of Technology Patent documents contain important technical knowledge and research results.
Automatic Trigger Generation for Rule-based Smart Homes
Automatic Trigger Generation for Rule-based Smart Homes ACM SIGPLAN PLAS, Vienna, Austria 10-24-2016 Chandrakana Nandi, Michael D. Ernst UW Seattle, USA 2 3 Common architecture OR 4 How to control your
Automating configuration troubleshooting with dynamic information flow analysis
Automating configuration troubleshooting with dynamic information flow analysis Mona Attariyan and Jason Flinn University of Michigan Abstract Software misconfigurations are time-consuming and enormously
Department of Electrical Engineering and Computer Science MASSACHUSETTS INSTITUTE OF TECHNOLOGY
Department of Electrical Engineering and Computer Science MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.095: Introduction to Computer Science and Programming Quiz I In order to receive credit you must answer
Outline. Review Choice Statements. Review Sequential Flow. Review Choice Before Loops. Review Choice After Loops
Programming with If Statements using Multiple Conditions Larry Caretto Computer Science 106 Computing in Engineering and Science February 23, 2006 Outline Review last class Program flow controls if s Exercises
Sets and Dictionaries
Copyright Software Carpentry 2010 This work is licensed under the Creative Commons Attribution License See http://software-carpentry.org/license.html for more information. Let's try an experiment Let's
Deckard: Scalable and Accurate Tree-based Detection of Code Clones. Lingxiao Jiang, Ghassan Misherghi, Zhendong Su, Stephane Glondu
Deckard: Scalable and Accurate Tree-based Detection of Code Clones Lingxiao Jiang, Ghassan Misherghi, Zhendong Su, Stephane Glondu The Problem Find similar code in large code bases, often referred to as
ENGR/CS 101 CS Session Lecture 3
ENGR/CS 101 CS Session Lecture 3 Log into Windows/ACENET (reboot if in Linux) Start Microsoft Visual Studio 2010 Windows button -> All Programs -> 02 Programming -> Microsoft Visual Studio 2010 -> Microsoft
Ontology mutation testing
Ontology mutation testing February 3, 2016 Cesare Bartolini Interdisciplinary Centre for Security, Reliability and Trust (SnT), University of Luxembourg Outline 1 Mutation testing 2 Mutant generation 3
I211: Information infrastructure II
Data Mining: Classifier Evaluation I211: Information infrastructure II 3-nearest neighbor labeled data find class labels for the 4 data points 1 0 0 6 0 0 0 5 17 1.7 1 1 4 1 7.1 1 1 1 0.4 1 2 1 3.0 0 0.1
Skytap Remote Access/Connectivity Checker Troubleshooting Guide
The Skytap Remote Access Client (SRA) supports multiple Operating Systems, Browsers, and Java versions. To ensure the most seamless experience when accessing a Skytap Cloud environment using the SRA, please
An Intuitive Formal Approach to Dynamic Workflow Modeling and Analysis
An Intuitive Formal Approach to Dynamic Workflow Modeling and Analysis Jiacun Wang, Daniela Rosca, William Tepfenhart, Allen Milewski, Michael Stoute Department of Software Engineering Monmouth University
Testing Error Handling Code in Device Drivers Using Characteristic Fault Injection
1 Testing Error Handling Code in Device Drivers Using Characteristic Fault Injection Jia-Ju Bai, Yu-Ping Wang, Jie Yin, Shi-Min Hu Department of Computer Science and Technology Tsinghua University Beijing,
VULNERABILITIES IN 2017 CODE ANALYSIS WEB APPLICATION AUTOMATED
AUTOMATED CODE ANALYSIS WEB APPLICATION VULNERABILITIES IN 2017 CONTENTS Introduction...3 Testing methods and classification...3 1. Executive summary...4 2. How PT AI works...4 2.1. Verifying vulnerabilities...5
Practical Techniques for Regeneration and Immunization of COTS Applications
Practical Techniques for Regeneration and Immunization of COTS Applications Lixin Li Mark R.Cornwell E.Hultman James E. Just R. Sekar Stony Brook University Global InfoTek, Inc (Research supported by DARPA,
Be Conservative: Enhancing Failure Diagnosis with Proactive Logging
Be Conservative: Enhancing Failure Diagnosis with Proactive Logging Ding Yuan, Soyeon Park, Peng Huang, Yang Liu, Michael Lee, Xiaoming Tang, Yuanyuan Zhou, Stefan Savage University of California, San
Juggling the Jigsaw Towards Automated Problem Inference from Network Trouble Tickets
Juggling the Jigsaw Towards Automated Problem Inference from Network Trouble Tickets Rahul Potharaju (Purdue University) Navendu Jain (Microsoft Research) Cristina Nita-Rotaru (Purdue University) April
Security Analyses For The Lazy Superhero
#1 Security Analyses For The Lazy Superhero #2 One-Slide Summary We can statically detect buffer overruns in programs by modeling the space allocated for a buffer and the space used for a buffer. We cannot
Diagnosing Production-Run Concurrency-Bug Failures. Shan Lu University of Wisconsin, Madison
Diagnosing Production-Run Concurrency-Bug Failures Shan Lu University of Wisconsin, Madison 1 Outline Myself and my group Production-run failure diagnosis What is this problem What are our solutions CCI
Finding Clues For Your Secrets: Semantics-Driven, Learning-Based Privacy Discovery in Mobile Apps
Finding Clues For Your Secrets: Semantics-Driven, Learning-Based Privacy Discovery in Mobile Apps Yuhong Nan, Zhemin Yang, Yuan Zhang, Donglai Zhu and Min Yang Fudan University Xiaofeng Wang Indiana University
Annotation and Feature Engineering
Annotation and Feature Engineering Introduction to Data Science Algorithms Jordan Boyd-Graber and Michael Paul HOUSES, SPOILERS, AND TRIVIA Introduction to Data Science Algorithms Boyd-Graber and Paul
Yuxi Chen, Shu Wang, Shan Lu, and Karthikeyan Sankaralingam *
Yuxi Chen, Shu Wang, Shan Lu, and Karthikeyan Sankaralingam * * 2 q Synchronization mistakes in multithreaded programs Thread 1 Thread 2 If(ptr){ tmp = *ptr; ptr = NULL; } Segfault q Common q Hard to diagnose
Software Testing Prof. Rajib Mall Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur. Lecture 13 Path Testing
Software Testing Prof. Rajib Mall Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur Lecture 13 Path Testing Welcome to this session and we will discuss about path
CSC 373: Algorithm Design and Analysis Lecture 8
CSC 373: Algorithm Design and Analysis Lecture 8 Allan Borodin January 23, 2013 1 / 19 Lecture 8: Announcements and Outline Announcements No lecture (or tutorial) this Friday. Lecture and tutorials as
Unit Test Virtualization with VMVM
Unit Test Virtualization with VMVM Jonathan Bell and Gail Kaiser Columbia University Fork me on Github Good news: We have tests! No judgement on whether they are complete or not, but we sure have a lot
Drexel Chatbot Requirements Specification
Drexel Chatbot Requirements Specification Hoa Vu Tom Amon Daniel Fitzick Aaron Campbell Nanxi Zhang Shishir
Branch-and-bound: an example
Branch-and-bound: an example Giovanni Righini Università degli Studi di Milano Operations Research Complements The Linear Ordering Problem The Linear Ordering Problem (LOP) is an N P-hard combinatorial
Chapter 5 Hashing. Introduction. Hashing. Hashing Functions. hashing performs basic operations, such as insertion,
Introduction Chapter 5 Hashing hashing performs basic operations, such as insertion, deletion, and finds in average time 2 Hashing a hash table is merely an of some fixed size hashing converts into locations
SmartAuth: User-Centered Authorization for the Internet of Things
SmartAuth: User-Centered Authorization for the Internet of Things Yuan Tian, Nan Zhang, Yueh-Hsun Lin, XiaoFeng Wang, Blase Ur, XianZheng Guo and Patrick Tague University, Indiana University Bloomington,
Lightweight Verification of Array Indexing
Lightweight Verification of Array Indexing Martin Kellogg*, Vlastimil Dort**, Suzanne Millstein*, Michael D. Ernst* * University of Washington, Seattle ** Charles University, Prague The problem: unsafe
Why do Internet services fail, and what can be done about it?
Why do Internet services fail, and what can be done about it? David Oppenheimer, Archana Ganapathi, and David Patterson Computer Science Division University of California at Berkeley 4 th USENIX Symposium
loops continued and coding efficiently Genome 559: Introduction to Statistical and Computational Genomics Prof. James H. Thomas
loops continued and coding efficiently Genome 559: Introduction to Statistical and Computational Genomics Prof. James H. Thomas Increment operator Review x += y x *= y x -= y x /= y # adds the value of
How can you manage what you can t see?
How can you manage what you can t see? Know what you have with Panda Cloud Systems Management Business challenge: You can t manage it if you don t know it exists. Do you have 100% permanent visibility
Oracle Developer Studio Code Analyzer
Oracle Developer Studio Code Analyzer The Oracle Developer Studio Code Analyzer ensures application reliability and security by detecting application vulnerabilities, including memory leaks and memory
Lessons Learned in Static Analysis Tool Evaluation. Providing World-Class Services for World-Class Competitiveness
Lessons Learned in Static Analysis Tool Evaluation 1 Overview Lessons learned in the evaluation of five (5) commercially available static analysis tools Topics Licensing Performance Measurement Limitations
Code verification. CSE 331 University of Washington. Michael Ernst
Code verification CSE 331 University of Washington Michael Ernst Specification and verification To find an error, compare two things Mental model Verification Specification Program Example input & output
INFS 214: Introduction to Computing
INFS 214: Introduction to Computing Session 11 Principles of Programming Lecturer: Dr. Ebenezer Ankrah, Dept. of Information Studies Contact Information: eankrah@ug.edu.gh College of Education School of
Installing GraphPad Prism for Many A guide for IT staff Last modified Sept 7, Up to date for Prism 7.03/7.0c and Prism 6.07/6.0h.
Installing GraphPad Prism for Many A guide for IT staff Last modified Sept 7, 2017. Up to date for Prism 7.03/7.0c and Prism 6.07/6.0h. Table of Contents Overview Managing your Prism subscription account
Monitoring Standards for the Producers of Web Services Alexander Quang Truong
Monitoring Standards for the Producers of Web Services 02-21-2017 Alexander Quang Truong Contents 1. Summary... 2 2. Metrics... 2 3. Benefits and Explanations of Metrics... 2 4. Tools for Monitoring...
SCAnDroid: Automated Side-Channel Analysis of Android APIs
S C I E N C E P A S S I O N T E C H N O L O G Y SCAnDroid: Automated Side-Channel Analysis of Android APIs Raphael Spreitzer, Gerald Palfinger, Stefan Mangard IAIK, Graz University of Technology, Austria
CS112 Lecture: Exceptions. Objectives: 1. Introduce the concepts of program robustness and reliability 2. Introduce exceptions
CS112 Lecture: Exceptions Objectives: 1. Introduce the concepts of program robustness and reliability 2. Introduce exceptions Materials: 1. Online Java documentation to project 2. ExceptionDemo.java to
Errors. And How to Handle Them
Errors And How to Handle Them 1 GIGO There is a saying in computer science: Garbage in, garbage out. Is this true, or is it just an excuse for bad programming? Answer: Both. Here s what you want: Can you
COSC160: Data Structures Hashing Structures. Jeremy Bolton, PhD Assistant Teaching Professor
COSC160: Data Structures Hashing Structures Jeremy Bolton, PhD Assistant Teaching Professor Outline I. Hashing Structures I. Motivation and Review II. Hash Functions III. HashTables I. Implementations
ConfGuru - A System for Fully Automated Debugging of Configuration Errors
ConfGuru - A System for Fully Automated Debugging of Configuration Errors Artur Andrzejak Institute of Computer Science Heidelberg University, Germany artur.andrzejak@informatik.uni-heidelberg.de Matthias
Traveling Salesman Problem. Java Genetic Algorithm Solution
Traveling Salesman Problem Java Genetic Algorithm Solution author: Dušan Saiko 23.08.2005 Index Introduction...2 Genetic algorithms...2 Different approaches...5 Application description...10 Summary...15
Fault Identification from Web Log Files by Pattern Discovery
ABSTRACT International Journal of Scientific Research in Computer Science, Engineering and Information Technology 2017 IJSRCSEIT Volume 2 Issue 2 ISSN : 2456-3307 Fault Identification from Web Log Files
INTELLIGENT SYSTEMS OVER THE INTERNET
INTELLIGENT SYSTEMS OVER THE INTERNET Web-Based Intelligent Systems Intelligent systems use a Web-based architecture and friendly user interface Web-based intelligent systems: Use the Web as a platform
Properties of Good Requirements
Properties of Good Requirements (Nonexhaustive) List Understandable by end users Nonprescriptive Correct Complete Concise (succinct) Precise Clear Unambiguous Consistent Traceable Modifiable Testable (verifiable)
Introduction. hashing performs basic operations, such as insertion, better than other ADTs we ve seen so far
Chapter 5 Hashing 2 Introduction hashing performs basic operations, such as insertion, deletion, and finds in average time better than other ADTs we ve seen so far 3 Hashing a hash table is merely an hashing
exlepse Eclipse XLE Plugin
exlepse Eclipse XLE Plugin Motivation During the course Grammar Development, held at the University of Konstanz in the Summer Term 2010, we were confronted with XLE and its development environment, the
Large, production-quality distributed systems still fail periodically,
Simple Testing Can Prevent Most Critical Failures An Analysis of Production Failures in Distributed Data-Intensive Systems DING YUAN, YU LUO, XIN ZHUANG, GUILHERME RENNA RODRIGUES, XU ZHAO, YONGLE ZHANG,
Evaluation of different biological data and computational classification methods for use in protein interaction prediction.
Evaluation of different biological data and computational classification methods for use in protein interaction prediction. Yanjun Qi, Ziv Bar-Joseph, Judith Klein-Seetharaman Protein 2006 Motivation Correctly
CS 315 Data Structures mid-term 2
CS 315 Data Structures mid-term 2 1) Shown below is an AVL tree T. Nov 14, 2012 Solutions to OPEN BOOK section. (a) Suggest a key whose insertion does not require any rotation. 18 (b) Suggest a key, if
Three requirements for reducing performance issues and unplanned downtime in any data center
Three requirements for reducing performance issues and unplanned downtime in any data center DARRYL FUJITA TECHNICAL SOFTWARE SOLUTIONS SPECIALIST HITACHI DATA SYSTEMS How Big Is The Cost Of Unplanned
DATA MODELS FOR SEMISTRUCTURED DATA
Chapter 2 DATA MODELS FOR SEMISTRUCTURED DATA Traditionally, real world semantics are captured in a data model, and mapped to the database schema. The real world semantics are modeled as constraints and
Administration. Conditional Statements. Agenda. Syntax. Flow of control. Lab 2 due now on floppy Lab 3 due tomorrow via FTP
Administration Conditional Statements CS 99 Summer 2000 Michael Clarkson Lecture 4 Lab 2 due now on floppy Lab 3 due tomorrow via FTP need Instruct account password Lab 4 posted this afternoon Prelim 1
Systems Approaches to Tackling Configuration Errors: A Survey
Systems Approaches to Tackling Configuration Errors: A Survey TIANYIN XU and YUANYUAN ZHOU, University of California San Diego In recent years, configuration errors (i.e., misconfigurations) have become
Oracle Database 12c: Performance Management and Tuning
Oracle University Contact Us: +43 (0)1 33 777 401 Oracle Database 12c: Performance Management and Tuning Duration: 5 Days What you will learn In the Oracle Database 12c: Performance Management and Tuning
TCM: Test Case Mutation to Improve Crash Detection in Android
TCM: Test Case Mutation to Improve Crash Detection in Android Presenter: Yavuz Koroglu Yavuz Koroglu and Alper Sen Dependable Systems Group (DSG) Bogazici University, Istanbul, Turkey http://depend.cmpe.boun.edu.tr
Using the code to measure test adequacy (and derive test cases) Structural Testing
Using the code to measure test adequacy (and derive test cases) Structural Testing Objectives To describe a second approach to testing which is geared to find program defects To explain the use of program
A BFS-BASED SIMILAR CONFERENCE RETRIEVAL FRAMEWORK
A BFS-BASED SIMILAR CONFERENCE RETRIEVAL FRAMEWORK Qing Guo 1, 2 1 Nanyang Technological University, Singapore 2 SAP Innovation Center Network,Singapore ABSTRACT Literature review is part of scientific
Lecture 3 - Fault Simulation
Lecture 3 - Fault Simulation Fault simulation Algorithms Serial Parallel Deductive Random Fault Sampling Problem and Motivation Fault simulation Problem: Given A circuit A sequence of test vectors A fault
Comparing procedure specifications
Comparing procedure specifications CSE 331 University of Washington Michael Ernst Outline Satisfying a specification; substitutability Stronger and weaker specifications Comparing by hand Comparing via
Variables and numeric types
s s and numeric types Comp Sci 1570 to C++ types Outline s types 1 2 s 3 4 types 5 6 Outline s types 1 2 s 3 4 types 5 6 s types Most programs need to manipulate data: input values, output values, store
Diagnosing Production-Run Failures Via White, Gray, Black Box Approaches
Diagnosing Production-Run Failures Via White, Gray, Black Box Approaches Yuanyuan (YY) Zhou Dept. of Computer Science and Engineering University of California, San Diego yyzhou@cs.ucsd.edu http://www.cs.ucsd.edu/~yyzhou
A Serializability Violation Detector for Shared-Memory Server Programs
A Serializability Violation Detector for Shared-Memory Server Programs Min Xu Rastislav Bodík Mark Hill University of Wisconsin Madison University of California, Berkeley Serializability Violation Detector:
Information Fusion Dr. B. K. Panigrahi
Information Fusion By Dr. B. K. Panigrahi Asst. Professor Department of Electrical Engineering IIT Delhi, New Delhi-110016 01/12/2007 1 Introduction Classification OUTLINE K-fold cross Validation Feature
CS102 Unit 2. Sets and Mathematical Formalism Programming Languages and Simple Program Execution
1 CS102 Unit 2 Sets and Mathematical Formalism Programming Languages and Simple Program Execution 2 Review Show how "Hi!\n" would be stored in the memory below Use decimal to represent each byte Remember
Data Mining: Classifier Evaluation. CSCI-B490 Seminar in Computer Science (Data Mining)
Data Mining: Classifier Evaluation CSCI-B490 Seminar in Computer Science (Data Mining) Predictor Evaluation 1. Question: how good is our algorithm? how will we estimate its performance? 2. Question: what
More Examples. Lecture 24: More Scala. Higher-Order Functions. Control Structures
More Examples Lecture 24: More Scala CSC 131 Fall, 2014 Kim Bruce MyList, MyArrayList, SinglyLinkedList - Val vs var - Can create Array[T] (unlike Java), though need implicit ClassManifest - foreach(f)
Constructing Algorithms and Pseudocoding This document was originally developed by Professor John P. Russo
Constructing Algorithms and Pseudocoding This document was originally developed by Professor John P. Russo Purpose: # Describe the method for constructing algorithms. # Describe an informal language for
The Perceptron. Simon Šuster, University of Groningen. Course Learning from data November 18, 2013
The Perceptron Simon Šuster, University of Groningen Course Learning from data November 18, 2013 References Hal Daumé III: A Course in Machine Learning http://ciml.info Tom M. Mitchell: Machine Learning
Path-based Macroanalysis for Large Distributed Systems
Path-based Macroanalysis for Large Distributed Systems 1, Anthony Accardi 2, Emre Kiciman 3 Dave Patterson 1, Armando Fox 3, Eric Brewer 1 mikechen@cs.berkeley.edu UC Berkeley 1, Tellme Networks 2, Stanford
GUIDE. Workshare Troubleshooting Guide
GUIDE Workshare Troubleshooting Guide Table of Contents Understanding Troubleshooting...3 System Understanding... 3 Strategic Understanding... 3 Procedural Understanding... 4 Troubleshooting Strategy...5
Course Outline. Introduction to java
Course Outline 1. Introduction to OO programming 2. Language Basics Syntax and Semantics 3. Algorithms, stepwise refinements. 4. Quiz/Assignment ( 5. Repetitions (for loops) 6. Writing simple classes 7.
Shin Hwei Tan Darko Marinov Lin Tan Gary T. Leavens University of Illinois. University of Illinois
Shin Hwei Tan Darko Marinov Lin Tan Gary T. Leavens University of Illinois University of Illinois University of Waterloo University of Central Florida 1 /* * Returns a synchronized map backed by the given
CS-XXX: Graduate Programming Languages. Lecture 9 Simply Typed Lambda Calculus. Dan Grossman 2012
CS-XXX: Graduate Programming Languages Lecture 9 Simply Typed Lambda Calculus Dan Grossman 2012 Types Major new topic worthy of several lectures: Type systems Continue to use (CBV) Lambda Caluclus as our
Fuzzing: Breaking software in an automated fashion
Fuzzing: Breaking software in an automated fashion Ilja van Sprundel December 8, 2005 1 Introduction Fuzzing is the art of automatic bug finding. This is done by providing an application with semi-valid
XDS An Extensible Structure for Trustworthy Document Content Verification Simon Wiseman CTO Deep- Secure 3 rd June 2013
Assured and security Deep-Secure XDS An Extensible Structure for Trustworthy Document Content Verification Simon Wiseman CTO Deep- Secure 3 rd June 2013 This technical note describes the extensible Data
Interaction Testing. Chapter 15
Interaction Testing Chapter 15 Interaction faults and failures Subtle Difficult to detect with testing Usually seen after systems have been delivered In low probability threads Occur after a long time
Population Problems. To develop a model for population growth, To develop proficiency with algebraic equations
Grade levels: 7-12 Population Problems Objectives: To develop a model for population growth, To develop proficiency with algebraic equations Topics involved: and sequences, Modeling, algebra, systems of
CSE 565 Computer Security Fall 2018
CSE 565 Computer Security Fall 2018 Lecture 15: Software Security II Department of Computer Science and Engineering University at Buffalo 1 Software Vulnerabilities Buffer overflow vulnerabilities account
Software Security IV: Fuzzing
1 Software Security IV: Fuzzing Chengyu Song Slides modified from Dawn Song 2 Administrivia Homework1 Due: Friday Oct 27 11:59pm Questions regarding reading materials Talk Security R&D in a Security Company: