Course Design Document. IS410: Advanced Data Management. Version 5.1

Transcription

1 Course Design Document IS410: Advanced Data Management Version December 2010

2 Table of Contents 1. Versions History 2. Overview of Advanced Data Management Course 2.1. Synopsis 2.2. Prerequisites 2.3. Objectives 2.4. Structure of the Course 2.5. Teaching Staff 3. Output and Assessment Summary 3.1 Midterm and Test (2 25%) 3.2 Group Implementation Assignments (2 15%) 3.3 Indexing Homework (5%) 3.4 Participation (15%) 4. Group Allocation for Assignments 5. Classroom Planning 6. Information Resources and References 6.1 Resources 6.2 Acknowledgements 7. Tooling 8. Learning Outcomes, Achievement Methods and Assessment IS410 Advanced Data Management Page 3

3 1. Versions History Version Description of Changes V 1.0 First version: Designed after discussions with Ramayya Krishnan (CMU), Baihua Zheng (SMU), Hwee Hwa Pang (SMU), and Ram Sivaram (Oracle Corp). V 1.1 Details and concrete weekly schedule filled out V 1.2 This version reflects the way ADM was actually taught in Term II AY It includes a diagram visualizing the course outline. V 2.0 Changes in the course material itself, and the assessments V 2.1 Updated LOMS table according to new template V 3.0 Changed Assignment 1, extended PL/SQL part, different mark distribution, slightly modified course content V 3.1 Decided to make the Indexing Homework an individual (versus team) assignment V3.2 Minor updates on LOMS table and weekly plan format, according to Dean s suggestions during annual review V3.3 Updated to the most current SIS format/template found on the S: drive V3.4 LOMS update according to new SIS template V4.0 Update on mark distribution and change of homework into a group assignment V5.0 General updates and LOMS enrichment according to new SIS template V5.1 Changes according to new SIS standards/templates. Author Date Kyriakos Mouratidis Kyriakos Mouratidis Kyriakos Mouratidis Kyriakos Mouratidis Kyriakos Mouratidis Kyriakos Mouratidis Kyriakos Mouratidis Kyriakos Mouratidis Kyriakos Mouratidis Kyriakos Mouratidis Kyriakos Mouratidis Kyriakos Mouratidis Kyriakos Mouratidis IS410 Advanced Data Management Page 4

4 Remark: Previous version includes a LO table that shows in detail how the various assignments and tasks achieve the specific objectives IS410 Advanced Data Management Page 5

5 2. Overview of the Advanced Data Management Course 2.1. Synopsis The objective of the Advanced Data Management course (IS410) is to expose students to exciting data management topics and to provide them with hands-on experience with widely used database tools. The course includes a technology component and an advanced topics component. The technology component comprises lab sessions, where students use a commercial database (e.g., Oracle) to solve exercises based on real-life scenarios. The advanced topics component is delivered through interactive lectures and discussions on emerging database fields, such as location-based services, preference-based query processing, etc Prerequisites Students are required to have taken (or be exempted from taking) the Data Management (IS202) courses to ensure that they have a solid foundation in database design and querying Objectives Upon completion of the course, students will be able to: Understand concepts of database design, extending further than common/standard application domains Identify the trade-offs of alternative solutions to a particular problem, and decide the best one, depending on the particular requirements of the targeted application and the intrinsic characteristics of the underlying data and queries Use techniques that are very useful when deploying/using/maintaining a real-world database system Use data management tools that are widely spread in the industry Solve problems and use tools other than those presented/dealt with in class IS410 Advanced Data Management Page 6

6 2.4. Structure of the Course The technology component includes three hands-on sessions. The first (3 hours) introduces PL/SQL with a combination of lecturer presentation and hands-on trials of the examples by the students. The second (delivered on the week after the initial Pl/SQL introduction) requires the students to perform a set of tasks using PL/SQL by themselves in class, with the professor assisting them individually when necessary. The third hands-on session uses PL/SQL as a platform and requires the students to go through a web-based tutorial that introduces the Oracle Spatial Locator and guides them through accomplishing a spatial indexing/querying task. Prior to the above sessions, the students are asked to complete a web-based tutorial to familiarize with the interface of Oracle 10g and get a sense of Oracle Application Express (a web-based database development tool). The advanced topics component includes standard database topics not covered in IS202 (the basic Data Management course), like file organization, indexing, and transaction management. The remaining lectures target non-conventional, emerging database areas, aiming at (i) widening the students perspective about what databases are and are capable of, and (ii) triggering their interest and motivating them for postgraduate studies/research. The following diagram shows the basic modules of the course, along with the main assignments and their duration. IS410: Advanced Data Management Basics (storage types, sorting & searching algorithms, client-server architectures, etc.) Hands-on introduction to PL/SQL In-class individual exercises on PL/SQL File Structures and Indexing Midterm Exam (week 7) Spatial Data and Location-based Services PL/SQL and Oracle Spatial Locator Transaction Management Data-stream Management Preference-based Queries Industry Talk (week 13) Advanced Topic Emerging Topic Lab/Hands-on Individual Assessment Group Assignment Homework Industry Talk Final Test (week 14) 2.5. Teaching Staff Professor: Kyriakos Mouratidis (course coordinator) Instructor: N.A. IS410 Advanced Data Management Page 7

7 3. Output and Assessment Summary 3.1 Midterm and Test (50%) There is a midterm (2 hours, 25%) and a final test (2 hours, 25%). 3.2 Group Implementation Assignments (30%) Students form groups of 3 and perform 2 hands-on assignments (15% each). The first one is on performance improvements derived from indexing (with plain indexes such as B + -trees); experiments are performed using Oracle 10g XE. In the second, the same groups of students use PL/SQL in conjunction with the Oracle Spatial Locator in order to appreciate spatial indexes and gain experience on creating procedures and functions. 3.3 Group Homework (5%) Group homework including query processing algorithms and cost estimation. 3.4 Participation (15%) Class participation and in-class exercises (15% of the final grade). Every lecture includes exercises and questions, keeping the students interest alive and allowing the assessment of their degree of engagement and understanding. IMPORTANT: Academic Integrity All acts of academic dishonesty (including, but not limited to, plagiarism, cheating, fabrication, facilitation of acts of academic dishonesty by others, unauthorized possession of exam questions, or tampering with the academic work of other students) are serious offences. All work (whether oral or written) submitted for purposes of assessment must be the student s own work. Penalties for violation of the policy range from zero marks for the component assessment to expulsion, depending on the nature of the offense. When in doubt, students should consult the instructors of the course. Details on the SMU Code of Academic Integrity may be accessed at 4. Group Allocation for Assignments Assignment No How groups are formed? No of Students in a group Assignment 1 Students form the group 3 Homework Same groups as in Assignment 1 3 Assignment 2 Same groups as in Assignment Classroom Planning There is one class of 3 hours each week. This is split into three sections of 1 hour each, with two breaks of 5-10 minutes in between. All sections contain in-class exercises, but most of them are given in the third section, which is the toughest to maintain the students attention/interest in as they are getting tired. The implementation of the above planning may vary from week to week, especially for the hands-on sessions. The following table summarizes the course schedule: Wk Focus Readings (before class)/ Tools Installation Classroom Activities 1 Introduction - Definitions - Main Memory vs. Secondary Storage - Client/Server database architectures 2 PL/SQL by Example Install: Oracle 10g Express Edition Presentation of PL/SQL based on coding examples Readings (after class)/assignments Web: Oracle Technology Network 3 PL/SQL Exercises - Individual, in-class exercises with PL/SQL (stored Release: Assignment 1 IS410 Advanced Data Management Page 8

8 & Buffer Management functions and procedures) - Buffer management 4 File Structures - Sorting and Binary search - File structures 5 Indexing I - Dense vs. Sparse indexes - Primary vs. Secondary indexes - Single-level vs Multi-level indexes 6 Indexing II - ISAM and its deficiencies - The (ubiquitous) B + -tree [15%] Book Extract: Buffer Management & File Organization Book Extract: Indexing Concepts Book Extract: The B + -tree 7 Midterm Midterm Exam [25%] Release: Indexing Homework [5%] 9 Location-based Services & Oracle Spatial Locator 10 Bitmap Indexes & Transaction Management I 11 Transaction Management II 12 Data-stream Management 13 Preference-based Queries & Industry Talk - Spatial data, queries and indexing - Oracle Spatial Locator (by example; web-based) - Indexes for arbitrary multi-attribute selections - Transaction management (ACID properties) - Serializability - Concurrency control 14 Final Test Final Test [25%] - Definitions - Applications - Challenges - Design decisions - Top-k query and the Skyline operator - Invited talk by a Data Management/Analytics company - Web: OTN tutorial on the Spatial Locator - Boor Extract: Spatial Data - Release: Assignment 2 [15%] Boor Extract: Transaction Management & Concurrency Control 6. Information resources and references 8.1 Resources Although there is a primary textbook, students are not required to purchase it. Extracts from the primary and supplemental books are provided via SMU-VISTA. Textbook: Database System Concepts, 5th edition, by Avi Silberschatz, Henry F. Korth, and S. Sudarshan, McGraw-Hill, Additional sources: Database Management Systems, 3rd edition, by Raghu Ramakrishnan and Johannes Gehrke, McGraw- Hill, Modern Database Management, 9th edition, by Jeffrey A. Hoffer, Mary B. Prescott, and Fred R. McFadden, Pearson/Prentice Hall, Acknowledgements Three sets of slides are based on the course materials of CSIT 530, HKUST (thanks to Dimitris Papadias) and CSCI 585, USC (thanks to Cyrus Shahabi). 7. Tooling Purpose of the Tool Description Remarks Database Management Oracle Database 10g (Express Edition) Used as platform for PL/SQL learning, experimentation and development (both in lab sessions and for the implementation assignments) IS410 Advanced Data Management Page 9

9 Spatial Data Management Oracle Spatial Locator Feature of Oracle Database used to build spatial indexes and process spatial queries IS410 Advanced Data Management Page 10

10 8. Learning Outcomes, Achievement Methods and Assessment IS410 - Advanced Data Management 1 Integration of business & technology in a sector context 1.1 Business IT value linkage skills Y 1.2 Cost and benefits analysis skills 1.3 Business software solution impact analysis skills Course-specific Core Competencies which Address the Outcomes Assess the importance of efficient data organization/processing in a business scenario Identify business functions where it is essential that specific queries are processed quickly Evaluate the degree to which indexing assists towards accelerating the aforementioned functions Faculty Methods to Assess Outcomes 2 IT architecture, design and development skills 2.1 System requirements specification skills 2.2 Software and IT architecture analysis and design skills YY 2.3 Implementation skills YY 2.4 Technology application skills Y Identify (analytically and experimentally) the trade-offs among alternative data organizations and indexes and decide which suits best an application at hand Make performance trade-off analyses in the context of transaction management, data-streams, and preference-based queries Implement procedures and functions in PL/SQL Build relational indexes in Oracle 10g Build spatial indexes using Oracle s Spatial Locator Run experiments using PL/SQL and indexes Choose the technique (such as choosing the right type of index, figuring out the best processing algorithm, etc.) that best meets a set of given requirements. Use appropriately learnt tools (e.g. the range and nearest neighbor queries of Spatial Locator) as building blocks to answer complex query types to Homework to Midterm Grade Final Test Observe and give feedback to student performance on the spot during the handson PL/SQL lab in Week 3 to Homework to Midterm Grade Final Test 3 Project management skills 3.1 Scope management skills 3.2 Risks management skills 3.3 Project integration and time management skills 3.4 Configuration management skills 3.5 Quality management skills 4 Learning to learn skills IS410 Advanced Data Management Page 11

11 4.1 Search skills Y 4.2 Skills for developing a methodology for learning Source real data that fit given experimentation requirements Use online resources to identify the right command/construct/syntax of PL/SQL Do independent self-study (e-learning tutorial) to familiarize with Oracle s Spatial Locator 5 Collaboration (or team) skills: 5.1 Skills to improve the effectiveness of group processes and work products Y Effectively communicate and resolve conflicts while working in a team with peers of various abilities and attitudes to Homework 6 Change management skills for enterprise systems 6.1 Skills to diagnose business changes 6.2 Skills to implement and sustain business changes 7 Skills for working across countries, cultures and borders 7.1 Cross-national awareness skills 7.2 Business across countries facilitation skills 8 Communication skills 8.1 Presentation skills 8.2 Writing skills Y Write a report on the solution to a given problem (technical choices etc) in a concise and formal way Grade the clarity of written reports for Assignments 1 and 2, and give feedback on it Y YY This sub-skill is covered partially by the course This sub-skill is a main focus for this course IS410 Advanced Data Management Page 12