Data Mining. Jeff M. Phillips. January 8, 2014

Similar documents
Data Mining. Jeff M. Phillips. January 12, 2015 CS 5140 / CS 6140

Data Mining. Jeff M. Phillips. January 9, 2013

Data Mining. Jeff M. Phillips. January 7, 2019 CS 5140 / CS 6140

CS 521 Data Mining Techniques Instructor: Abdullah Mueen

10/14/2017. Dejan Sarka. Anomaly Detection. Sponsors

Generalized Principal Component Analysis CVPR 2007

Data Preprocessing. Slides by: Shree Jaswal

CPSC 340: Machine Learning and Data Mining. Principal Component Analysis Fall 2017

Introduction to Data Mining

Sublinear Models for Streaming and/or Distributed Data

K236: Basis of Data Science

UNIT 2 Data Preprocessing

10/10/13. Traditional database system. Information Retrieval. Information Retrieval. Information retrieval system? Information Retrieval Issues

Elysium Technologies Private Limited::IEEE Final year Project

CSE P521: Applied Algorithms

Instructor: Dr. Mehmet Aktaş. Mining of Massive Datasets Jure Leskovec, Anand Rajaraman, Jeff Ullman Stanford University

CS325 Artificial Intelligence Ch. 20 Unsupervised Machine Learning

Unsupervised Data Mining: Clustering. Izabela Moise, Evangelos Pournaras, Dirk Helbing

MATH36032 Problem Solving by Computer. Data Science

Data Mining. Introduction. Hamid Beigy. Sharif University of Technology. Fall 1395

COSC160: Detection and Classification. Jeremy Bolton, PhD Assistant Teaching Professor

Data Mining. Introduction. Hamid Beigy. Sharif University of Technology. Fall 1394

Table Of Contents: xix Foreword to Second Edition

CPSC 340: Machine Learning and Data Mining. Hierarchical Clustering Fall 2017

CSE 255 Lecture 6. Data Mining and Predictive Analytics. Community Detection

Big Data Analytics: What is Big Data? Stony Brook University CSE545, Fall 2016 the inaugural edition

Exploiting the OpenPOWER Platform for Big Data Analytics and Cognitive. Rajesh Bordawekar and Ruchir Puri IBM T. J. Watson Research Center

Contents. Foreword to Second Edition. Acknowledgments About the Authors

Data Mining. Data preprocessing. Hamid Beigy. Sharif University of Technology. Fall 1395

A Geometric Analysis of Subspace Clustering with Outliers

CS639: Data Management for Data Science. Lecture 1: Intro to Data Science and Course Overview. Theodoros Rekatsinas

Data Science Bootcamp Curriculum. NYC Data Science Academy

CPSC 340: Machine Learning and Data Mining. Principal Component Analysis Fall 2016

STA141C: Big Data & High Performance Statistical Computing

CPSC 340: Machine Learning and Data Mining

Python With Data Science

Question Bank. 4) It is the source of information later delivered to data marts.

This tutorial has been prepared for computer science graduates to help them understand the basic-to-advanced concepts related to data mining.

ECLT 5810 Data Preprocessing. Prof. Wai Lam

Network Traffic Measurements and Analysis

DATA STREAMS: MODELS AND ALGORITHMS

Pre-Requisites: CS2510. NU Core Designations: AD

Review: Memory, Disks, & Files. File Organizations and Indexing. Today: File Storage. Alternative File Organizations. Cost Model for Analysis

ECT7110. Data Preprocessing. Prof. Wai Lam. ECT7110 Data Preprocessing 1

Outlier Pursuit: Robust PCA and Collaborative Filtering

USC Viterbi School of Engineering

Exploratory Data Analysis using Self-Organizing Maps. Madhumanti Ray

Data Preprocessing. Why Data Preprocessing? MIT-652 Data Mining Applications. Chapter 3: Data Preprocessing. Multi-Dimensional Measure of Data Quality

Machine Learning and Data Mining. Clustering (1): Basics. Kalev Kask

Data Mining. Data preprocessing. Hamid Beigy. Sharif University of Technology. Fall 1394

Preprocessing Short Lecture Notes cse352. Professor Anita Wasilewska

Large-Scale Flight Phase identification from ADS-B Data Using Machine Learning Methods

Outlier detection using autoencoders

CMPSCI 711: More Advanced Algorithms

3. Data Preprocessing. 3.1 Introduction

2. Data Preprocessing

CSE 40171: Artificial Intelligence. Learning from Data: Unsupervised Learning

Machine Learning. Unsupervised Learning. Manfred Huber

Specialist ICT Learning

By Mahesh R. Sanghavi Associate professor, SNJB s KBJ CoE, Chandwad

Context. File Organizations and Indexing. Cost Model for Analysis. Alternative File Organizations. Some Assumptions in the Analysis.

22 October, 2012 MVA ENS Cachan. Lecture 5: Introduction to generative models Iasonas Kokkinos

Modern Multidimensional Scaling

Image Analysis, Classification and Change Detection in Remote Sensing

DEPARTMENT OF COMPUTER SCIENCE

NeuroMem. A Neuromorphic Memory patented architecture. NeuroMem 1

COSC160: Data Structures Hashing Structures. Jeremy Bolton, PhD Assistant Teaching Professor

Dta Mining and Data Warehousing

Event: PASS SQL Saturday - DC 2018 Presenter: Jon Tupitza, CTO Architect

IMAGE ANALYSIS, CLASSIFICATION, and CHANGE DETECTION in REMOTE SENSING

CPSC 340: Machine Learning and Data Mining. Hierarchical Clustering Fall 2016

Database and Knowledge-Base Systems: Data Mining. Martin Ester

数据挖掘 Introduction to Data Mining

CLASSIFICATION AND CHANGE DETECTION

Data Foundations. Topic Objectives. and list subcategories of each. its properties. before producing a visualization. subsetting

Columbus State Community College Mathematics Department Public Syllabus. Course and Number: MATH 1172 Engineering Mathematics A

data-based banking customer analytics

Name of the lecturer Doç. Dr. Selma Ayşe ÖZEL

Data Mining Chapter 3: Visualizing and Exploring Data Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University

Overlay and P2P Networks. Introduction. Prof. Sasu Tarkoma

Summary of Last Chapter. Course Content. Chapter 3 Objectives. Chapter 3: Data Preprocessing. Dr. Osmar R. Zaïane. University of Alberta 4

Jarek Szlichta

COSC-589 Web Search and Sense-making Information Retrieval In the Big Data Era. Spring Instructor: Grace Hui Yang

Today s topic CS347. Results list clustering example. Why cluster documents. Clustering documents. Lecture 8 May 7, 2001 Prabhakar Raghavan

Data Preprocessing Yudho Giri Sucahyo y, Ph.D , CISA

Exercise 2. AMTH/CPSC 445a/545a - Fall Semester September 21, 2017

Administrative. Machine learning code. Supervised learning (e.g. classification) Machine learning: Unsupervised learning" BANANAS APPLES

A Brief Look at Optimization

UNIT 2. DATA PREPROCESSING AND ASSOCIATION RULES

Epilog: Further Topics

Data Preprocessing. S1 Teknik Informatika Fakultas Teknologi Informasi Universitas Kristen Maranatha

CSE 158 Lecture 6. Web Mining and Recommender Systems. Community Detection

B561 Advanced Database Concepts Streaming Model. Qin Zhang 1-1

Similarity Ranking in Large- Scale Bipartite Graphs

Machine Learning - Regression. CS102 Fall 2017

PSU Student Research Symposium 2017 Bayesian Optimization for Refining Object Proposals, with an Application to Pedestrian Detection Anthony D.

Collaborative filtering based on a random walk model on a graph

ELEG Compressive Sensing and Sparse Signal Representations

Information Retrieval May 15. Web retrieval

Data Mining Learning from Large Data Sets

Transcription:

Data Mining Jeff M. Phillips January 8, 2014

Data Mining What is Data Mining? Finding structure in data? Machine learning on large data? Unsupervised learning? Large scale computational statistics?

Data Mining What is Data Mining? Finding structure in data? Machine learning on large data? Unsupervised learning? Large scale computational statistics? What you can recover from data and what you cannot recover. Algorithms for how to recover it efficiently.

Data Mining What is Data Mining? Finding structure in data? Machine learning on large data? Unsupervised learning? Large scale computational statistics? What you can recover from data and what you cannot recover. Algorithms for how to recover it efficiently. How to think about data analytics.

Modeling versus Efficiency Two Intertwined Objectives: Model Data Correctly Process Data Efficiently Statistics Machine Learning Data Mining Algorithms Modeling Efficiency

Other Data Mining Course Every university teaches data mining differently!

Other Data Mining Course Every university teaches data mining differently! What flavor is offered in this class: Focus on techniques for very large scale data Broad coverage... with recent developments Formally and generally presented (proof sketches)... but useful in practice (e.g. internet companies) Probabilistic algorithms: connections to CS and Stat

Other Data Mining Course Every university teaches data mining differently! What flavor is offered in this class: Focus on techniques for very large scale data Broad coverage... with recent developments Formally and generally presented (proof sketches)... but useful in practice (e.g. internet companies) Probabilistic algorithms: connections to CS and Stat not specific software tools / programming languages

Other Data Mining Course Every university teaches data mining differently! What flavor is offered in this class: Focus on techniques for very large scale data Broad coverage... with recent developments Formally and generally presented (proof sketches)... but useful in practice (e.g. internet companies) Probabilistic algorithms: connections to CS and Stat not specific software tools / programming languages Maths: Linear Algebra, Probability, High-dimensional geometry

Outline Statistical Principals: 1. Understanding random effects Data and Distances: 2. Similarity (find duplicates and similar items) 3. Clustering (aggregate close items) Structure in Data: 3. Clustering (aggregate close items) 4. Regression (patterns in data) 5. Noisy Data (anomalies in data) Controlling for Noise and Uncertainty: 5. Noisy Data (anomalies in data) 6. Link Analysis (prominent structure in large graphs) 7. Summaries (concise representation)

Statistical Principals What happens as data is generated with replacement {IP addresses, words in dictionary, edges in graph, hash table} When do items collide? When do you see all items? When is the distribution almost uniform?

Statistical Principals What happens as data is generated with replacement {IP addresses, words in dictionary, edges in graph, hash table} When do items collide? When do you see all items? When is the distribution almost uniform?

Statistical Principals What happens as data is generated with replacement {IP addresses, words in dictionary, edges in graph, hash table} When do items collide? When do you see all items? When is the distribution almost uniform?

Statistical Principals What happens as data is generated with replacement {IP addresses, words in dictionary, edges in graph, hash table} When do items collide? When do you see all items? When is the distribution almost uniform?

Raw Data to Abstract Representations How to measure similarity between data? Key idea: data point a quick brown fox jumped... 1 1 1 1 1 1 1 1 1 1 1 1 11 joe bob sue age income height 25 32 28 90K 45K 38K 1.85 1.52 1.61

Similarity Given a large set of data P. Given new point q, is q in P? Given a large set of data P. Given new point q, what is closest point in P to q? q P

Clustering How to find groups of similar data. do we need a representative? can groups overlap? what is structure of data/distance?

Clustering How to find groups of similar data. do we need a representative? can groups overlap? what is structure of data/distance? Hierarchical clustering : When to combine groups? k-means clustering : k-median, k-center, k-means++ Graph clustering : modularity, spectral

Regression Consider a data set P R d, where d is BIG! Want to find representation of P in some R k µ(p) Q R k so p i p j q i q j Q R k should capture most data in P

Regression Consider a data set P R d, where d is BIG! Want to find representation of P in some R k µ(p) Q R k so p i p j q i q j Q R k should capture most data in P L 2 Regression + PCA : Common easy approach Multidimensional Scaling : Fits in R k with k small Random Projections : Faster and easier (different bounds) L 1 Regression : Better, Orthogonal Matching Pursuit Special Topic : Compressed Sensing

Noisy Data What to do when data is noisy? Identify it : Find and remove outliers Model it : It may be real, affect answer Exploit it : Differential privacy (ethics in data)

Link Analysis How does Google Search work? Converts webpage links into directed graph. Markov Chains : Models movement in a graph PageRank : How to convert graph into important nodes MapReduce : How to scale up PageRank Communities : Other important nodes in graphs

Summaries Reducing massive data to small space. Want to retain as much as possible (not specific structure) error guarantees OnePass Sampling : Reservoir Sampling Density Approximation : Quantiles MinCount Hash : Sketching data, abstract features Spanners : graph approximations [...] :... on request... memory length m CPU word 2 [n] u ω(k, u) ω(p, u)

Themes What are course goals? Intuition for data analytics How to model data (convert to abstract data types) How to process data efficiently (balance models with algorithms)

Themes What are course goals? Intuition for data analytics How to model data (convert to abstract data types) How to process data efficiently (balance models with algorithms) Work Plan: 2-3 weeks each topic. Overview classic techniques Focus on modeling / efficiency tradeoff Special topics Short homework for each (analysis + with data) Course Project (1/2 grade). Focus on specific data set Deep exploration with technique Ongoing refinement of presentation + approach

On Homeworks Managed through Canvas (will be up by end of week) No restriction on programming language. Some designed for matlab, others better in python or C++. Programming assignments with not too many specifications. Bonus Questions!

Data Group Data Group Meeting Thursdays @ 12:15-1:30 in MEB 3147 (LCR) CS 7941 Data Reading Group requires one presentation if taken for credit http://datagroup.cs.utah.edu/dbgroup.php

Data Group Data Group Meeting Thursdays @ 12:15-1:30 in MEB 3147 (LCR) CS 7941 Data Reading Group requires one presentation if taken for credit http://datagroup.cs.utah.edu/dbgroup.php Tomorrow: Qin Zhang (Indiana University) Subspace Embeddings and L p -Regression Using Exponential Random Variables

2024 © technodocbox.com Privacy Policy | Terms of Service | Feedback