ELEC6910Q Analytics and Systems for Social Media and Big Data Applications

Transcription

1 ELEC6910Q Analytics and Systems for Social Media and Big Data Applications Tutorial 1 [Visualization and Data Analytic] Prof. James She james.she@ust.hk 1

2 Outcomes of this tutorial 1. Basic Task: Visualization using Gephi visualize social graph learn basic UI 2. Creative/Additional Task: Python in ECE cloud learn to access ECE cloud setup virtual environment with Anaconda for Python platform 2

3 1. Basic Task (Due: within Tutorial) Making a social graph with Gephi 1. Visualize a social graph with Gephi using the dataset provided: 2. Change the size and the colour of the graph according to degree 3. Try some way to figure out the following: What s the the average path length between any pair of nodes in your graph? *Demonstrate your basic task to the TAs before you leave *Submit your basic task on course Facebook post *20% will be deducted for late submission. 3

4 Gephi Introduction Gephi is an open-source network analysis and visualization software package written in Java on the Netbeans platform. 2. Selected for the Google Summer of Code in 2009 to

5 Gephi Introduction Real-time visualization 2. Layout 3. Metrics Diameter Average Separation Centrality 4. Network Analysis 5. Create cartography 6. and more 5

6 Gephi Visualize coauthors graph in network science Example: coauthors graph in SML Kang 1 4 Tom 2 2 James 1 3 Hui 1 Ming Paper id authors 1 Kang, Tom, James 2 Hui, Ming, James 3 Hui, Kang, James 4 Ming, James 5 Kang, James 6 Tom, James 7 Kang, Ming, James Insight 1: max degree separation: 3 e.g., Ming James Kang Tom (3), Tom James Hui (2), Insight 2: The node with highest betweenness: James 6

7 Gephi Basic UI 1. Appearance to make some initial adjustments to the graph appearance based on different network attributes 2. Layout to obtain a first pass layout to start sorting things out 3. Context to select or filter out parts of the graph based on network attributes 4 4. Settings change setting related to the node, edge, and label appearances 7

8 Gephi Measurements click run to get the results 8

9 Gephi Layouts select layout and click run try to play around with different parameters 9

10 2. Creative Task (Due: next Monday noon) Accessing ECE Cloud and Setup Python Follow through the instruction to setup Anaconda and Python 3.6 on your personal computers Create a virtual environment with some creative name Take a screen shot showing python version and the name of your virtual environment created *Submit your creative task on course Facebook post *20% will be deducted for late submission. 10

11 ECE Cloud Setting up ECE Cloud Start VMWare Horizon View Client. 2. Double-click Add Server or New Server. 3. Type vdi.ece.ust.hk into the Connection Server field Double-click vdi.ece.ust.hk icon 5. Type in your ITSC login and configure the Domain as HKUST

12 ECE Cloud Setting up ECE Cloud Double-click ELEC6910Q LAB. And now you should be connected to the VM 7. Click Allow 8. You can find the local drives in tsclients

13 Anaconda & Python Installing Anaconda 1. Download latest Anaconda from here. Make sure you download Python 3.6! 2. Open "Terminal 3. Browse to your downloads folder by running: cd /home/your_itsc_account/downloads 4. Run: bash Anaconda Linux-x86_64.sh 5. Follow through the instruction 6. Restart the terminal 13

14 Anaconda & Python Creating a Virtual Environment 1. Open Terminal 2. Run conda info --envs to see available virtual environments 3. Run conda create --name elec6910q python=3.6 to create new environment with name elec6910q and python version Run source activate elec6910q to activate this new environment 5. Run conda info --envs again to see if the environment is created and activated (you will see an * next to the activated environment) 6. Run python --version to check python version 14

15 -End of Tutorial 1 Questions / Comments? 15

16 Appendix - 1 Exporting Path 1. Open Terminal 2. Run export PATH=~/anaconda3/bin:$PATH 3. Run conda --version to check the version 4. Run conda update conda to update to latest verion 16