Analysis of Program Behavior
|
|
- Jeffery Sutton
- 5 years ago
- Views:
Transcription
1 Analysis of Program Behavior High Performance Computing, Visualization Lucas Mello Schnorr probably soon (LIG-CNRS INF-UFRGS) 2 nd LICIA Workshop Grenoble, France September 5th, / 25
2 Introduction High Performance Computing Supercomputers, Clusters, Multi-Clusters Dedicated interconnection, geographically centralized Distributed Systems Grids, Clouds, Volunteer Computing Shared interconnection, geographically dispersed IBM BlueGene/Q with 1,572,864 cores (#1 - Top500) 2/ 25
3 Introduction High Performance Computing Supercomputers, Clusters, Multi-Clusters Dedicated interconnection, geographically centralized Distributed Systems Grids, Clouds, Volunteer Computing Shared interconnection, geographically dispersed IBM BlueGene/Q with 1,572,864 cores (#1 - Top500) Applications Climatology, Simulation, Cryptography 2/ 25
4 Challenges and Motivation Very large applications Top500 has machines with 1.5 million cores BOINC has more than 300K active computers Low-intrusion tracing techniques Buffering, hardware support, simulation traces 3/ 25
5 Challenges and Motivation Very large applications Top500 has machines with 1.5 million cores BOINC has more than 300K active computers Low-intrusion tracing techniques Buffering, hardware support, simulation traces Space/Time trace size explosion Very detailed in time Many entities in space 3/ 25
6 Challenges and Motivation Very large applications Top500 has machines with 1.5 million cores BOINC has more than 300K active computers Low-intrusion tracing techniques Buffering, hardware support, simulation traces Space/Time trace size explosion Very detailed in time Many entities in space How to extract useful information from traces? 3/ 25
7 Approach and Objectives Approach Exploratory Trace Visualization Multi-scale graphical representation of events Data aggregation mechanisms to scale Interactivity for most of operations 4/ 25
8 Approach and Objectives Approach Exploratory Trace Visualization Multi-scale graphical representation of events Data aggregation mechanisms to scale Interactivity for most of operations Analysis of Program Behavior Validate or refute behavioral assumptions Explain anomalies, unexpected behavior Consider resource constraints 4/ 25
9 Introduction Traditional trace visualization
10 Introduction Traditional trace visualization
11 Introduction Traditional trace visualization
12 Outline 1 Why data aggregation? 2 Visualization techniques Squarified Treemap View Hierarchical Graph View 3 Tools and framework 4 Collaborations within LICIA 5 Conclusion 6/ 25
13 Trace visualization Real BOINC availability trace file Availability is either true or false One volunteer client 7/ 25
14 Trace visualization Real BOINC availability trace file Availability is either true or false One volunteer client GNUPlot to a vector file: 8-month and 12-day zoom 7/ 25
15 Trace visualization trust the rendering? Same vector file, two different views Different interpretation depending on the viewer 8/ 25
16 Trace visualization trust the rendering? Same vector file, two different views Different interpretation depending on the viewer Evince Acroread 8/ 25
17 Trace visualization trust the rendering? Same vector file, two different views Different interpretation depending on the viewer Evince Acroread Should we trust the rendering? No! We need to make choices before visualizing data 8/ 25
18 Trace visualization data aggregation 24-hour time integration 9/ 25
19 Trace visualization data aggregation 24-hour time integration Should we aggregate data without care? No! We need to make choices before aggregating data 9/ 25
20 Space/Time views Widespread, useful, intuitive, fast adoption All trace events represented, causal order Paje Vite Vampir 10/ 25
21 Space/Time views Widespread, useful, intuitive, fast adoption All trace events represented, causal order Paje Vite Vampir However... Also impacted by ever larger trace sizes Limited visualization scalability 10/ 25
22 Space/Time views limitations MPI Sweep3D 16 processes Simulated with SMPI, traced with SimGrid pj_dump ed to a csv file, loaded into R Gantt-charts by R, dumped to a vector file 11/ 25
23 Space/Time views limitations Evince 11/ 25
24 Space/Time views limitations GS (Ghostscript) 11/ 25
25 Space/Time views limitations MPI Sweep3D 16 processes Real execution on the Griffon cluster of Grid 5000 traced with TAU, converted with tau2paje Once again, Gantt-charts by R vector file 12/ 25
26 Space/Time views limitations Evince 12/ 25
27 Space/Time views limitations Acroread 12/ 25
28 So, why data aggregation? Technical need: too much data to fit on small screens 13/ 25
29 So, why data aggregation? Technical need: too much data to fit on small screens Data aggregation key for large-scale visualization 13/ 25
30 So, why data aggregation? Technical need: too much data to fit on small screens Data aggregation key for large-scale visualization Semantic: aggregated data more representative 13/ 25
31 So, why data aggregation? Technical need: too much data to fit on small screens Data aggregation key for large-scale visualization Semantic: aggregated data more representative Goals Visualization techniques for aggregated data 13/ 25
32 So, why data aggregation? Technical need: too much data to fit on small screens Data aggregation key for large-scale visualization Semantic: aggregated data more representative Goals Visualization techniques for aggregated data Analyst has full control of aggregation 13/ 25
33 Visualization Techniques 14/ 25
34 Visualization techniques Squarified Treemap View Observe outliers, differences of behavior Hierarchical aggregation B Hierarchy: Site (10) - Cluster(10) - Machine (10) - Processor (100) C Hierarchy: Site (10) - Cluster(10) - Machine (10) - Processor (100) D Hierarchy: Site (10) - Cluster(10) - Machine (10) - Processor (100) E Maximum Aggregation 15/ 25
35 Visualization techniques Squarified Treemap View Observe outliers, differences of behavior Hierarchical aggregation B Hierarchy: Site (10) - Cluster(10) - Machine (10) - Processor (100) C Hierarchy: Site (10) - Cluster(10) - Machine (10) - Processor (100) D Hierarchy: Site (10) - Cluster(10) - Machine (10) - Processor (100) E Maximum Aggregation Hierarchical Graph View Pin-point resource contention Correlate application behavior to network topology time slice time slice 15/ 25
36 Squarified Treemap View Scalable representation for hierarchies when compared to node-link diagrams better visualization scalability for large trees 16/ 25
37 Squarified Treemap View Scalable representation for hierarchies when compared to node-link diagrams better visualization scalability for large trees Space-filling top-down recursive layout algorithm Node value space occupied in the screen Squarified version keeps rectangles ratio close to 1 T=6 M=3 N=2 O=1 A=1 B=1 C=1 D=1 E=1 F=1 16/ 25
38 Squarified Treemap View Scalable representation for hierarchies when compared to node-link diagrams better visualization scalability for large trees Space-filling top-down recursive layout algorithm Node value space occupied in the screen Squarified version keeps rectangles ratio close to 1 T=6 M=3 N=2 O=1 T=6 A=1 B=1 C=1 D=1 E=1 F=1 16/ 25
39 Squarified Treemap View Scalable representation for hierarchies when compared to node-link diagrams better visualization scalability for large trees Space-filling top-down recursive layout algorithm Node value space occupied in the screen Squarified version keeps rectangles ratio close to 1 T=6 M=3 N=2 O=1 A=1 B=1 C=1 D=1 E=1 F=1 T=6 M=3 N=2 O=1 16/ 25
40 Squarified Treemap View Scalable representation for hierarchies when compared to node-link diagrams better visualization scalability for large trees Space-filling top-down recursive layout algorithm Node value space occupied in the screen Squarified version keeps rectangles ratio close to 1 T=6 M=3 N=2 O=1 T=6 M=3 N=2 A=1 B=1 D=1 E=1 A=1 B=1 C=1 D=1 E=1 F=1 O=1 C=1 F=1 16/ 25
41 Squarified Treemap View an example Synthetic trace with 100 thousand processes Two states, four-level hierarchy Visualization artifacts without spatial aggregation A Hierarchy: Site (10) - Cluster(10) - Machine (10) - Processor (100) 17/ 25
42 Squarified Treemap View an example Synthetic trace with 100 thousand processes Two states, four-level hierarchy Visualization artifacts without spatial aggregation B Hierarchy: Site (10) - Cluster(10) - Machine (10) - Processor (100) 17/ 25
43 Squarified Treemap View an example Synthetic trace with 100 thousand processes Two states, four-level hierarchy Visualization artifacts without spatial aggregation C Hierarchy: Site (10) - Cluster(10) - Machine (10) - Processor (100) 17/ 25
44 Squarified Treemap View an example Synthetic trace with 100 thousand processes Two states, four-level hierarchy Visualization artifacts without spatial aggregation D Hierarchy: Site (10) - Cluster(10) - Machine (10) - Processor (100) 17/ 25
45 Squarified Treemap View an example Synthetic trace with 100 thousand processes Two states, four-level hierarchy Visualization artifacts without spatial aggregation E Maximum Aggregation 17/ 25
46 Hierarchical Graph View Scalable representation for graphs Topology, with application-level metrics Identify resource bottleneck in space and time Use spatial-temporal aggregated traces Interactive force-directed layout (Barnes-Hut algorithm) 18/ 25
47 Hierarchical Graph View Scalable representation for graphs Topology, with application-level metrics Identify resource bottleneck in space and time Use spatial-temporal aggregated traces Interactive force-directed layout (Barnes-Hut algorithm) Trace metrics geometrical properties Size, shape, filling, colors Nodes: monitored entities Edges: relationship among entities time slice hosta link utilization link hostb 18/ 25
48 Hierarchical Graph View Scalable representation for graphs Topology, with application-level metrics Identify resource bottleneck in space and time Use spatial-temporal aggregated traces Interactive force-directed layout (Barnes-Hut algorithm) Trace metrics geometrical properties Size, shape, filling, colors Nodes: monitored entities Edges: relationship among entities time slice hosta link utilization link hostb 18/ 25
49 Hierarchical Graph View - an example Squares are hosts, diamonds are network links Colors represent different applications or parts of it (task type, phase) Two clusters interconnected by four network links Cluster backbones have larger bandwidth capacity Each host connected to the backbone by a private link time slice 19/ 25
50 Tools and Framework 20/ 25
51 Open-source tools PajeNG Next Generation (Space/Time views), GPL3 Only pj_dump and pj_validate (partial pajeng) Link against libpaje.so then use Paje protocol 21/ 25
52 Open-source tools PajeNG Next Generation (Space/Time views), GPL3 Only pj_dump and pj_validate (partial pajeng) Link against libpaje.so then use Paje protocol Data Liberation Front $./pj_dump input.paje > output.csv Then use your preferred visualization tool (gnuplot, R, GNU Octave,...) 21/ 25
53 Open-source tools PajeNG Next Generation (Space/Time views), GPL3 Only pj_dump and pj_validate (partial pajeng) Link against libpaje.so then use Paje protocol Data Liberation Front $./pj_dump input.paje > output.csv Then use your preferred visualization tool (gnuplot, R, GNU Octave,...) Viva (Aggregated Treemaps, Hierarchical graph), GPL3 Partial graph visualization for now (soon) Deprecates Triva, serves as research framework 21/ 25
54 Open-source tools PajeNG Next Generation (Space/Time views), GPL3 Only pj_dump and pj_validate (partial pajeng) Link against libpaje.so then use Paje protocol Data Liberation Front $./pj_dump input.paje > output.csv Then use your preferred visualization tool (gnuplot, R, GNU Octave,...) Viva (Aggregated Treemaps, Hierarchical graph), GPL3 Partial graph visualization for now (soon) Deprecates Triva, serves as research framework Some tracers and converters: SimGrid, Akypuera (tau2paje, otf2paje, otf22paje), Poti, XKaapi, EZTrace, rastro2paje, librastro, GTG, JRastro and counting... 21/ 25
55 Collaborations within LICIA 22/ 25
56 Collaborations Arnaud Legrand (LIG-Mescal) ANR Infra-SONGS Project Scalable trace analysis Trace comparison 23/ 25
57 Collaborations Arnaud Legrand (LIG-Mescal) ANR Infra-SONGS Project Scalable trace analysis Trace comparison Jean-Marc Vincent (LIG-Mescal) Evaluating data aggregation with entropy Very promising initial results already integrated with treemap 23/ 25
58 Collaborations Arnaud Legrand (LIG-Mescal) ANR Infra-SONGS Project Scalable trace analysis Trace comparison Jean-Marc Vincent (LIG-Mescal) Evaluating data aggregation with entropy Very promising initial results already integrated with treemap Guillaume Huard (LIG-Moais) SoC-Trace Project Evaluating data aggregation Using embedded applications as scenario 23/ 25
59 Collaborations Arnaud Legrand (LIG-Mescal) ANR Infra-SONGS Project Scalable trace analysis Trace comparison Jean-Marc Vincent (LIG-Mescal) Evaluating data aggregation with entropy Very promising initial results already integrated with treemap Guillaume Huard (LIG-Moais) SoC-Trace Project Evaluating data aggregation Using embedded applications as scenario Nicolas Maillard, Philippe Navaux (INF-UFRGS) expected New scenarios: parallel file systems, Java/ProActive, Many-core applications Joao Comba (INF-UFRGS) expected Propose novel information visualization techniques 23/ 25
60 Collaborations Arnaud Legrand (LIG-Mescal) ANR Infra-SONGS Project Scalable trace analysis Trace comparison Jean-Marc Vincent (LIG-Mescal) Evaluating data aggregation with entropy Very promising initial results already integrated with treemap Guillaume Huard (LIG-Moais) SoC-Trace Project Evaluating data aggregation Using embedded applications as scenario Nicolas Maillard, Philippe Navaux (INF-UFRGS) expected New scenarios: parallel file systems, Java/ProActive, Many-core applications Joao Comba (INF-UFRGS) expected Propose novel information visualization techniques Open to new collaborations 23/ 25
61 Conclusion and Future Work Data aggregation Key to scale data visualization for analysis No pre-defined or fixed parameters 24/ 25
62 Conclusion and Future Work Data aggregation Key to scale data visualization for analysis No pre-defined or fixed parameters Visualization techniques Based upon aggregated data Complementary to existing techniques Continuous evaluation of visualization scalability With larger data-sets, does it remain useful? 24/ 25
63 Conclusion and Future Work Data aggregation Key to scale data visualization for analysis No pre-defined or fixed parameters Visualization techniques Based upon aggregated data Complementary to existing techniques Continuous evaluation of visualization scalability With larger data-sets, does it remain useful? Future Work Scalable trace comparison Can we visualy compare two traces on scale? Revisit Gantt-charts Can we keep causal order analysis with aggregated data? Data aggregation and other visualization techniques 24/ 25
64 Thank you for your attention Some references VIVA Visualizing more performance data than what fits on your screen. Lucas Mello Schnorr, Arnaud Legrand. The 6th International Parallel Tools Workshop. Springer (Invited paper) Detection and Analysis of Resource Usage Anomalies in Large Distributed Systems Through Multi-scale Visualization. Lucas Mello Schnorr, Arnaud Legrand, Jean-Marc Vincent. Concurrency and Computation: Practice and Experience. Wiley A Hierarchical Aggregation Model to achieve Visualization Scalability in the analysis of Parallel Applications. Lucas Mello Schnorr, Guillaume Huard, Philippe Olivier Alexandre Navaux. Parallel Computing. Volume 38, Issue 3, March 2012, Pages More information INFRA-SONGS Project (WP-7) Simulation of Next Generation Systems WP-7: Visualization and Analysis 25/ 25
Interactive Analysis of Large Distributed Systems with Scalable Topology-based Visualization
Interactive Analysis of Large Distributed Systems with Scalable Topology-based Visualization Lucas M. Schnorr, Arnaud Legrand, and Jean-Marc Vincent e-mail : Firstname.Lastname@imag.fr Laboratoire d Informatique
More informationVisual Mapping of Program Components to Resources Representation: a 3D Analysis of Grid Parallel Applications
Visual Mapping of Program Components to Resources Representation: a 3D Analysis of Grid Parallel Applications Lucas Mello Schnorr, Guillaume Huard, Philippe Olivier Alexandre Navaux Federal University
More informationLarge-Scale Trace Visualization Analysis with Triva and Pajé the G5K case study
1 / 12 Large-Scale Trace Visualization Analysis with Triva and Pajé the G5K case study Lucas M. Schnorr, Arnaud Legrand Grid 5000 Spring School Reims, France 20 April 2011 2 / 12 Introduction Basic Concepts
More informationSome Visualization Models applied to the Analysis of Parallel Applications
1 / 1 Some Visualization Models applied to the Analysis of Parallel Applications Lucas Mello Schnorr Advisors: Philippe O. A. Navaux & Denis Trystram & Guillaume Huard Federal University of Rio Grande
More informationInteractive Analysis of Large Distributed Systems with Topology-based Visualization
Interactive Analysis of Large Distributed Systems with Topology-based Visualization Lucas Mello Schnorr, Arnaud Legrand, Jean-Marc Vincent To cite this version: Lucas Mello Schnorr, Arnaud Legrand, Jean-Marc
More informationTowards Visualization Scalability through Time Intervals and Hierarchical Organization of Monitoring Data
Towards Visualization Scalability through Time Intervals and Hierarchical Organization of Monitoring Data Lucas Mello Schnorr, Guillaume Huard, Philippe Olivier Alexandre Navaux Instituto de Informática
More informationTriva: Interactive 3D Visualization for Performance Analysis of Parallel Applications
paper text Click here to view linked References Triva: Interactive 3D Visualization for Performance Analysis of Parallel Applications Lucas Mello Schnorr,a,b, Guillaume Huard b, Philippe O. A. Navaux a
More informationTriva: Interactive 3D Visualization for Performance Analysis of Parallel Applications
Triva: Interactive 3D Visualization for Performance Analysis of Parallel Applications Lucas Mello Schnorr,a,b, Guillaume Huard b, Philippe O. A. Navaux a a Instituto de Informática, Federal University
More informationOcelotl: Large Trace Overviews Based on Multidimensional Data Aggregation
Ocelotl: Large Trace Overviews Based on Multidimensional Data Aggregation Damien Dosimont, Youenn Corre, Lucas Mello Schnorr, Guillaume Huard, Jean-Marc Vincent To cite this version: Damien Dosimont, Youenn
More informationVisualization Techniques for Grid Environments: a Survey and Discussion
Visualization Techniques for Grid Environments: a Survey and Discussion Lucas Mello Schnorr, Philippe Olivier Alexandre Navaux Instituto de Informática Universidade Federal do Rio Grande do Sul CEP 91501-970
More informationPerformance Evaluation
A not so Short Introduction Why, Who, When and How? Jean-Marc Vincent 12 1 Laboratoire LIG, projet Inria-Mescal UniversitéJoseph Fourier Jean-Marc.Vincent@imag.fr 2 LICIA Laboratoire International de Calcul
More informationLaboratoire International de Calcul Intensif et d Informatique Ambiante, Laboratório Internacional em Computação Intensiva e Informática Ambiente
Laboratoire International de Calcul Intensif et d Informatique Ambiante Laboratório Internacional em Computação Intensiva e Informática Ambiente International Laboratory in HPC and Ambiant Computing Jean-Marc.Vincent@imag.fr
More informationEZTrace upcoming features
EZTrace 1.0 + upcoming features François Trahay francois.trahay@telecom-sudparis.eu 2015-01-08 Context Hardware is more and more complex NUMA, hierarchical caches, GPU,... Software is more and more complex
More informationVisualization and clusters: collaboration and integration issues. Philip NERI Integrated Solutions Director
Visualization and clusters: collaboration and integration issues Philip NERI Integrated Solutions Director Overview Introduction, Paradigm & Clusters The Geoscience task map Seismic Data Processing / specifics
More informationCycle Sharing Systems
Cycle Sharing Systems Jagadeesh Dyaberi Dependable Computing Systems Lab Purdue University 10/31/2005 1 Introduction Design of Program Security Communication Architecture Implementation Conclusion Outline
More informationPerformance Evaluation of Computer Systems
Jean-Marc Vincent and Bruno Gaujal 1 1 MESCAL Project Laboratory of Informatics of Grenoble (LIG) Universities of Grenoble {Jean-Marc.Vincent,Bruno.Gaujal}@imag.fr http://mescal.imag.fr/members.php Site
More informationA Visual Performance Analysis Framework for Task-based Parallel Applications running on Hybrid. Clusters
A Visual Performance Analysis Framework for Task-based Parallel Applications running on Hybrid Clusters Vinicius Garcia Pinto, Lucas Schnorr, Luka Stanisic, Arnaud Legrand, Samuel Thibault, Vincent Danjean
More informationBANDWIDTH MODELING IN LARGE DISTRIBUTED SYSTEMS FOR BIG DATA APPLICATIONS
BANDWIDTH MODELING IN LARGE DISTRIBUTED SYSTEMS FOR BIG DATA APPLICATIONS Bahman Javadi School of Computing, Engineering and Mathematics Western Sydney University, Australia 1 Boyu Zhang and Michela Taufer
More informationRevealing Applications Access Pattern in Collective I/O for Cache Management
Revealing Applications Access Pattern in for Yin Lu 1, Yong Chen 1, Rob Latham 2 and Yu Zhuang 1 Presented by Philip Roth 3 1 Department of Computer Science Texas Tech University 2 Mathematics and Computer
More information8. Visual Analytics. Prof. Tulasi Prasad Sariki SCSE, VIT, Chennai
8. Visual Analytics Prof. Tulasi Prasad Sariki SCSE, VIT, Chennai www.learnersdesk.weebly.com Graphs & Trees Graph Vertex/node with one or more edges connecting it to another node. Cyclic or acyclic Edge
More informationGlyphs. Presentation Overview. What is a Glyph!? Cont. What is a Glyph!? Glyph Fundamentals. Goal of Paper. Presented by Bertrand Low
Presentation Overview Glyphs Presented by Bertrand Low A Taxonomy of Glyph Placement Strategies for Multidimensional Data Visualization Matthew O. Ward, Information Visualization Journal, Palmgrave,, Volume
More informationVisualizing large scale IP traffic flows
Networks and Distributed Systems Visualizing large scale IP traffic flows Authors: Florian Mansmann, University of Konstanz Fabian Fischer, University of Konstanz Daniel A, Keim, University of Konstanz
More informationAn open source tool chain for performance analysis
An open source tool chain for performance analysis Kevin Coulomb, Augustin Degomme, Mathieu Faverge, François Trahay To cite this version: Kevin Coulomb, Augustin Degomme, Mathieu Faverge, François Trahay.
More informationQuadstream. Algorithms for Multi-scale Polygon Generalization. Curran Kelleher December 5, 2012
Quadstream Algorithms for Multi-scale Polygon Generalization Introduction Curran Kelleher December 5, 2012 The goal of this project is to enable the implementation of highly interactive choropleth maps
More informationDeferred Splatting. Gaël GUENNEBAUD Loïc BARTHE Mathias PAULIN IRIT UPS CNRS TOULOUSE FRANCE.
Deferred Splatting Gaël GUENNEBAUD Loïc BARTHE Mathias PAULIN IRIT UPS CNRS TOULOUSE FRANCE http://www.irit.fr/~gael.guennebaud Plan Complex Scenes: Triangles or Points? High Quality Splatting: Really
More informationKAAPI : Adaptive Runtime System for Parallel Computing
KAAPI : Adaptive Runtime System for Parallel Computing Thierry Gautier, thierry.gautier@inrialpes.fr Bruno Raffin, bruno.raffin@inrialpes.fr, INRIA Grenoble Rhône-Alpes Moais Project http://moais.imag.fr
More informationJobs Resource Utilization as a Metric for Clusters Comparison and Optimization. Slurm User Group Meeting 9-10 October, 2012
Jobs Resource Utilization as a Metric for Clusters Comparison and Optimization Joseph Emeras Cristian Ruiz Jean-Marc Vincent Olivier Richard Slurm User Group Meeting 9-10 October, 2012 INRIA - MESCAL Jobs
More informationOut-Of-Core Sort-First Parallel Rendering for Cluster-Based Tiled Displays
Out-Of-Core Sort-First Parallel Rendering for Cluster-Based Tiled Displays Wagner T. Corrêa James T. Klosowski Cláudio T. Silva Princeton/AT&T IBM OHSU/AT&T EG PGV, Germany September 10, 2002 Goals Render
More informationFunctional Requirements for Grid Oriented Optical Networks
Functional Requirements for Grid Oriented Optical s Luca Valcarenghi Internal Workshop 4 on Photonic s and Technologies Scuola Superiore Sant Anna Pisa June 3-4, 2003 1 Motivations Grid networking connection
More informationChapter 1, Introduction
CSI 4352, Introduction to Data Mining Chapter 1, Introduction Young-Rae Cho Associate Professor Department of Computer Science Baylor University What is Data Mining? Definition Knowledge Discovery from
More informationVAMPIR & VAMPIRTRACE INTRODUCTION AND OVERVIEW
VAMPIR & VAMPIRTRACE INTRODUCTION AND OVERVIEW 8th VI-HPS Tuning Workshop at RWTH Aachen September, 2011 Tobias Hilbrich and Joachim Protze Slides by: Andreas Knüpfer, Jens Doleschal, ZIH, Technische Universität
More informationScientific Visualization
Scientific Visualization Topics Motivation Color InfoVis vs. SciVis VisTrails Core Techniques Advanced Techniques 1 Check Assumptions: Why Visualize? Problem: How do you apprehend 100k tuples? when your
More informationThe Collaborative Workspace
The Collaborative Workspace Introduction... 2 Available modules... 3 User, Administrator, Guest... 6 Space and subspaces... 6 Access Rights : generality... 7 Access Rights of Containers... 8 Update and
More information3. Multidimensional Information Visualization II Concepts for visualizing univariate to hypervariate data
3. Multidimensional Information Visualization II Concepts for visualizing univariate to hypervariate data Vorlesung Informationsvisualisierung Prof. Dr. Andreas Butz, WS 2009/10 Konzept und Basis für n:
More informationViscous Fingers: A topological Visual Analytic Approach
Viscous Fingers: A topological Visual Analytic Approach Jonas Lukasczyk University of Kaiserslautern Germany Bernd Hamann University of California Davis, U.S.A. Garrett Aldrich Univeristy of California
More informationEdge Equalized Treemaps
Edge Equalized Treemaps Aimi Kobayashi Department of Computer Science University of Tsukuba Ibaraki, Japan kobayashi@iplab.cs.tsukuba.ac.jp Kazuo Misue Faculty of Engineering, Information and Systems University
More informationDISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S. TANENBAUM MAARTEN VAN STEEN. Chapter 1. Introduction
DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S. TANENBAUM MAARTEN VAN STEEN Chapter 1 Introduction Definition of a Distributed System (1) A distributed system is: A collection of
More informationData Visualization. Fall 2016
Data Visualization Fall 2016 Information Visualization Upon now, we dealt with scientific visualization (scivis) Scivisincludes visualization of physical simulations, engineering, medical imaging, Earth
More informationChapter 1. Introduction
Introduction 1 Chapter 1. Introduction We live in a three-dimensional world. Inevitably, any application that analyzes or visualizes this world relies on three-dimensional data. Inherent characteristics
More informationMulti-domain Internet Performance Sampling and Analysis Tools
Multi-domain Internet Performance Sampling and Analysis Tools Prasad Calyam, Ph.D., pcalyam@osc.edu Student Research Assistants: Jialu Pu, Lakshmi Kumarasamy ESCC/Internet2 Joint Techs, July 2010 Project
More informationFROM PEER TO PEER...
FROM PEER TO PEER... Dipartimento di Informatica, Università degli Studi di Pisa HPC LAB, ISTI CNR Pisa in collaboration with: Alessandro Lulli, Emanuele Carlini, Massimo Coppola, Patrizio Dazzi 2 nd HPC
More informationCentralized versus distributed schedulers for multiple bag-of-task applications
Centralized versus distributed schedulers for multiple bag-of-task applications O. Beaumont, L. Carter, J. Ferrante, A. Legrand, L. Marchal and Y. Robert Laboratoire LaBRI, CNRS Bordeaux, France Dept.
More informationAn Overview of Every Mobile Widget From Analytics and Transactions to Geolocation and Multimedia
An Overview of Every Mobile Widget From Analytics and Transactions to Geolocation and Multimedia Andrea Schiller #mstrworld Agenda Introduction Basic Visualizations (Graphs) Advanced Visualizations (Widgets)
More informationHigh Availability Distributed (Micro-)services. Clemens Vasters Microsoft
High Availability Distributed (Micro-)services Clemens Vasters Microsoft Azure @clemensv ice Microsoft Azure services I work(-ed) on. Notification Hubs Service Bus Event Hubs Event Grid IoT Hub Relay Mobile
More informationProviding Automated Detection of Problems in Virtualized Servers using Monitor framework
Providing Automated Detection of Problems in Virtualized Servers using framework Gunjan Khanna, Saurabh Bagchi (Purdue University) Kirk Beaty, Andrzej Kochut, Norman Bobroff and Gautam Kar (IBM T. J. Watson
More informationGoal. Interactive Walkthroughs using Multiple GPUs. Boeing 777. DoubleEagle Tanker Model
Goal Interactive Walkthroughs using Multiple GPUs Dinesh Manocha University of North Carolina- Chapel Hill http://www.cs.unc.edu/~walk SIGGRAPH COURSE #11, 2003 Interactive Walkthrough of complex 3D environments
More informationLecture 9: MIMD Architecture
Lecture 9: MIMD Architecture Introduction and classification Symmetric multiprocessors NUMA architecture Cluster machines Zebo Peng, IDA, LiTH 1 Introduction MIMD: a set of general purpose processors is
More informationCSE 124: THE DATACENTER AS A COMPUTER. George Porter November 20 and 22, 2017
CSE 124: THE DATACENTER AS A COMPUTER George Porter November 20 and 22, 2017 ATTRIBUTION These slides are released under an Attribution-NonCommercial-ShareAlike 3.0 Unported (CC BY-NC-SA 3.0) Creative
More informationECE7995 (3) Basis of Caching and Prefetching --- Locality
ECE7995 (3) Basis of Caching and Prefetching --- Locality 1 What s locality? Temporal locality is a property inherent to programs and independent of their execution environment. Temporal locality: the
More informationHigh Performance Computing Course Notes HPC Fundamentals
High Performance Computing Course Notes 2008-2009 2009 HPC Fundamentals Introduction What is High Performance Computing (HPC)? Difficult to define - it s a moving target. Later 1980s, a supercomputer performs
More information3DNSITE: A networked interactive 3D visualization system to simplify location awareness in crisis management
www.crs4.it/vic/ 3DNSITE: A networked interactive 3D visualization system to simplify location awareness in crisis management Giovanni Pintore 1, Enrico Gobbetti 1, Fabio Ganovelli 2 and Paolo Brivio 2
More informationProtocol Based on Mobile Agents
Bluecouts: A catternet Formation Bluecouts: A catternet Formation ergio González-Valenzuela 1 on T. Vuong 2 Victor C. M. Leung 1 1 Department of Electrical and Computer Engineering 2 Department of Computer
More informationOracle Data Modelling & Database Design Course Content:35-40hours
Oracle Data Modelling & Database Design Course Content:35-40hours Course Outline Introduction to Modeling List the reasons why modeling is important Describe the phases of the Database and Application
More informationREMEM: REmote MEMory as Checkpointing Storage
REMEM: REmote MEMory as Checkpointing Storage Hui Jin Illinois Institute of Technology Xian-He Sun Illinois Institute of Technology Yong Chen Oak Ridge National Laboratory Tao Ke Illinois Institute of
More informationECE 669 Parallel Computer Architecture
ECE 669 Parallel Computer Architecture Lecture 9 Workload Evaluation Outline Evaluation of applications is important Simulation of sample data sets provides important information Working sets indicate
More informationChapter 1: Introduction 1/29
Chapter 1: Introduction 1/29 What is a Distributed System? A distributed system is a collection of independent computers that appears to its users as a single coherent system. 2/29 Characteristics of a
More informationAdaptability and Dynamicity in Parallel Programming The MPI case
Adaptability and Dynamicity in Parallel Programming The MPI case Nicolas Maillard Instituto de Informática UFRGS 21 de Outubro de 2008 http://www.inf.ufrgs.br/~nicolas The Institute of Informatics, UFRGS
More informationWhy Multiprocessors?
Why Multiprocessors? Motivation: Go beyond the performance offered by a single processor Without requiring specialized processors Without the complexity of too much multiple issue Opportunity: Software
More informationPerformance Analysis with Vampir
Performance Analysis with Vampir Johannes Ziegenbalg Technische Universität Dresden Outline Part I: Welcome to the Vampir Tool Suite Event Trace Visualization The Vampir Displays Vampir & VampirServer
More informationIntroduction to Distributed Systems. INF5040/9040 Autumn 2018 Lecturer: Eli Gjørven (ifi/uio)
Introduction to Distributed Systems INF5040/9040 Autumn 2018 Lecturer: Eli Gjørven (ifi/uio) August 28, 2018 Outline Definition of a distributed system Goals of a distributed system Implications of distributed
More informationFPGA based Network Traffic Analysis using Traffic Dispersion Graphs
FPGA based Network Traffic Analysis using Traffic Dispersion Graphs 2 nd September, 2010 Faisal N. Khan, P. O. Box 808, Livermore, CA 94551 This work performed under the auspices of the U.S. Department
More informationHigh Performance Computing Course Notes Course Administration
High Performance Computing Course Notes 2009-2010 2010 Course Administration Contacts details Dr. Ligang He Home page: http://www.dcs.warwick.ac.uk/~liganghe Email: liganghe@dcs.warwick.ac.uk Office hours:
More informationFigure 1: Workflow of object-based classification
Technical Specifications Object Analyst Object Analyst is an add-on package for Geomatica that provides tools for segmentation, classification, and feature extraction. Object Analyst includes an all-in-one
More informationScore-P. SC 14: Hands-on Practical Hybrid Parallel Application Performance Engineering 1
Score-P SC 14: Hands-on Practical Hybrid Parallel Application Performance Engineering 1 Score-P Functionality Score-P is a joint instrumentation and measurement system for a number of PA tools. Provide
More informationOAR batch scheduler and scheduling on Grid'5000
http://oar.imag.fr OAR batch scheduler and scheduling on Grid'5000 Olivier Richard (UJF/INRIA) joint work with Nicolas Capit, Georges Da Costa, Yiannis Georgiou, Guillaume Huard, Cyrille Martin, Gregory
More informationELASTIC: Dynamic Tuning for Large-Scale Parallel Applications
Workshop on Extreme-Scale Programming Tools 18th November 2013 Supercomputing 2013 ELASTIC: Dynamic Tuning for Large-Scale Parallel Applications Toni Espinosa Andrea Martínez, Anna Sikora, Eduardo César
More informationH5FED HDF5 Based Finite Element Data Storage
H5FED HDF5 Based Finite Element Data Storage Novel, Open Source, Unrestricted Usability Benedikt Oswald (GFA, PSI) and Achim Gsell (AIT, PSI) s From: B. Oswald, P. Leidenberger. Electromagnetic fields
More informationNextData System of Systems Infrastructure (ND-SoS-Ina)
NextData System of Systems Infrastructure (ND-SoS-Ina) DELIVERABLE D2.3 (CINECA, CNR-IIA) - Web Portal Architecture DELIVERABLE D4.1 (CINECA, CNR-IIA) - Test Infrastructure Document identifier: D2.3 D4.1
More informationVDBench: A Benchmarking Toolkit for Thinclient based Virtual Desktop Environments
VDBench: A Benchmarking Toolkit for Thinclient based Virtual Desktop Environments Alex Berryman, berryman@oar.net In collaboration with: Dr. Prasad Calyam (OSC/OARnet), Prof. Albert Lai (OSUMC), Matt Honigford
More informationLecture 6. Abstract Interpretation
Lecture 6. Abstract Interpretation Wei Le 2014.10 Outline Motivation History What it is: an intuitive understanding An example Steps of abstract interpretation Galois connection Narrowing and Widening
More informationFODAVA Partners Leland Wilkinson (SYSTAT & UIC) Robert Grossman (UIC) Adilson Motter (Northwestern) Anushka Anand, Troy Hernandez (UIC)
FODAVA Partners Leland Wilkinson (SYSTAT & UIC) Robert Grossman (UIC) Adilson Motter (Northwestern) Anushka Anand, Troy Hernandez (UIC) Visually-Motivated Characterizations of Point Sets Embedded in High-Dimensional
More informationINTRUSION DETECTION AND CORRELATION. Challenges and Solutions
INTRUSION DETECTION AND CORRELATION Challenges and Solutions Advances in Information Security Sushil Jajodia Consulting editor Center for Secure Information Systems George Mason University Fairfax, VA
More informationIAT 355 Intro to Visual Analytics Graphs, trees and networks 2. Lyn Bartram
IAT 355 Intro to Visual Analytics Graphs, trees and networks 2 Lyn Bartram Graphs and Trees: Connected Data Graph Vertex/node with one or more edges connecting it to another node Cyclic or acyclic Edge
More informationCharacterizing Result Errors in Internet Desktop Grids
Characterizing Result Errors in Internet Desktop Grids D. Kondo 1, F. Araujo 2, P. Malecot 1, P. Domingues 2, L. Silva 2, G. Fedak 1, F. Cappello 1 1 INRIA, France 2 University of Coimbra, Portugal Desktop
More informationActionable User Intentions for Real-Time Mobile Assistant Applications
Actionable User Intentions for Real-Time Mobile Assistant Applications Thimios Panagos, Shoshana Loeb, Ben Falchuk Applied Research, Telcordia Technologies One Telcordia Drive, Piscataway, New Jersey,
More informationLoad Balancing for Parallel Multi-core Machines with Non-Uniform Communication Costs
Load Balancing for Parallel Multi-core Machines with Non-Uniform Communication Costs Laércio Lima Pilla llpilla@inf.ufrgs.br LIG Laboratory INRIA Grenoble University Grenoble, France Institute of Informatics
More informationSecond Conference on Parallel, Distributed, Grid and Cloud Computing for Engineering
State of the art distributed parallel computational techniques in industrial finite element analysis Second Conference on Parallel, Distributed, Grid and Cloud Computing for Engineering Ajaccio, France
More informationBasic Idea. The routing problem is typically solved using a twostep
Global Routing Basic Idea The routing problem is typically solved using a twostep approach: Global Routing Define the routing regions. Generate a tentative route for each net. Each net is assigned to a
More informationConnectivity Services, Autobahn and New Services
Connectivity Services, Autobahn and New Services Domenico Vicinanza, DANTE EGEE 09, Barcelona, 21 st -25 th September 2009 Agenda Background GÉANT Connectivity services: GÉANT IP GÉANT Plus GÉANT Lambda
More informationOracle Primavera P6 Enterprise Project Portfolio Management Performance and Sizing Guide. An Oracle White Paper December 2011
Oracle Primavera P6 Enterprise Project Portfolio Management Performance and Sizing Guide An Oracle White Paper December 2011 Disclaimer The following is intended to outline our general product direction.
More informationWeek 6: Networks, Stories, Vis in the Newsroom
Week 6: Networks, Stories, Vis in the Newsroom Tamara Munzner Department of Computer Science University of British Columbia JRNL 520H, Special Topics in Contemporary Journalism: Data Visualization Week
More informationScalable Selective Traffic Congestion Notification
Scalable Selective Traffic Congestion Notification Győző Gidófalvi Division of Geoinformatics Deptartment of Urban Planning and Environment KTH Royal Institution of Technology, Sweden gyozo@kth.se Outline
More informationHPC and Inria
HPC and Clouds @ Inria F. Desprez Frederic.Desprez@inria.fr! Jun. 12, 2013 INRIA strategy in HPC/Clouds INRIA is among the HPC leaders in Europe Long history of researches around distributed systems, HPC,
More informationNetworks & protocols research in Grid5000 DAS3
1 Grid 5000 Networks & protocols research in Grid5000 DAS3 Date Pascale Vicat-Blanc Primet Senior Researcher at INRIA Leader of the RESO team LIP Laboratory UMR CNRS-INRIA-ENS-UCBL Ecole Normale Supérieure
More informationThere are two ways to establish VCs:
Virtual Circuits 1 Virtual Circuits The connection through a Frame Relay network between two DTEs is called a virtual circuit (VC). The circuits are virtual because there is no direct electrical connection
More informationThe Distributed Computing Model Based on The Capabilities of The Internet
The Distributed Computing Model Based on The Capabilities of The Internet Lukasz Swierczewski Computer Science and Automation Institute College of Computer Science and Business Administration in Łomża
More informationAdvanced Concepts for Large Data Visualization. SNU, February 28, 2012
Advanced Concepts for Large Data Visualization SNU, February 28, 2012 Research Interests Scientific Visualization Information Visualization Visual Analytics High Performance Computing User Interface Design
More informationVisual Analysis of Set Relations in a Graph
Visual Analysis of Set Relations in a Graph Panpan Xu 1, Fan Du 2, Nan Cao 3, Conglei Shi 1, Hong Zhou 4, Huamin Qu 1 1 Hong Kong University of Science and Technology, 2 Zhejiang University, 3 IBM T. J.
More information1. Interpreting the Results: Visualization 1
1. Interpreting the Results: Visualization 1 visual/graphical/optical representation of large sets of data: data from experiments or measurements: satellite images, tomography in medicine, microsopy,...
More informationFloVis: Leveraging Visualization to Protect Sensitive Network Infrastructure
FloVis: Leveraging Visualization to Protect Sensitive Network Infrastructure J. Glanfield, D. Paterson, C. Smith, T. Taylor, S. Brooks, C. Gates, and J. McHugh Dalhousie University, Halifax, NS, Canada;
More informationTrafficDB: HERE s High Performance Shared-Memory Data Store Ricardo Fernandes, Piotr Zaczkowski, Bernd Göttler, Conor Ettinoffe, and Anis Moussa
TrafficDB: HERE s High Performance Shared-Memory Data Store Ricardo Fernandes, Piotr Zaczkowski, Bernd Göttler, Conor Ettinoffe, and Anis Moussa EPL646: Advanced Topics in Databases Christos Hadjistyllis
More informationData storage services at KEK/CRC -- status and plan
Data storage services at KEK/CRC -- status and plan KEK/CRC Hiroyuki Matsunaga Most of the slides are prepared by Koichi Murakami and Go Iwai KEKCC System Overview KEKCC (Central Computing System) The
More informationNon-Uniform Memory Access (NUMA) Architecture and Multicomputers
Non-Uniform Memory Access (NUMA) Architecture and Multicomputers Parallel and Distributed Computing Department of Computer Science and Engineering (DEI) Instituto Superior Técnico September 26, 2011 CPD
More informationService-Centric Networking for the Developing World
GAIA workshop Service-Centric Networking for the Developing World Arjuna Sathiaseelan, Liang Wang, Andrius Aucinas, Gareth Tyson*, Jon Crowcroft N4D Lab liang.wang@cl.cam.ac.uk Cambridge University, UK
More informationEfficient Orienteering-Route Search over Uncertain Spatial Datasets
Efficient Orienteering-Route Search over Uncertain Spatial Datasets Mr. Nir DOLEV, Israel Dr. Yaron KANZA, Israel Prof. Yerach DOYTSHER, Israel 1 Route Search A standard search engine on the WWW returns
More informationSCALING A DISTRIBUTED SPATIAL CACHE OVERLAY. Alexander Gessler Simon Hanna Ashley Marie Smith
SCALING A DISTRIBUTED SPATIAL CACHE OVERLAY Alexander Gessler Simon Hanna Ashley Marie Smith MOTIVATION Location-based services utilize time and geographic behavior of user geotagging photos recommendations
More informationBuilding the Storage Internet. Dispersed Storage Overview March 2008
Building the Storage Internet Dispersed Storage Overview March 2008 Project Overview An Open Source Project with Commercial Backing Dispersed Storage an Open Source Project Hosted at www.cleversafe.org
More informationDesign methodology for multi processor systems design on regular platforms
Design methodology for multi processor systems design on regular platforms Ph.D in Electronics, Computer Science and Telecommunications Ph.D Student: Davide Rossi Ph.D Tutor: Prof. Roberto Guerrieri Outline
More informationAccelerating MPI Message Matching and Reduction Collectives For Multi-/Many-core Architectures
Accelerating MPI Message Matching and Reduction Collectives For Multi-/Many-core Architectures M. Bayatpour, S. Chakraborty, H. Subramoni, X. Lu, and D. K. Panda Department of Computer Science and Engineering
More informationPerformance measurements of computer systems: tools and analysis
Performance measurements of computer systems: tools and analysis M2R PDES Jean-Marc Vincent and Arnaud Legrand Laboratory LIG MESCAL Project Universities of Grenoble {Jean-Marc.Vincent,Arnaud.Legrand}@imag.fr
More information