Volumes with yt. Matthew Turk Columbia University

Size: px

Start display at page:

Download "Volumes with yt. Matthew Turk Columbia University"

Moris Ray
5 years ago
Views:

1 Volumes with yt Matthew Turk Columbia University

2 Exascale is made of people! - Mike Warren, 2014

3 Scientific Inquiry

4 Analyzing Data

5 Running Simulations

6 Run Study

7 10% 90%

8 10% 90% Dekel s Law

9 Data

10 yt Data

11 Dat yt

12 Dat yt-3.0

13 yt-3.0

14 yt-3.0 We got to break, then fix.

15 yt-3.0 SPH, octrees, units, field types,...

16 Dat yt-3.0

17 yt is not the point.

18 Dat Synthesis

19 The point! Dat Synthesis

20 How do we get there?

21 Clarity Abstraction Delegation

22 Develop a data language.

23 Develop a data language. Inspection, Analysis, & Visualization

24 Inspection, Analysis, & Visualization

25 import yt ds = yt.load("output_00084/info_00084.txt") sp = ds.sphere("max", (1.0, "Mpc")) print sp["density"] [ e-32,..., e-30] g/cm**3

26 import yt ds = yt.load("output_00084/info_00084.txt") sp = ds.sphere("max", (1.0, "Mpc")) sp.quantities.extrema("density") ( e-32 g/cm**3, e-24 g/cm**3)

27 Inspection, Analysis, & Visualization

28 Tasker et al 2013

29 Collins et al 2012

30 Smith et al 2013

31 Egan et al 2013

32 Egan et al 2013

33 Egan et al 2013

34 ZuHone et al

35 Inspection, Analysis, & Visualization

36 import yt ds = yt.load("snapshot_033/snap_033.0.hdf") p = yt.projectionplot(ds, "x", "density") p.save()

38 import yt ds = yt.load("galaxy0030/galaxy0030") ad = ds.all_data() p = yt.phaseplot(ad, "density", "temperature", "cell_mass", None) p.save()

40 import yt ds = yt.load("galaxy0030/galaxy0030") ad = ds.all_data() p = yt.phaseplot(ad, "density", "temperature", "cell_mass", None) p.set_unit("cell_mass", "Msun") p.save()

43 Separate responsibilities to preserve API stability.

44 yt

45 API IO, parallelism, indexing, processing, iteration, filtering,...

46 Abstract data sources and indexing.

48 Some Simulation

49 Some Simulation Selector

50 Selected

51 Da Selected

52 unk Selected C

54 Values Coordinates Extent

55 Values Coordinates Extent Components

56 Values Coordinates Extent Components Value Neighbors Block Neighbors

57 Values Coordinates Extent Components Value Neighbors Block Neighbors

58 High-Level Operations

59 High-Level Operations

60 High-Level Operations

61 High-Level Operations

62 High-Level Operations

63 High-Level Operations

64 High-Level Operations

65 High-Level Operations Process data.

66 Low-Level Operations

67 a Low-Level Operations

68 a Low-Level Operations

69 a Low-Level Operations

70 Low-Level Operations Internal yt

71 Low-Level Operations Patches Particles Octs

72 Low-Level Operations 2HOT

73 Low-Level Operations Cello

74 Low-Level Operations ARTIO

75 Low-Level Operations VTK

76 Low-Level Operations

77 Low-Level Operations

78 Low-Level Operations

79 Low-Level Operations Index data.

80 Software Infrastructure

81 Software Infrastructure Generic Specific

82 Software Infrastructure Generic Specific Math Solvers Algorithms IO Parallelism Analysis Visualization

83 Software Infrastructure Generic Specific Math Parallelism Algorithms Visualization Solvers IO Analysis

84 Software Infrastructure Generic Specific Math Parallelism Algorithms Visualization IO Solvers Analysis

85 Software Infrastructure Generic Specific Domain specificity is a transient phenomena for infrastructure.

86 Software Infrastructure Generic Specific Domain specificity is a lasting phenomena for implementations.

87 Not Invented Here

88 Not Invented Here (a space-filling effect)

93 Metcalfe s Law

94 Dat yt

95 Dat Rockstar yt

96 Dat ORIGAMI yt

97 Dat Sunrise yt

98 Dat Hyperion yt

99 Dat VisIt yt

100 Dat ParaView yt

101 Dat Theia yt

102 Warren s Law

103 Exascale is made of people! - Mike Warren, 2014

104 People

105 Image Credit: Erik Rosolowsky & ALMA

106 Holtzman et al

107 Neurodome and ITER SubbaRao, Fisher, Shriwise

108

109 Thank you.

110 Tom Abel Kenza Arraki David Collins Brian Crosby Andrew Cunningham Hilary Egan Nathan Goldbaum William Grey Markus Haider Cameron Hummels Christian Karch Steffen Klemer Kacper Kowalik Mike Kuhlen Eve Lee Sam Leitner Yuan Li Chris Malone Josh Moloney Chris Moody Andrew Myers Jill Naiman Kaylea Nelson Jeff Oishi Jean-Claude Passy Mark Richardson Thomas Robitaille Anna Rosen Doug Rudd Anthony Scopatz Devin Silvia Sam Skillman Stephen Skory Britton Smith Geoffrey So Casey Stark Elizabeth Tasker Stephanie Tonnesen Sebastian TrujilloGomez Matthew Turk Rick Wagner Andrew Wetzel John Wise John ZuHone

Analysis and Visualization with yt. Matthew Turk UIUC School of Information Sciences UIUC Astronomy

Analysis and Visualization with yt Matthew Turk UIUC School of Information Sciences UIUC Astronomy yt-project.org hub.yt Layers of Representation Bit Layers of Representation Data Bit Layers of Representation