TACC Overview and Pecan Street Involvement

Transcription

1 TACC Overview and Pecan Street Involvement Paul A. Navrátil, Ph.D. Manager Scalable Visualization Technologies Silicon Valley Leadership Group Energy Summit June 8, 2012

2 Texas Advanced Computing Center (TACC) TACC s mission is to enable discoveries that advance science and society through the application of advanced computing technologies. UT Austin: What starts here, changes the world TACC: Powering discoveries that change the world

3 Advanced Computing Systems Visualization Supercomputers Stampede 10+Pflops Dell/Intel top 5 in 2013 Ranger 579 Tflops Sun/AMD - #25 in the world Lonestar Tflops Dell/Intel - #39 in world with partners across Texas Data Mining/Storage Longhorn largest GPGPU Vis system Spur large data visualization Corral 1.2 PB data storage Ranch 10 PB archive Stallion highest resolution tile display Lasso large touch / Kinect display You have access to all these systems!

4 Stampede Stampede, TACC s most-recently announced system, will enter production in January 2013 with 10+ petaflops peak performance Funding from a $51 million National Science Foundation grant, one of the largest NSF grants in UT history System configuration: 100,000+ Intel Sandy Bridge cores in thousands of nodes Thousands of Intel Knight s Corner MIC co-processors 272 TB total system memory 14 PB Lustre distributed file system FDR (56 Gb) InfiniBand interconnect

5 Ranger Ranger is one of the most powerful supercomputers in academia, with over 579 teraflops peak performance. Currently #3 academically hosted system, #25 overall in Top500 (11/2011) To build and deploy Ranger, the National Science Foundation awarded TACC $59 million, the largest single award ever from that agency to UT Austin. System configuration: 62,976 AMD Barcelona cores in 3,936 nodes (16 cores per node) 123 TB total system memory (32 GB per node) 1.73 PB Lustre distributed file system SDR (10 Gb) Infiniband interconnect To date: over 2.6 million jobs run, over 2 billion SUs delivered

6 Lonestar4 Entered production in April 2011, already 467K+ jobs run Currently #4 academically hosted system, #39 overall in Top500 (11/2011) Partners include National Science Foundation, UT Austin, UT System, Texas A&M and Texas Tech Lower peak performance than Ranger (302 peak teraflops), but more powerful for science due to improved processors, faster processor-memory interfaces and faster interconnect System configuration: 22,656 Intel Westmere cores in 1,888 nodes (12 cores per node) 45 TB total system memory (24 GB per node) 1 PB Lustre distributed file system QDR (40 Gb) InfiniBand interconnect TB shared memory nodes 16+ nodes with two NVIDIA M2070 (Fermi-class) GPUs each

7 Visualization on Longhorn Longhorn is the largest open-science system in the world dedicated to visualization and data analysis $7 million grant from the National Science Foundation, entered production in January 2010 System configuration: 2048 Intel Nehalem cores in 256 nodes (8 cores per node) 13.5 TB total system memory (48 GB per node) 270 TB Lustre distributed file system read-only mount to Ranger s 1.73 PB file system mount to Corral s 1 PB file system 512 NVIDIA Quadro FX5800 (Tesla-class) GPUs (2 GPUs per node) 16 nodes with 144 GB of memory each QDR (40Gb) InfiniBand interconnect

8 Data on Corral 1 PB spinning disk for large data collections mounted on all production systems: Ranger, Lonestar, Longhorn External Collections: University of Alaska Museum of the North: Herbarium Digitization and Earth Sciences Collection (paleontology) University of New Mexico - Museum of SW Biology - Parasites University of Alaska Fairbanks - Killer Whale Acoustics Data UC Berkeley Museum of Vertebrate Zoology- Ornithology Collection UT-Austin Collections: Center for Space Research CESAR (Cyberinfrastructure for Emergency Situation Assessment and Response) GRACE (The Gravity Recovery and Climate Experiment) Institute for Classical Archaeology PECOS Engineering Simulation Project

9 O Donnel Data-Driven Science Gift Announced February 21 st, initial production Q $10 M over three years for: a high-performance petascale performance data storage accessible from all of TACC s computing systems a computing system with embedded high-speed storage that is optimized for data-intensive computing $2 M matching funds from UT for staffing

10 Pecan Street Data Portal Command-line database access Web-based analysis and statistics

11 Pecan Street Data Portal Command-line database access Web-based analysis and statistics Water, Gas and Electric data from Incenergy, CheckIT and Austin Energy ERCOT pricing and generation data

12 Pecan Street Data Portal Command-line database access Web-based analysis and statistics over 2.7B records over 200 GB on disk

13 Web-Based Visualization

14 Web-Based Visualization

15 Geospatial Visualization Average home energy usage at 7 am, August Average home energy usage at 7 pm, August Mueller neighborhood data grouped by census block Visualized in Google Earth

16 EPA ERCOT Austin Energy Weather Incenergy Check-It egauge Homes File Server Static Data Transformations Staging Schema Analysis and Curation Warehouse Schema

17 Austin Energy meter_id interval_time timestamp responding read_value E :15: E :15: E :15: egauge dataid timestamp consumption gen grid More :14:

18 Incenergy mac device_id circuit_type_id timestamp mia read_value C2.75.9D.FC 102 RFG :00: Checkit monitor_id channel_id channel_name watt_seconds Watts start_date end_date 14 2 Refrigerator :13:01 00:13:11

19 Event Data Installation Information System Information File Server Transformations Surveys Audits Staging Schema Analysis and Curation Warehouse Schema

20 Staging Schema pecanstreet_rawdata pecanstreet_dev housemap ercot_pricing egauge timestamp datetime 1 DataID smallint (6) Incenergy_Install_Datetime datetime PV_Rebate_System_Install_Datetime datetime ercot_power_plants consumption decimal (11,9) generation decimal (11,9) House varchar (10) MAC varchar (23) ercot_generation grid decimal (11,9) DataID smallint (6) * AE_Generation varchar (32) AE_To_Grid varchar (32) AE_From_Grid varchar (32) Removed_Incenergy tinyint (4) A * * B checkit austin_energy_daily * * * * incenergy_electric mac varchar (23) device_id smallint (5) circuit_type_id varchar (6) timestamp incenergy_water mac varchar (23) device_id smallint (5) circuit_type_id varchar (6) timestamp datetime mia tinyint (1) read_value decimal (7,2) datetime mia tinyint (1) read_value decimal (7,2) incenergy_gas mac varchar (23) device_id smallint (5) circuit_type_id varchar (6) * * * circuits_map 1 device_id int (11) 1 1 description varchar (50) A circuit_type_id varchar (10) factor smallint (6) B noise smallint (6) encoder smallint (6) voltage smallint (6) mac varchar (23) macrotype varchar (23) system_test_results audits surveys austin_energy_15min meter_id varchar (32) interval_time smallint (5) timestamp datetime responding smallint (6) read_value decimal (10,5) * * * * PV_Rebate_PV tinyint (4) Duke tinyint (4) In_Mueller tinyint (4) Has_PV tinyint (4) Block_id varchar (6) Zipplus4 varchar (12) Tract_id varchar (6) Has_Appraisal tinyint (4) Year_Built smallint (6) Acres decimal (4,3) First_Floor_sqft smallint (6) Second_Floor_sqft smallint (6) Third_Floor_sqft smallint (6) egauge varchar (35) Full_PV_Data tinyint (4) South_1 tinyint (4) South_2 tinyint (4) West tinyint (4) South_1_Size decimal (4,3) South_1_Tilt smallint (6) South_1_Azimuth smallint (6) South_2_Size decimal (4,3) South_2_Tilt smallint (6) South_2_Azimuth smallint (6) West_Size decimal (4,3) West_Tilt smallint (6) West_Azimuth smallint (6) timestamp datetime Has_2_Inverters tinyint (4) mia tinyint (1) Dual_MPPT tinyint (4) read_value decimal (7,2)

21 Warehouse Schema dim_date dim_device id device_group device_name varchar (45) device_abbr varchar (45) id pk_date datetime day day_name varchar (9) month month_name varchar (9) quarter year fact_incenergy_electric id time_id date_id device_id location_id house_id fact_austin_energy_electric id int time_id date_id device_id location_id house_id dim_time id time_utc varchar (45) fifteen_min varchar (45) half_hour varchar (45) dim_location provider_id power_watts decimal (10,5) provider_id power_watts decimal (10,5) id timestamp datetime timestamp datetime zipplus4 varchar (45) dim_house dim_provider id id house_id varchar (45) provider varchar (45)

22 Staging Schema 27 sec Warehouse Schema 3 sec

23 Some Research Right Now Incentives for differing solar system configurations Pecan St., funded University of Texas researchers Feeder-Level Storage and Grid Impacts from EV, PV, storage University of Texas IGERT students, Center for Electromechanics Electric, Gas, and Water Disaggregation and Behavior Info funded University of Texas researchers, Pecan St. Consumer Behavior and Appliance Use Patterns funded University of Texas researchers, Pecan St. Impacts of System Accuracy and Data funded University of Texas researchers, Pecan St. AC system sizing, Savings from Energy Efficiency Measures funded University of Texas researchers Emissions Reductions Environmental Defense Fund, Pecan St.

24 Thank you! Paul A. Navrátil