Realtime Photometry System for AST3 (AST3_RPS)

Transcription

1 Realtime Photometry System for AST3 (AST3_RPS) Yu Ce ( 于策 ) yuce@tju.edu.cn School of Computer Science and Technology, Tianjin University ( 天津大学 ) Under the direction of Zhaohui Shang Xi an, Aug. 2010

2 Team Members Astronomers Zhaohui Shang, Jun Pan, Qiang Liu, Bin Ma Members from TJU (HPC and Software) Director: Prof. Jizhou Sun ( 孙济洲 ) Wei Guo, Ce Yu, Jiyan Chen, Jizeng Wei Wei Cao, Xuming Zhang, Jiliang Li, Wendong Kang, Mujin Yang, Shaofei Shi /8/24

3 Outline AST3_RPS Summary Report Related R&D Works /8/24

4 Outline AST3_RPS Summary Report Related R&D Works /8/24

5 AST3_RPS Overview Under support of NSFC ( , ) Build a realtime photometry system for AST3 Image subtraction photometry (based on ISIS, etc) /8/24

6 Provided by Prof. Shang /8/24

7 Challenges of AST3_RPS Processing speed: Realtime Every 2.4 minutes, the telescope will produce a new image (200MB), we must finish the processing procedure before the next image is produced. Robust: High Reliability AST3_RPS will be running through out the whole winter in Kunlun station, without human intervention. So the robustness of the system must be ensured /8/24

8 Work Summary AST3_RPS (AST3 Realtime Photometry System) Daemon AST3 Pipelines Algorithm Parallelization GPU SoC (System on Chip) Output Photometry Pipelines Paralleled Processing Input Image AST3 Daemon Server GPU/SoC Runtime Environment (CPU) /8/24

9 AST3_RPS Daemon AST3 Pipelines Algorithm Parallelization GPU SoC (System on Chip) /8/24

10 Loop and monitor All ISIS Flow China Research Laboratory AST3 Daemon Server (ADS) Periodic check Timer All jobs ok Init runtime parameters A new image Add Start a new job Processes pool Init Abnormal Job Kill job Log Remove Fork() Log Communication with daemon: This job is terminal normally. End /8/24

11 AST3 Daemon Server, self protect Cross protection Daemon Protect service If one is terminated, another will restart it! Cron Daemon /8/24

12 AST3_RPS Daemon AST3 Pipelines Algorithm Parallelization GPU SoC (System on Chip) /8/24

13 AST3 Pipeline Support two observer patterns Tracking Observe Drift Scan Two pipelines Produce the reference image Find the variable objects /8/24

14 Produce the reference image 1 Flat field correction 2 Using sextractor to generate the stars catalog 3 Using SCAMP to generate a ASCII file 4 Using cfitsio to generate the fits header. 5 Co-add the references in the same sky area /8/24

15 Find the variable objects 1 Flat field correction 2 Using sextractor to generate the stars catalog 3 Using SCAMP to generate a ASCII file 4 Using cfitsio to generate the fits header 5 Cut the corresponding area in the references as the reference image 6 Image registration 7 Image subtraction 8 find the variable objects 9 photometry /8/24

16 AST3_RPS Daemon AST3 Pipelines Algorithm Parallelization GPU SoC (System on Chip) /8/24

17 Performance bottleneck In the image subtract photometry processing, the operation of kernel_convolve is the performance bottleneck /8/24

18 GPU Result GPU: NV GTX GFLOPS 1792MB Mem CPU: i7 920, 4core 2.67GHz 8MB Cache Mem: 12GB GPU can meet the requirement of processing speed, but the power consumption is a big problem /8/24

19 SoC solution CPU DMA SRAM FPGA Bus T*core PCIE DDR2 Controller PCIE PHY DDR2 Host /8/24

20 GPU vs SoC GPU SoC Cost Low High Development cycle Short Long Customization No Yes Power consumption High (NV T2, 200W+) Low (T*core, <2W) /8/24

21 Outline AST3_RPS Summary Report Related R&D Works /8/24

22 Research background NAOC-TJU Joint Laboratory in Astro-Informatics Founded in Nov members Director: Jizhou Sun Vice Director Ce Yu Chenzhou Cui /8/24

23 Research topics Astronomical computing Realtime photometry system for AST3 (AST3_RPS) China-VO Large scale cross matching (MapReduce) Indexing massive astronomy data National Astronomical Observatories Science Data Center Parallel programming theory and methods Visual modeling of parallel application Source code skeleton generation /8/24

24 Computing resources Tianhe-1, 1 st peta scale supercomputer in China National Supercomputing Center in Tianjin Its first sub center is founded in TJU in Jul, 2010 Daily management: HPC Lab HPC Cloud of TJU Under construction /8/24

25 /8/24

26 Cooperation with IT companies IBM SUR projects and awards, on parallel computing Google Course development, on Cloud Computing Intel Joint lab and Course development, on multicore Dawning R&D on parallel programming /8/24

27 Our goal: HPC support for Astronomers We are here /8/24

28 Thanks /8/24