POSSUM: analysis for early science and beyond

Size: px
Start display at page:

Download "POSSUM: analysis for early science and beyond"

Transcription

1 POSSUM: analysis for early science and beyond Cormac Purcell, Bryan Gaensler and the POSSUM team ASKAP 2016 askap.org/possum

2 Rotation 1 Rotation 2 Figure: O'Sullivan et al POSSUM-12 versus POSSUM-36 AGN

3 Figure: O'Sullivan et al POSSUM-12 versus POSSUM-36 ASKAP-36 ASKAP-36 Figure: O'Sullivan et al MHz 1130 MHz

4 Figure: O'Sullivan et al H II region around ζ Oph (Harvey-Smith, Madsen & BMG 2011) POSSUM-12 versus POSSUM-36 ASKAP-36 ASKAP-36 Figure: O'Sullivan et al MHz 1130 MHz POSSUM-36: Detect simple Faraday rotating screens Taylor,Stil&Sunstrum 2009 RM Grid

5 Figure: O'Sullivan et al H II region around ζ Oph (Harvey-Smith, Madsen & BMG 2011) POSSUM-12 versus POSSUM-36 ASKAP-36 ASKAP-12 ASKAP-36 ASKAP-12 Figure: O'Sullivan et al MHz 700 MHz 1430 MHz 1130 MHz POSSUM-36: Detect simple Faraday rotating screens Taylor,Stil&Sunstrum 2009 RM Grid

6 Figure: O'Sullivan et al Fletcher et al 2004 POSSUM-12 versus POSSUM-36 ASKAP-36 ASKAP-12 ASKAP-36 ASKAP-12 Figure: O'Sullivan et al MHz 700 MHz 1430 MHz 1130 MHz POSSUM-36: Detect simple Faraday rotating screens POSSUM-12: Detect complex polarisation mechanisms

7 POSSUM Polarisation Catalogues Validation Report POSSUM team defines 3 different catalogues:

8 POSSUM Polarisation Catalogues Validation Report POSSUM team defines 3 different catalogues: POSSUM Polarisation Catalogue (PPC) ASKAP-36 RM-Synthesis & simple modelling

9 POSSUM Polarisation Catalogues Validation Report POSSUM team defines 3 different catalogues: POSSUM Polarisation Catalogue (PPC) POSSUM Broad-Band Catalogue (PBCat) ASKAP-36 ASKAP-12 RM-Synthesis & simple modelling Complex Modelling

10 POSSUM Polarisation Catalogues Validation Report POSSUM team defines 3 different catalogues: POSSUM Polarisation Catalogue (PPC) POSSUM Broad-Band Catalogue (PBCat) POSSUM Value Added Catalogue (PBCat) ASKAP-36 ASKAP-12 ASKAP-12 & 36 RM-Synthesis & simple modelling Complex Modelling Complex Modelling (x, y z, φ) including other sources of information, e.g., synchrotron intensity.

11 ASKAP & POSSUM uv-data Implement for ASKAP Calibration & Imaging Image Data Source finding, & measurement CSIRO Stokes I Catalogue Secondary processing Polarisation Catalogue Advanced data products POSSUM

12 ASKAP & POSSUM uv-data Calibration & Imaging Image Data Source finding, & measurement Stokes I Catalogue Secondary processing Polarisation Catalogue Advanced data products Implement for ASKAP CSIRO POSSUM Design Phase CSIRO / Other POSSUM

13 ASKAP & POSSUM uv-data Calibration & Imaging Image Data Source finding, & measurement Stokes I Catalogue Secondary processing Polarisation Catalogue Advanced data products Implement for ASKAP CSIRO POSSUM Design Phase CSIRO / Other POSSUM

14 ASKAP & POSSUM Implement for ASKAP Design Phase Prototype Pipeline Goals: Develop Algorithms uv-data Calibration & Imaging Image Data Source finding, & measurement CSIRO CSIRO / Other RM-determination. Physical model fitting Degeneracy / model choice End-to-end Integration Catch 'edge cases' data Useful catalogue flags Analysis workflow Stokes I Catalogue Develop Quality Control Secondary processing Pre-release quality report Data quality metrics Granular data selection Polarisation Catalogue Advanced data products POSSUM POSSUM Explore Existing Surveys ATCA test fields, GALFACTS Documentation by code

15 Implementing the Prototype Dedicated USyd

16 Implementing the Prototype Dedicated USyd half of an astronomer

17 Implementing the Prototype Dedicated USyd half of an astronomer

18 Implementing the Prototype Dedicated USyd half of an astronomer Portable, modular, easy to install, easy to run, easy to modify and applicable to current real-world data.

19 Implementing the Prototype Dedicated USyd half of an astronomer Portable, modular, easy to install, easy to run, easy to modify and applicable to current real-world data. Processing Tasks: Python / Numpy Modules Visualisation: Mathplotlib & Tk GUI (Meta)data Storage Images & Spectra: FITS files (1 per source) Catalogue tables: SQLite3 Database File

20 Implementing the Prototype Dedicated USyd half of an astronomer Portable, modular, easy to install, easy to run, easy to modify and applicable to current real-world data. Processing Tasks: Python / Numpy Modules Visualisation: Mathplotlib & Tk GUI (Meta)data Storage Images & Spectra: FITS files (1 per source) Catalogue tables: SQLite3 Database File numpy tkinter sqlite3 mpfit & emcee astropy.io.fits astropy.io.wcs calculations visualisation... local database for model fitting FITS file I/O WCS processing Standard Python Library Standard Astronomy Library Distributed with Pipeline

21 Workflow Pipeline Tasks: 0_gen_model_images.py Input Sensitivity curve

22 Workflow Pipeline Tasks: 0_gen_model_images.py Input Sensitivity curve Input model

23 Workflow Pipeline Tasks: 0_gen_model_images.py Session Directory 1_verify_image_data.py 2_create_image_session.py Source finder catalogue or FITS mask Pipeline supports 'sessions' to facilitate different processing pathways on large datasets Source finding an external step: input can be catalogue or a FITS mask. Flexible catalogue ingestion via SQL CREATE Link

24 Workflow Pipeline Tasks: 0_gen_model_images.py 1_verify_image_data.py 2_create_image_session.py 3_extract_spectra.py Robust spectral extraction, noise estimation & postage-stamp 'cublet' creation U Q 1D & 3D versions

25 Workflow Pipeline Tasks: 0_gen_model_images.py Fourier Transform 1_verify_image_data.py 2_create_image_session.py U Q 3_extract_spectra.py 4_do_RM-synthesis.py Operate on Fourier transformed data Wavelength to Faraday Depth

26 Workflow Pipeline Tasks: 0_gen_model_images.py Deconvolve FDF 1_verify_image_data.py 2_create_image_session.py 3_extract_spectra.py 4_do_RM-synthesis.py 5_do_RM-clean.py

27 Workflow Pipeline Tasks: 0_gen_model_images.py Faraday Thin FDF 1_verify_image_data.py 2_create_image_session.py 3_extract_spectra.py 4_do_RM-synthesis.py 5_do_RM-clean.py Detect peak, subtract thin model & measure residual Residual 6_assess_complexity.py

28 Workflow Pipeline Tasks: 0_gen_model_images.py 1_verify_image_data.py 2_create_image_session.py KS-test 3_extract_spectra.py 4_do_RM-synthesis.py 5_do_RM-clean.py Sigma Sigma Residual 6_assess_complexity.py Skewness KS-test Anderson-Darling test

29 Workflow Pipeline Tasks: 0_gen_model_images.py 1_verify_image_data.py 2_create_image_session.py Clean components 3_extract_spectra.py 4_do_RM-synthesis.py 5_do_RM-clean.py Residual 6_assess_complexity.py 2 nd moment of Clean component spectrum

30 Workflow Pipeline Tasks: 0_gen_model_images.py Faraday Thick FDF 1_verify_image_data.py 2_create_image_session.py 3_extract_spectra.py 4_do_RM-synthesis.py 5_do_RM-clean.py Residual Residual 6_assess_complexity.py

31 Workflow Pipeline Tasks: 0_gen_model_images.py 1_verify_image_data.py 2_create_image_session.py 3_extract_spectra.py 4_do_RM-synthesis.py 5_do_RM-clean.py Residual Residual 6_assess_complexity.py

32 Workflow Pipeline Tasks: 0_gen_model_images.py 1_verify_image_data.py 2_create_image_session.py Clean components 3_extract_spectra.py 4_do_RM-synthesis.py 5_do_RM-clean.py Residual Residual 6_assess_complexity.py

33 Workflow Pipeline Tasks: 0_gen_model_images.py Sun et al _verify_image_data.py 2_create_image_session.py 3_extract_spectra.py 4_do_RM-synthesis.py χ2 5_do_RM-clean.py 6_assess_complexity.py 7_do_QUfit_MCMC.py Scheme QU-fitting

34 Workflow One rotating screen + foreground depolarisation: Two rotating screens Depolarisation Rotation within the beam: N screens with RM-gradients: Rotation 1 Rotation 2

35 Workflow Current work focused on testing robust code to fit models to fractional polarisation data. Foreman-Mackey et al Convergence can be a problem: Robust MCMC fitting code (Purcell et al. in prep) Exploration Burn-in Convergence

36 Workflow N RM-gradient screens Scary: 2-3 component models can fit almost any observed spectrum!

37 Workflow N RM-gradient screens Scary: 2-3 component models can fit almost any observed spectrum! Very high S/N needed across broad band to dissentangle

38 Workflow Pipeline Tasks: 0_gen_model_images.py 1_verify_image_data.py 2_create_image_session.py 3_extract_spectra.py 4_do_RM-synthesis.py 5_do_RM-clean.py 6_assess_complexity.py 7_do_QUfit_MCMC.py rmpipeviewer.py

39 Workflow Pipeline Tasks: 0_gen_model_images.py 1_verify_image_data.py 2_create_image_session.py 3_extract_spectra.py 4_do_RM-synthesis.py 5_do_RM-clean.py 6_assess_complexity.py 7_do_QUfit_MCMC.py rmpipeviewer.py

40 Workflow Pipeline Tasks: 0_gen_model_images.py 1_verify_image_data.py 2_create_image_session.py 3_extract_spectra.py Source summary table 4_do_RM-synthesis.py 5_do_RM-clean.py Common plotting actions 6_assess_complexity.py 7_do_QUfit_MCMC.py rmpipeviewer.py

41 Workflow Pipeline Tasks: 0_gen_model_images.py 1_verify_image_data.py 2_create_image_session.py 3_extract_spectra.py 4_do_RM-synthesis.py SQL Query Interface 5_do_RM-clean.py 6_assess_complexity.py 7_do_QUfit_MCMC.py rmpipeviewer.py

42 Summary Goal: Build a prototype pipeline for the POSSUM project Easy to deploy and use Well commented & documented for CSIRO Framework for testing and integrating algorithms Robust enough to use on existing datasets.

43 Summary Goal: Build a prototype pipeline for the POSSUM project Easy to deploy and use Well commented & documented for CSIRO Framework for testing and integrating algorithms Robust enough to use on existing datasets.

44 Summary Goal: Build a prototype pipeline for the POSSUM project Easy to deploy and use Well commented & documented for CSIRO Framework for testing and integrating algorithms Robust enough to use on existing datasets.

45 Summary Goal: Build a prototype pipeline for the POSSUM project Easy to deploy and use Well commented & documented for CSIRO Framework for testing and integrating algorithms Robust enough to use on existing datasets.

46 Summary Goal: Build a prototype pipeline for the POSSUM project Easy to deploy and use Well commented & documented for CSIRO Framework for testing and integrating algorithms Robust enough to use on existing datasets.

47 Summary Goal: Build a prototype pipeline for the POSSUM project Easy to deploy and use Well commented & documented for CSIRO Framework for testing and integrating algorithms Robust enough to use on existing datasets. Code release in two tranches: 1D & 3D RM-synthesis, RM-clean & QU-fitting modules + demonstration code Will be released on GitHub soon (announcement to POSSUM list): POSSUM pipeline code to make specific PPC and PBCat catalogues Contact cormac.purcell@sydney.edu.au

ASKAP Pipeline processing and simulations. Dr Matthew Whiting ASKAP Computing, CSIRO May 5th, 2010

ASKAP Pipeline processing and simulations. Dr Matthew Whiting ASKAP Computing, CSIRO May 5th, 2010 ASKAP Pipeline processing and simulations Dr Matthew Whiting ASKAP Computing, CSIRO May 5th, 2010 ASKAP Computing Team Members Team members Marsfield: Tim Cornwell, Ben Humphreys, Juan Carlos Guzman, Malte

More information

CSIRO ASKAP Science Data Archive CSIRO ASTRONOMY AND SPACE SCIENCE (CASS)

CSIRO ASKAP Science Data Archive CSIRO ASTRONOMY AND SPACE SCIENCE (CASS) CSIRO ASKAP Science Data Archive CSIRO ASTRONOMY AND SPACE SCIENCE (CASS) Jessica Chapman, ATUC Meeting, 5 December 2013 CSIRO ASKAP Science Data Archive (CASDA) Talk outline A: CASDA overview and timeline

More information

The Virtual Observatory in Australia Connecting to International Initiatives. Peter Lamb. CSIRO Mathematical & Information Sciences

The Virtual Observatory in Australia Connecting to International Initiatives. Peter Lamb. CSIRO Mathematical & Information Sciences The Virtual Observatory in Australia Connecting to International Initiatives Peter Lamb CSIRO Mathematical & Information Sciences The Grid & escience Convergence of high-performance computing, huge data

More information

Data Analysis. I have got some data, so what now? Naomi McClure-Griffiths CSIRO Australia Telescope National Facility 2 Oct 2008

Data Analysis. I have got some data, so what now? Naomi McClure-Griffiths CSIRO Australia Telescope National Facility 2 Oct 2008 Data Analysis I have got some data, so what now? Naomi McClure-Griffiths CSIRO Australia Telescope National Facility 2 Oct 2008 1 Outline Non-imaging analysis Parameter estimation Point source fluxes,

More information

Imaging and Deconvolution

Imaging and Deconvolution Imaging and Deconvolution Urvashi Rau National Radio Astronomy Observatory, Socorro, NM, USA The van-cittert Zernike theorem Ei E V ij u, v = I l, m e sky j 2 i ul vm dldm 2D Fourier transform : Image

More information

zap Documentation Release 1.0.dev86 Kurt Soto

zap Documentation Release 1.0.dev86 Kurt Soto zap Documentation Release 1.0.dev86 Kurt Soto February 03, 2016 Contents 1 Installation 3 1.1 Requirements............................................... 3 1.2 Steps...................................................

More information

ASKAP Data Flow ASKAP & MWA Archives Meeting

ASKAP Data Flow ASKAP & MWA Archives Meeting ASKAP Data Flow ASKAP & MWA Archives Meeting Ben Humphreys ASKAP Software and Computing Project Engineer 25 th March 2013 ASTRONOMY AND SPACE SCIENCE ASKAP @ Murchison Radioastronomy Observatory Australian

More information

Continuum error recognition and error analysis

Continuum error recognition and error analysis Continuum error recognition and error analysis Robert Laing (ESO) 1 Outline Error recognition: how do you recognise and diagnose residual errors by looking at images? Image analysis: how do you extract

More information

FIFI-LS: Basic Cube Analysis using SOSPEX

FIFI-LS: Basic Cube Analysis using SOSPEX FIFI-LS: Basic Cube Analysis using SOSPEX Date: 1 Oct 2018 Revision: - CONTENTS 1 INTRODUCTION... 1 2 INGREDIENTS... 1 3 INSPECTING THE CUBE... 3 4 COMPARING TO A REFERENCE IMAGE... 5 5 REFERENCE VELOCITY

More information

Basic Imaging and Self- Calibration (T4 + T7)

Basic Imaging and Self- Calibration (T4 + T7) Basic Imaging and Self- Calibration (T4 + T7) John McKean Visibilities Fourier Transform Deconvolution AIM: 1. To make an image by taking the fast Fourier transform of the visibility data. 2. Carry out

More information

High Dynamic Range Imaging

High Dynamic Range Imaging High Dynamic Range Imaging Josh Marvil CASS Radio Astronomy School 3 October 2014 CSIRO ASTRONOMY & SPACE SCIENCE High Dynamic Range Imaging Introduction Review of Clean Self- Calibration Direction Dependence

More information

Fast Holographic Deconvolution

Fast Holographic Deconvolution Precision image-domain deconvolution for radio astronomy Ian Sullivan University of Washington 4/19/2013 Precision imaging Modern imaging algorithms grid visibility data using sophisticated beam models

More information

Adaptive selfcalibration for Allen Telescope Array imaging

Adaptive selfcalibration for Allen Telescope Array imaging Adaptive selfcalibration for Allen Telescope Array imaging Garrett Keating, William C. Barott & Melvyn Wright Radio Astronomy laboratory, University of California, Berkeley, CA, 94720 ABSTRACT Planned

More information

How accurately do our imaging algorithms reconstruct intensities and spectral indices of weak sources?

How accurately do our imaging algorithms reconstruct intensities and spectral indices of weak sources? How accurately do our imaging algorithms reconstruct intensities and spectral indices of weak sources? Urvashi Rau, Sanjay Bhatnagar, Frazer Owen ( NRAO ) 29th Annual New Mexico Symposium, NRAO, Socorro,

More information

Deconvolution and Imaging ASTR 240: In-class activity, April 1, 2013

Deconvolution and Imaging ASTR 240: In-class activity, April 1, 2013 Deconvolution and Imaging ASTR 240: In-class activity, April 1, 2013 In this activity, we will use calibrated visibilities from the Submillimeter Array to create an image of a disk around a nearby young

More information

National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology WISE Archive.

National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology WISE Archive. Bruce Berriman / Steve Groom Infrared Science Archive (IRSA), IPAC/Caltech GBB/SLG - 1 WSDC Functional Block Diagram White Sands JPL UCLA HRP H/K MOS Maneuvers SOC Science Team Images FTP Site Ancillary

More information

CASA. Algorithms R&D. S. Bhatnagar. NRAO, Socorro

CASA. Algorithms R&D. S. Bhatnagar. NRAO, Socorro Algorithms R&D S. Bhatnagar NRAO, Socorro Outline Broad areas of work 1. Processing for wide-field wide-band imaging Full-beam, Mosaic, wide-band, full-polarization Wide-band continuum and spectral-line

More information

Synthesis Imaging. Claire Chandler, Sanjay Bhatnagar NRAO/Socorro

Synthesis Imaging. Claire Chandler, Sanjay Bhatnagar NRAO/Socorro Synthesis Imaging Claire Chandler, Sanjay Bhatnagar NRAO/Socorro Michelson Summer Workshop Caltech, July 24-28, 2006 Synthesis Imaging 2 Based on the van Cittert-Zernike theorem: The complex visibility

More information

Computational issues for HI

Computational issues for HI Computational issues for HI Tim Cornwell, Square Kilometre Array How SKA processes data Science Data Processing system is part of the telescope Only one system per telescope Data flow so large that dedicated

More information

The Canadian CyberSKA Project

The Canadian CyberSKA Project The Canadian CyberSKA Project A. G. Willis (on behalf of the CyberSKA Project Team) National Research Council of Canada Herzberg Institute of Astrophysics Dominion Radio Astrophysical Observatory May 24,

More information

JWST Pipeline & Data Products

JWST Pipeline & Data Products JWST Pipeline & Data Products Stage 1: Ramps-to-Slopes Karl D. Gordon JWST Calibration WG Lead Space Telescope Sci. Inst. Baltimore, MD, USA Stage 2: Calibrated Slopes Stage 3: Ensemble Processing 18 May

More information

Sky-domain algorithms to reconstruct spatial, spectral and time-variable structure of the sky-brightness distribution

Sky-domain algorithms to reconstruct spatial, spectral and time-variable structure of the sky-brightness distribution Sky-domain algorithms to reconstruct spatial, spectral and time-variable structure of the sky-brightness distribution Urvashi Rau National Radio Astronomy Observatory Socorro, NM, USA Outline : - Overview

More information

ALMA Memo 386 ALMA+ACA Simulation Tool J. Pety, F. Gueth, S. Guilloteau IRAM, Institut de Radio Astronomie Millimétrique 300 rue de la Piscine, F-3840

ALMA Memo 386 ALMA+ACA Simulation Tool J. Pety, F. Gueth, S. Guilloteau IRAM, Institut de Radio Astronomie Millimétrique 300 rue de la Piscine, F-3840 ALMA Memo 386 ALMA+ACA Simulation Tool J. Pety, F. Gueth, S. Guilloteau IRAM, Institut de Radio Astronomie Millimétrique 300 rue de la Piscine, F-38406 Saint Martin d'h eres August 13, 2001 Abstract This

More information

Case Study: CyberSKA - A Collaborative Platform for Data Intensive Radio Astronomy

Case Study: CyberSKA - A Collaborative Platform for Data Intensive Radio Astronomy Case Study: CyberSKA - A Collaborative Platform for Data Intensive Radio Astronomy Outline Motivation / Overview Participants / Industry Partners Documentation Architecture Current Status and Services

More information

Preprocessing, Management, and Analysis of Mass Spectrometry Proteomics Data

Preprocessing, Management, and Analysis of Mass Spectrometry Proteomics Data Preprocessing, Management, and Analysis of Mass Spectrometry Proteomics Data * Mario Cannataro University Magna Græcia of Catanzaro, Italy cannataro@unicz.it * Joint work with P. H. Guzzi, T. Mazza, P.

More information

Overview of LFI maps generation and their characteristics

Overview of LFI maps generation and their characteristics Overview of LFI maps generation and their characteristics Davide Maino University of Milano, Dept. of Physics UC Davis, 20 May 2013 Davide Maino Overview of LFI maps generation and their characteristics

More information

TW Hya CASA Spectral Line Reduc6on Tutorial Imaging and Analysis

TW Hya CASA Spectral Line Reduc6on Tutorial Imaging and Analysis TW Hya CASA Spectral Line Reduc6on Tutorial Imaging and Analysis Day 4, Wednesday September 9 th 12:15 HCO+(4-3) moment maps of TW Hya Tutors: Katharine Johnston Andy Biggs, Sandra Etoka, (Liz Humphreys),

More information

ALMA Science Pipeline Quickstart Guide

ALMA Science Pipeline Quickstart Guide Doc 2.13, ver. 1.0 September 2014 ALMA Science Pipeline Quickstart Guide ALMA, an international astronomy facility, is a partnership of Europe, North America and East Asia in cooperation with the Republic

More information

Lessons learnt from implementing mosaicing and faceting in ASKAPsoft. Max Voronkov & Tim Cornwell ASKAP team 2nd April 2009

Lessons learnt from implementing mosaicing and faceting in ASKAPsoft. Max Voronkov & Tim Cornwell ASKAP team 2nd April 2009 Lessons learnt from implementing mosaicing and faceting in ASKAPsoft Max Voronkov & Tim Cornwell ASKAP team 2nd April 2009 Outline - Imaging software ASKAPsoft re-uses LOFAR design Imaging is treated as

More information

An Introduction to Markov Chain Monte Carlo

An Introduction to Markov Chain Monte Carlo An Introduction to Markov Chain Monte Carlo Markov Chain Monte Carlo (MCMC) refers to a suite of processes for simulating a posterior distribution based on a random (ie. monte carlo) process. In other

More information

Exploiting Virtual Observatory and Information Technology: Techniques for Astronomy

Exploiting Virtual Observatory and Information Technology: Techniques for Astronomy Exploiting Virtual Observatory and Information Technology: Techniques for Astronomy Nicholas Walton AstroGrid Project Scientist Institute of Astronomy, The University of Cambridge Lecture #3 Goal: Applications

More information

SKA Regional Centre Activities in Australasia

SKA Regional Centre Activities in Australasia SKA Regional Centre Activities in Australasia Dr Slava Kitaeff CSIRO-ICRAR APSRC Project Engineer ERIDANUS National Project Lead Why SKA Regional Centres? SKA 1 Observatory Compute capacity: 100 Pflops

More information

ALMA Antenna responses in CASA imaging

ALMA Antenna responses in CASA imaging ALMA Antenna responses in CASA imaging Dirk Petry (ESO), December 2012 Outline Motivation ALBiUS/ESO work on CASA responses infrastructure and ALMA beam library First test results 1 Motivation ALMA covers

More information

ASKAP Central Processor: Design and Implementa8on

ASKAP Central Processor: Design and Implementa8on ASKAP Central Processor: Design and Implementa8on Calibra8on and Imaging Workshop 2014 Ben Humphreys ASKAP So(ware and Compu3ng Project Engineer 3rd - 7th March 2014 ASTRONOMY AND SPACE SCIENCE Australian

More information

Quality assurance in the ingestion of data into the CDS VizieR catalogue and data services

Quality assurance in the ingestion of data into the CDS VizieR catalogue and data services Quality assurance in the ingestion of data into the CDS VizieR catalogue and data services VizieR Staff and contributors: Astronomers: P.Ocvirk, C. Bot, S.Derriere, A.Nebot Engineers: G.Landais, T.Boch,

More information

The ALMA Pipeline. Introduction Pipeline Subsystem Heuristics Task Interface Tests / Commissioning Results Demos. D. Muders, MPIfR L.

The ALMA Pipeline. Introduction Pipeline Subsystem Heuristics Task Interface Tests / Commissioning Results Demos. D. Muders, MPIfR L. The ALMA Pipeline Introduction Pipeline Subsystem Heuristics Task Interface Tests / Commissioning Results Demos D. Muders, MPIfR L. Davis, NRAO 1 Introduction ALMA must be available to all of the astronomical

More information

ALMA Science Pipeline Quickstart Guide

ALMA Science Pipeline Quickstart Guide Doc 2.13, ver. 2.0 August 2015 ALMA Science Pipeline Quickstart Guide Pipeline CASA 4.3.1 ALMA, an international astronomy facility, is a partnership of Europe, North America and East Asia in cooperation

More information

Getting the most out of your ALMA DATA with ADMIT: The ALMA DATA Mining Toolkit

Getting the most out of your ALMA DATA with ADMIT: The ALMA DATA Mining Toolkit Getting the most out of your ALMA DATA with : The ALMA DATA Mining Toolkit Lee Mundy, Leslie Looney, Peter Teuben, Doug Friedel, Marc Pound, Lisa Xu, Kevin Rauch, Robert Harris, Jeff Kern, & team : ALMA

More information

TerraMatch. Introduction

TerraMatch. Introduction TerraMatch Introduction Error sources Interior in LRF Why TerraMatch? Errors in laser distance measurement Scanning mirror errors Exterior in trajectories Errors in position (GPS) Errors in orientation

More information

Multivariate Calibration Quick Guide

Multivariate Calibration Quick Guide Last Updated: 06.06.2007 Table Of Contents 1. HOW TO CREATE CALIBRATION MODELS...1 1.1. Introduction into Multivariate Calibration Modelling... 1 1.1.1. Preparing Data... 1 1.2. Step 1: Calibration Wizard

More information

Visualization & the CASA Viewer

Visualization & the CASA Viewer Visualization & the Viewer Juergen Ott & the team Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Visualization Goals:

More information

Science User Interface and Tools: Status. David R. Ciardi & Xiuqin Wu On Behalf of the SUIT Team at IPAC

Science User Interface and Tools: Status. David R. Ciardi & Xiuqin Wu On Behalf of the SUIT Team at IPAC Science User Interface and Tools: Status David R. Ciardi & Xiuqin Wu On Behalf of the SUIT Team at IPAC 1 Building the SUIT Vision Given the speed with which web technologies evolve, SUIT was intentionally

More information

WALLABY kinematic parametre extraction:

WALLABY kinematic parametre extraction: WALLABY kinematic parametre extraction: A sub-pipeline for 2D tilted-ring fits (ICRAR/UWA) with WALLABY kinematics working group Contents A brief recap of WALLABY rotation curve pipeline 2D tilted-ring

More information

VERY LARGE TELESCOPE 3D Visualization Tool Cookbook

VERY LARGE TELESCOPE 3D Visualization Tool Cookbook European Organisation for Astronomical Research in the Southern Hemisphere VERY LARGE TELESCOPE 3D Visualization Tool Cookbook VLT-SPE-ESO-19500-5652 Issue 1.0 10 July 2012 Prepared: Mark Westmoquette

More information

High dynamic range imaging, computing & I/O load

High dynamic range imaging, computing & I/O load High dynamic range imaging, computing & I/O load RMS ~15µJy/beam RMS ~1µJy/beam S. Bhatnagar NRAO, Socorro Parameterized Measurement Equation Generalized Measurement Equation Obs [ S M V ij = J ij, t W

More information

Image Analysis. Jim Lovell

Image Analysis. Jim Lovell Image Analysis Jim Lovell ATNF Synthesis Imaging Workshop May 2003 What Do You Want to Measure? (What you want to do and how to do it.)! Flux density of components! Absolute positions! Relative positions

More information

Lecture 17 Reprise: dirty beam, dirty image. Sensitivity Wide-band imaging Weighting

Lecture 17 Reprise: dirty beam, dirty image. Sensitivity Wide-band imaging Weighting Lecture 17 Reprise: dirty beam, dirty image. Sensitivity Wide-band imaging Weighting Uniform vs Natural Tapering De Villiers weighting Briggs-like schemes Reprise: dirty beam, dirty image. Fourier inversion

More information

STREAMING ALGORITHMS. Tamás Budavári / Johns Hopkins University ANALYSIS OF ASTRONOMY IMAGES & CATALOGS 10/26/2015

STREAMING ALGORITHMS. Tamás Budavári / Johns Hopkins University ANALYSIS OF ASTRONOMY IMAGES & CATALOGS 10/26/2015 STREAMING ALGORITHMS ANALYSIS OF ASTRONOMY IMAGES & CATALOGS 10/26/2015 / Johns Hopkins University Astronomy Changed! Always been data-driven But we used to know the sources by heart! Today large collections

More information

Spectrographs. C. A. Griffith, Class Notes, PTYS 521, 2016 Not for distribution.

Spectrographs. C. A. Griffith, Class Notes, PTYS 521, 2016 Not for distribution. Spectrographs C A Griffith, Class Notes, PTYS 521, 2016 Not for distribution 1 Spectrographs and their characteristics A spectrograph is an instrument that disperses light into a frequency spectrum, which

More information

NRAO VLA Archive Survey

NRAO VLA Archive Survey NRAO VLA Archive Survey Jared H. Crossley, Loránt O. Sjouwerman, Edward B. Fomalont, and Nicole M. Radziwill National Radio Astronomy Observatory, 520 Edgemont Road, Charlottesville, Virginia, USA ABSTRACT

More information

Data products. Dario Fadda (USRA) Pipeline team Bill Vacca Melanie Clarke Dario Fadda

Data products. Dario Fadda (USRA) Pipeline team Bill Vacca Melanie Clarke Dario Fadda Data products Dario Fadda (USRA) Pipeline team Bill Vacca Melanie Clarke Dario Fadda Pipeline (levels 1 à 2) The pipeline consists in a sequence of modules. For each module, files are created and read

More information

Introduction to Raman spectroscopy measurement data processing using Igor Pro

Introduction to Raman spectroscopy measurement data processing using Igor Pro Introduction to Raman spectroscopy measurement data processing using Igor Pro This introduction is intended to minimally guide beginners to processing Raman spectroscopy measurement data, which includes

More information

SPECTRAL IMAGING VIEWER SOFTWARE MANUAL

SPECTRAL IMAGING VIEWER SOFTWARE MANUAL 103 Quality Circle, Suite 215 Huntsville, AL 35806 Phone: (256) 704-3332 Fax: (256) 971-2073 E-Mail: info@axometrics.com Website: http://www.axometrics.com SPECTRAL IMAGING VIEWER SOFTWARE MANUAL 2012

More information

AKARI FTS Toolkit Manual

AKARI FTS Toolkit Manual Version 1 (May 13, 2008) 1 AKARI FTS Toolkit Manual Version 1 Hidenori Takahashi 1, Yoko Okada 2, Akiko Yasuda 2, Hiroshi Matsuo 3, Mitsunobu Kawada 4, Noriko Murakami 5, and Chris Pearson 6,7 1 Gunma

More information

Mu lt i s p e c t r a l

Mu lt i s p e c t r a l Viewing Angle Analyser Revolutionary system for full spectral and polarization measurement in the entire viewing angle EZContrastMS80 & EZContrastMS88 ADVANCED LIGHT ANALYSIS by Field iris Fourier plane

More information

The Virtual Observatory and the IVOA

The Virtual Observatory and the IVOA The Virtual Observatory and the IVOA The Virtual Observatory Emergence of the Virtual Observatory concept by 2000 Concerns about the data avalanche, with in mind in particular very large surveys such as

More information

Data Centres in the Virtual Observatory Age

Data Centres in the Virtual Observatory Age Data Centres in the Virtual Observatory Age David Schade Canadian Astronomy Data Centre A few things I ve learned in the past two days There exist serious efforts at Long-Term Data Preservation Alliance

More information

X-ray Spectra Part II: Fitting Data and Determining Errors

X-ray Spectra Part II: Fitting Data and Determining Errors X-ray Spectra Part II: Fitting Data and Determining Errors Michael Nowak, mnowak@space.mit.edu May 12, 2016 Setting Up the Data This exercise presumes that you ve downloaded and installed the.isisrc files

More information

The Completeness and Reliability of Threshold and False-discovery Rate Source Extraction Algorithms for Compact Continuum Sources

The Completeness and Reliability of Threshold and False-discovery Rate Source Extraction Algorithms for Compact Continuum Sources CSIRO PUBLISHING Publications of the Astronomical Society of Australia, 2012, 29, 229 243 http://dx.doi.org/10.1071/as11026 The Completeness and Reliability of Threshold and False-discovery Rate Source

More information

Performing Iterative Non-blind Deconvolution with BiaQIm (Second Edition, )

Performing Iterative Non-blind Deconvolution with BiaQIm (Second Edition, ) How to Deconvolve with BiaQIm www.bialith.com Page 1 Performing Iterative Non-blind Deconvolution with BiaQIm (Second Edition, 02.05.2010) Introduction This is an extract from the BiaQIm user s manual.

More information

Time Series Analytics with Simple Relational Database Paradigms Ben Leighton, Julia Anticev, Alex Khassapov

Time Series Analytics with Simple Relational Database Paradigms Ben Leighton, Julia Anticev, Alex Khassapov Time Series Analytics with Simple Relational Database Paradigms Ben Leighton, Julia Anticev, Alex Khassapov LAND AND WATER & CSIRO IMT SCIENTIFIC COMPUTING Energy Use Data Model (EUDM) endeavours to deliver

More information

JWST Pipeline & Data Products

JWST Pipeline & Data Products JWST Pipeline & Data Products Stage 1: Ramps-to-Slopes Karl D. Gordon JWST Calibration WG Lead Space Telescope Sci. Inst. Baltimore, MD, USA Stage 2: Calibrated Slopes Stage 3: Ensemble Processing Star

More information

OSKAR-2: Simulating data from the SKA

OSKAR-2: Simulating data from the SKA OSKAR-2: Simulating data from the SKA AACal 2012, Amsterdam, 13 th July 2012 Fred Dulwich, Ben Mort, Stef Salvini 1 Overview OSKAR-2: Interferometer and beamforming simulator package. Intended for simulations

More information

The Herschel Data Processing System: History, Status and latest Developments

The Herschel Data Processing System: History, Status and latest Developments The Herschel Data Processing System: History, Status and latest Developments Stephan Ott Herschel Science Data Processing Development Manager Herschel Science Data Processing Coordinator Herschel Science

More information

Using Noise Substitution for Backwards-Compatible Audio Codec Improvement

Using Noise Substitution for Backwards-Compatible Audio Codec Improvement Using Noise Substitution for Backwards-Compatible Audio Codec Improvement Colin Raffel AES 129th Convention San Francisco, CA February 16, 2011 Outline Introduction and Motivation Coding Error Analysis

More information

RASDRWin Companion Software for RASDR. Paul Oxley Retired AT&T Microwave Engineer David Fields Stan Kurtz

RASDRWin Companion Software for RASDR. Paul Oxley Retired AT&T Microwave Engineer David Fields Stan Kurtz RASDRWin Companion Software for RASDR Paul Oxley Retired AT&T Microwave Engineer David Fields Stan Kurtz Abstract: An update of the RASDR project will be presented. The paper demonstrates Windows control

More information

( ) = First Bessel function, x = π Dθ

( ) = First Bessel function, x = π Dθ Observational Astronomy Image formation Complex Pupil Function (CPF): (3.3.1) CPF = P( r,ϕ )e ( ) ikw r,ϕ P( r,ϕ ) = Transmittance of the aperture (unobscured P = 1, obscured P = 0 ) k = π λ = Wave number

More information

CSIRO Visualisation Service

CSIRO Visualisation Service CSIRO Visualisation Service Assessment and Future Plans Justin Baker Visualisation and Collaboration Manager 31 August2012 IMT ERESEARCH PROGRAM CSIRO eresearch Program Research Planning eresearch Planning

More information

CS4758: Rovio Augmented Vision Mapping Project

CS4758: Rovio Augmented Vision Mapping Project CS4758: Rovio Augmented Vision Mapping Project Sam Fladung, James Mwaura Abstract The goal of this project is to use the Rovio to create a 2D map of its environment using a camera and a fixed laser pointer

More information

X-ray imaging software tools for HPC clusters and the Cloud

X-ray imaging software tools for HPC clusters and the Cloud X-ray imaging software tools for HPC clusters and the Cloud Darren Thompson Application Support Specialist 9 October 2012 IM&T ADVANCED SCIENTIFIC COMPUTING NeAT Remote CT & visualisation project Aim:

More information

Wide field polarization calibration in the image plane using the Allen Telescope Array

Wide field polarization calibration in the image plane using the Allen Telescope Array Wide field polarization calibration in the image plane using the Allen Telescope Array Mattieu de Villiers, SKA SA Casey Law, UC Berkeley 8 October 00 Abstract This study investigates wide field polarization

More information

University of Huddersfield Repository

University of Huddersfield Repository University of Huddersfield Repository Muhamedsalih, Hussam, Jiang, Xiang and Gao, F. Interferograms analysis for wavelength scanning interferometer using convolution and fourier transform. Original Citation

More information

PSRCHIVE is: Introduction to PSRCHIVE. IPTA 2015 Student Workshop. PSRCHIVE can: PSRCHIVE cannot: Use PSRCHIVE to. PSRCHIVE Core Applications 7/21/15

PSRCHIVE is: Introduction to PSRCHIVE. IPTA 2015 Student Workshop. PSRCHIVE can: PSRCHIVE cannot: Use PSRCHIVE to. PSRCHIVE Core Applications 7/21/15 Introduction to PSRCHIVE IPTA 2015 Student Workshop Parkes Observatory, 20 24 July 2015 PSRCHIVE is: not a single monolithic program a suite of programs integrated with the UNIX environment a C++ development

More information

Image Pixelization and Dynamic Range

Image Pixelization and Dynamic Range EVLA Memo 114 Image Pixelization and Dynamic Range W. D. Cotton, Juan M. Uson NRAO 1 Abstract This study investigates some of the effects of representing the sky by a rectangular grid of pixels on the

More information

Distributed Archive System for the Cherenkov Telescope Array

Distributed Archive System for the Cherenkov Telescope Array Distributed Archive System for the Cherenkov Telescope Array RIA-653549 Eva Sciacca, S. Gallozzi, A. Antonelli, A. Costa INAF, Astrophysical Observatory of Catania INAF, Astronomical Observatory of Rome

More information

GONG Hα Instrument. J. Harvey & GONG Team

GONG Hα Instrument. J. Harvey & GONG Team GONG Hα Instrument J. Harvey & GONG Team Outline Overview Optical design Hα Filter Camera Mechanical Remaining issues September 22, 2009 GONG H-alpha Review 2 Instrument Design Goals No significant impact

More information

SIVIC GUI Overview. SIVIC GUI Layout Overview

SIVIC GUI Overview. SIVIC GUI Layout Overview SIVIC GUI Overview SIVIC GUI Layout Overview At the top of the SIVIC GUI is a row of buttons called the Toolbar. It is a quick interface for loading datasets, controlling how the mouse manipulates the

More information

Raman Spectrometer Installation Manual

Raman Spectrometer Installation Manual RI Raman Spectrometer Instruction Manual Application software (included in standard configuration) Connection RI RAMAN is recognized by Windows operational system as standard HID device. That is why there

More information

Document Number: SC2/FTS/SOF/020

Document Number: SC2/FTS/SOF/020 SCUBA-2 FTS Project Office University of Lethbridge Physics Department 4401 University Drive Lethbridge, Alberta CANADA T1K 3M4 Tel: 1-403-329-2771 Fax: 1-403-329-2057 Email: brad.gom@uleth.ca WWW: http://research.uleth.ca/scuba2/

More information

NHSC HIFI DP workshop Caltech, September A Tour of HIFI Data. - page 1

NHSC HIFI DP workshop Caltech, September A Tour of HIFI Data. - page 1 NHSC HIFI DP workshop Caltech, 12-13 September 2012 A Tour of HIFI Data - page 1 Outline Opening the observation context A casual look at the HIPE GUI presentation of your data How to plot the spectra

More information

arxiv: v1 [astro-ph.im] 15 Jan 2019

arxiv: v1 [astro-ph.im] 15 Jan 2019 Efficient Source Finding for Radio Interferometric Images arxiv:1901.04956v1 [astro-ph.im] 15 Jan 2019 Abstract Luís Lucas 1 Critical Software S.A., Portugal 2 Polytechnic Institute of Leiria, Portugal

More information

OTO Photonics. Sidewinder TM Series Datasheet. Description

OTO Photonics. Sidewinder TM Series Datasheet. Description OTO Photonics Sidewinder TM Series Datasheet Description SW (Sidewinder TM ) Series spectrometer,built with the InGaAs type sensor and high performance 32bits RISC controller in, is specially designed

More information

ME scope Application Note 19

ME scope Application Note 19 ME scope Application Note 19 Using the Stability Diagram to Estimate Modal Frequency & Damping The steps in this Application Note can be duplicated using any Package that includes the VES-4500 Advanced

More information

IPTA student workshop 2017: Day 1, preparing timing data with psrchive

IPTA student workshop 2017: Day 1, preparing timing data with psrchive IPTA student workshop 2017: Day 1, preparing timing data with psrchive June 26, 2017 Kuo Liu 1, Stefan Os lowski 2 1 Max-Planck-Institut für Radioastronomie, Auf dem Hügel 69, D-53121 Bonn, Germany 2 Centre

More information

Lesson 2 Instrument Configurations for Profex / BGMN

Lesson 2 Instrument Configurations for Profex / BGMN Lesson 2 Instrument Configurations for Profex / BGMN Nicola Döbelin RMS Foundation, Bettlach, Switzerland June 13 15, 2018, Bettlach, CH Fundamental Parameters Approach http://www.bgmn.de 2 BGMN: Wavelength

More information

Implementation of a reporting workflow to maintain data lineage for major water resource modelling projects

Implementation of a reporting workflow to maintain data lineage for major water resource modelling projects 18 th World IMACS / MODSIM Congress, Cairns, Australia 13-17 July 2009 http://mssanz.org.au/modsim09 Implementation of a reporting workflow to maintain data lineage for major water Merrin, L.E. 1 and S.M.

More information

Broadband Radio Astronomy Tools (BRATS) Cookbook

Broadband Radio Astronomy Tools (BRATS) Cookbook Broadband Radio Astronomy Tools (BRATS) Cookbook Developed by Jeremy J. Harwood jeremy.harwood@physics.org If you have made use of this software, please reference Harwood et al., 2013, MNRAS, 435, 3353

More information

IVOA Spectral Energy Distribution (SED) Data Model

IVOA Spectral Energy Distribution (SED) Data Model International Virtual Observatory Alliance IVOA Spectral Energy Distribution (SED) Data Model Version 1.0 IVOA Working Draft, 2012 October 15 This version: WD-SEDDM-1.0-20121015 Previous version(s): http://www.ivoa.net/internal/ivoa/interopmay2011sed/seddm-20110515.pdf

More information

Imaging and non-imaging analysis

Imaging and non-imaging analysis 1 Imaging and non-imaging analysis Greg Taylor University of New Mexico Spring 2017 Plan for the lecture-i 2 How do we go from the measurement of the coherence function (the Visibilities) to the images

More information

Operating instructions - Cary 100 Bio UV-visible Spectrophotometer

Operating instructions - Cary 100 Bio UV-visible Spectrophotometer Operating instructions - Cary 100 Bio UV-visible Spectrophotometer This document describes how to power up the spectrophotometer, set its measurement parameters, insert one or more of samples for analysis

More information

3D Slicer Overview. Andras Lasso, PhD PerkLab, Queen s University

3D Slicer Overview. Andras Lasso, PhD PerkLab, Queen s University 3D Slicer Overview Andras Lasso, PhD PerkLab, Queen s University Right tool for the job Technological prototype Research tool Clinical tool Can it be done? Jalopnik.com Innovative, not robust, usually

More information

QUALITY CONTROL CHECKLISTS FOR DIGITIZATION PROJECTS

QUALITY CONTROL CHECKLISTS FOR DIGITIZATION PROJECTS QUALITY CONTROL CHECKLISTS FOR DIGITIZATION PROJECTS This document provides a template to use when creating quality control (QC) workflows and checklists. Use this resource to develop a similar document

More information

THE SQUARE KILOMETER ARRAY (SKA) ESD USE CASE

THE SQUARE KILOMETER ARRAY (SKA) ESD USE CASE THE SQUARE KILOMETER ARRAY (SKA) ESD USE CASE Ronald Nijboer Head ASTRON R&D Computing Group With material from Chris Broekema (ASTRON) John Romein (ASTRON) Nick Rees (SKA Office) Miles Deegan (SKA Office)

More information

The Italian LBT spectroscopic data reduction pipeline

The Italian LBT spectroscopic data reduction pipeline LBTO 2017 Users' Meeting The Italian LBT spectroscopic data reduction pipeline Alida Marchetti INAF-IASF Milano Firenze, June 20th-23rd reduction pipeline SOME NUMBERS INAF nights 46 Effective observing

More information

ALMA Software development. George KOSUGI: NAOJ, ALMA ICT-EA Manager

ALMA Software development. George KOSUGI: NAOJ, ALMA ICT-EA Manager ALMA Software development George KOSUGI: NAOJ, ALMA ICT-EA Manager Contents ALMA Software Developments in EU (ESO) ALMA Software Developments in NA (NRAO) ALMA+ Software Developments in EA (NAOJ) Development

More information

Implementing the RDA Data Citation Recommendations for Long Tail Research Data. Stefan Pröll

Implementing the RDA Data Citation Recommendations for Long Tail Research Data. Stefan Pröll Implementing the RDA Data Citation Recommendations for Long Tail Research Data Stefan Pröll Overview 2 Introduction Recap of the WGDC Recommendations Long Tail Research Data SQL Prototype Git Prototype

More information

1

1 In the following tutorial we will determine by fitting the standard instrumental broadening supposing that the LaB 6 NIST powder sample broadening is negligible. This can be achieved in the MAUD program

More information

Visualization-directed interactive model-fitting to spectral data cubes CRICOS provider 00111D

Visualization-directed interactive model-fitting to spectral data cubes CRICOS provider 00111D Visualization-directed interactive model-fitting to spectral data cubes CRICOS provider 00111D Christopher Fluke with Jayanne English (U. Manitoba) David Barnes (Swin) Ben Barsdell (Swin), Amr Hassan (Swin)

More information

CASA Status. Crystal Brogan (subsystem scientist) ASAC Meeting, March 9, 2010 Mitaka, Japan. NRAO/North American ALMA Science Center

CASA Status. Crystal Brogan (subsystem scientist) ASAC Meeting, March 9, 2010 Mitaka, Japan. NRAO/North American ALMA Science Center Status ASAC Meeting, March 9, 2010 Mitaka, Japan Crystal Brogan (subsystem scientist) NRAO/North American ALMA Science Center Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert

More information

Progress Report. Ian Evans On behalf of the Chandra Source Catalog Project Team. Chandra Users Committee Meeting October 25, 2010

Progress Report. Ian Evans On behalf of the Chandra Source Catalog Project Team. Chandra Users Committee Meeting October 25, 2010 Progress Report Ian Evans On behalf of the Chandra Source Catalog Project Team Chandra Users Committee Meeting October 25, 2010 Executive Summary Summary Catalog version 1.1 was released on 2010 Aug 10

More information