Virtual Observatory publication of interferometry simulations

Size: px
Start display at page:

Download "Virtual Observatory publication of interferometry simulations"

Transcription

1 Virtual Observatory publication of interferometry simulations Anita Richards, Paul Harrison JBCA, University of Manchester Francois Levrier LRA, ENS Paris Nicholas Walton, Eduardo Gonzalez-Solarez IoA, Cambridge p1

2 VO usage and brief explanation VO access to simulated data e.g. SKADS Simulated Skies (S3) How the VO query works (UK AstroGrid interface) Manipulate results in TopCat Compare with observed Deep Field On-the-fly interferometry image extraction Exchange data between analysis tools Publishing data to VOs: Metadata, Registry Data publishing tools from AstroGrid User scripting IVOA: Interoperability standards Useful links ALMA applications p2

3 3 SKADS Simulated Skies (S ) (thanks to Levrier; see Heywood talk) Semi-Analytic extragalactic Obreschkow et al. Semi-Empirical extragalactic Wilman et al. MN 2008 Radio-quiet AGN, FRI, FR2, SFG, SB 150, 610, 1400, 4860, MHz continuum HI cubes, clusters, halos... Continuum sensitivity 10 njy, z 20 ~300 million sources in 400 square degrees Web access to catalogues, images, cubes ox.ac.uk Tabular data published to VO More services, PULsar simulation under dev. p3

4 Central square degree of S-cubed SEX Radio-quiet AGN Normal galaxies FR I FR II Starburst p4 Courtesy of F. Levrier s-cubed.physics. ox.ac.uk

5 How the VO query works VO harvests data providers' standard descriptions Publishing registries at Cambs, CDS, HEASARC etc. VOExplorer searches Registry of resources Chose SKADS Simulated Sky Catalogues stored in database in Cambridge Content description contains 'SKA' and 'simulated' Browse/sort details of columns etc. User types query in SQL-like ADQL or uses tree GUI Query sent to database Results returned as standard xml-like VOTable Examine, process, convert to ascii e.g. in TopCat p5

6 AstroGrid 'desktop' access to S 3 VOExplorer Task Runner Search for 'SKA' - 53 data sets Refine: Content includes 'simulated' Select ADQL interface p6

7 AstroGrid 'desktop' access to S 3 VOExplorer Task Runner Execute Search for 'SKA' - 53 data sets query Refine: Content includes 'simulated' Find sub-mjy galaxies within 0.25 deg box Select ADQL interface Select * From sources as a where a.right_ascension> and a.i_151 < -3 p7 Validation/diagnostics

8 Manipulate results in TopCat Astronomical spreadsheet Co-ord/format conversions, maths, publishable plots... Scripting/library STILTS p8

9 Manipulate results in TopCat Astronomical spreadsheet Add ( , ) to RA, Co-ord/format conversions, maths, publishable plots... Dec to allow overlay on HDF(N) Scripting/library STILTS p9

10 Compare with observed Deep Field MERLIN+VLA HDF (GOODS North) on-line at JBCA (8.5 x 8.5) arcmin ~ 67 million pixels AstroGrid service extracts cut-outs at 0."2-2" resolution Similar to MERLINImager access to MERLIN Archive Calibrated visibility data imaged on demand Position Image size Resolution p10

11 MERLINImager User IVOA Registry No radio jargon nor domainspecific software Managed via AstroGrid Universal Worker Service Python wrapper to AIPS Download VOExplorer Task Launcher MERLINImager Position, size,, resoln, date AstroGrid UWS MERLIN archive RadioNet Parseltongue p11 Aladin, GAIA VOSpace FITS images VOTable description

12 Exchange data between analysis tools Send edited table (90 k sources) to Aladin from TopCat IVOA SAMP protocol lets applications communicate Use Aladin filter to plot simulated source sizes Load table of 92 publishedp12sources >40 Jy from Vizier Overlay on cut-out radio image

13 Aladin and TopCat Select point in Aladin Same point Simulations with ALMA Sep 2008 AMS Richards highlighted in TopCat Make new column on the fly Spectral index = (i_151 - i_18000)/log(18000/151) p13

14 Aladin and TopCat Select point in Aladin Same point Simulations with ALMA Sep 2008 AMS Richards highlighted in TopCat Make new column on the fly Spectral index = (i_151 - i_18000)/log(18000/151) p14

15 Publishing data to VOs: Descriptions VOTable METADATA Uniform Content Descriptors Data Models 'Simple' Image etc. Access Protocols S*AP: also *=Spectral Table Line... DATA Astronomical or description, URL for images etc. Ensure consistent queries and results p15

16 Publishing to VOs: Registry Publish standard description to Registry Service type, capabilities, content, waveband etc. Find data and services anywhere Database queries written in ADQL Translate at DB into local SQL dialect Or simple cone seach p16

17 Publishing to VOs: Registry Publish standard description to Registry Service type, capabilities, content, waveband etc. Find data and services anywhere Database queries written in ADQL Translate at DB into local SQL dialect Or simple cone seach p17

18 Publishing to VOs cont. courtesy Nic Walton p18

19 Data publishing tools from AstroGrid Data Set Access (DSA) Translates between VO protocols and common DBs Universal Worker Service (ex-cea) Manages web services (Tomcat) Wrap any command-line script Pass parameters from GUI or other UI Returns results as appropriate Directly to user's cache Via VOTable description + URLs for bulky data User side Astro Runtime API for Desktop & scripting Enables SAMP (Plastic) message passing p19

20 User-scripted workflows Astro Runtime provides environment Easiest/commonest for Python Download AstroGrid module Full documentation and examples Search Registry for data or tools Send queries Manipulate results Use Stilts library to work on VOTables Use your own local programs Launch PLASTICised display packages Also available for java, IDL etc. (in progress) p20

21 User-scripted workflows Astro Runtime provides environment Easiest/commonest for Python Download AstroGrid module Full documentation and examples Search Registry for data or tools Send queries Manipulate results Use Stilts library to work on VOTables Use your own local programs Launch PLASTICised display packages Also available for java, IDL etc. (in progress) p21

22 IVOA: Interoperability Standards The International Virtual Observatory Alliance Forum for national/continental VOs Projects represent astronomy data & service providers Forum for interoperability standards VO projects build on these standards Bi-annual meetings Mailing lists p22

23 VO links AstroGrid On-line help, downloads AstroGrid services to enable VO data publishing EuroVO, AIDA Tools to organise metadata, construct registry entries Workshops, possible local support International Virtual Observatory Alliance Documents, xml schemata, discussion/development WGs incl. Data Access, Applications, Theory... p23

24 ALMA applications ALMA data 'VO compatible' ALMA SDM v. VO data models? Start with simplest end-products 'Josie astronomer' use cases Remote user-steered pipelines? VO spectral line standards under development Simulations of general interest Planning observations Analysing data Ideas from this workshop: TopCat convert tables to CC? SAMP for ALMASimmos ObsPrep? Extract/refine FITS metadata > DB p24 Peretto et al 2007 Star formation with varying turbulence

What might astronomers want? Flexible data products and remotely-steered pipelines

What might astronomers want? Flexible data products and remotely-steered pipelines What might astronomers want? Flexible data products and remotely-steered pipelines Anita Richards AstroGrid / ALMA Regional Centre JBCA, University of Manchester thanks to e-merlin, ALMA, RadioNet ALBiUS

More information

Usage of the Astro Runtime

Usage of the Astro Runtime A PPARC funded project Usage of the Astro Runtime Noel Winstanley nw@jb.man.ac.uk AstroGrid, Jodrell Bank, UK AstroGrid Workbench A Rich GUI Client for the VO http://www.astrogrid.org/desktop Workbench

More information

The Astro Runtime. for data access. Noel Winstanley Jodrell Bank, AstroGrid. with the part of Noel played by John Taylor, IfA Edinburgh/AstroGrid

The Astro Runtime. for data access. Noel Winstanley Jodrell Bank, AstroGrid. with the part of Noel played by John Taylor, IfA Edinburgh/AstroGrid A PPARC funded project The Astro Runtime for data access Noel Winstanley Jodrell Bank, AstroGrid with the part of Noel played by John Taylor, IfA Edinburgh/AstroGrid The Astro Runtime uniform access to

More information

Exploiting Virtual Observatory and Information Technology: Techniques for Astronomy

Exploiting Virtual Observatory and Information Technology: Techniques for Astronomy Exploiting Virtual Observatory and Information Technology: Techniques for Astronomy Nicholas Walton AstroGrid Project Scientist Institute of Astronomy, The University of Cambridge Lecture #3 Goal: Applications

More information

Technology for the Virtual Observatory. The Virtual Observatory. Toward a new astronomy. Toward a new astronomy

Technology for the Virtual Observatory. The Virtual Observatory. Toward a new astronomy. Toward a new astronomy Technology for the Virtual Observatory BRAVO Lecture Series, INPE, Brazil July 23-26, 2007 1. Virtual Observatory Summary 2. Service Architecture and XML 3. Building and Using Services 4. Advanced Services

More information

THE EUCLID ARCHIVE SYSTEM: A DATA-CENTRIC APPROACH TO BIG DATA

THE EUCLID ARCHIVE SYSTEM: A DATA-CENTRIC APPROACH TO BIG DATA THE EUCLID ARCHIVE SYSTEM: A DATA-CENTRIC APPROACH TO BIG DATA Rees Williams on behalf of A.N.Belikov, D.Boxhoorn, B. Dröge, J.McFarland, A.Tsyganov, E.A. Valentijn University of Groningen, Groningen,

More information

New VO-Related Features in TOPCAT

New VO-Related Features in TOPCAT New VO-Related Features in TOPCAT Mark Taylor (AstroGrid, Bristol) IVOA Interop Meeting, ESO 9 November 2009 $Id: tcvo.tex,v 1.12 2009/11/02 15:07:07 mbt Exp $ Mark Taylor, IVOA Interop, ESO, Garching,

More information

VIRTUAL OBSERVATORY TECHNOLOGIES

VIRTUAL OBSERVATORY TECHNOLOGIES VIRTUAL OBSERVATORY TECHNOLOGIES / The Johns Hopkins University Moore s Law, Big Data! 2 Outline 3 SQL for Big Data Computing where the bytes are Database and GPU integration CUDA from SQL Data intensive

More information

THE EUCLID ARCHIVE SYSTEM: A DATA-CENTRIC APPROACH TO BIG DATA

THE EUCLID ARCHIVE SYSTEM: A DATA-CENTRIC APPROACH TO BIG DATA THE EUCLID ARCHIVE SYSTEM: A DATA-CENTRIC APPROACH TO BIG DATA Sara Nieto on behalf of B.Altieri, G.Buenadicha, J. Salgado, P. de Teodoro European Space Astronomy Center, European Space Agency, Spain O.R.

More information

Euclid Archive Science Archive System

Euclid Archive Science Archive System Euclid Archive Science Archive System Bruno Altieri Sara Nieto, Pilar de Teodoro (ESDC) 23/09/2016 Euclid Archive System Overview The EAS Data Processing System (DPS) stores the data products metadata

More information

Tutorial "Gaia in the CDS services" Gaia data Heidelberg June 19, 2018 Sébastien Derriere (adapted from Thomas Boch)

Tutorial Gaia in the CDS services Gaia data Heidelberg June 19, 2018 Sébastien Derriere (adapted from Thomas Boch) Tutorial "Gaia in the CDS services" Gaia data workshop @ Heidelberg June 19, 2018 Sébastien Derriere (adapted from Thomas Boch) Each section (numbered 1. to 6.) can be done independently. 1. Explore Gaia

More information

Grid computing with IVOA standards and VOTech components

Grid computing with IVOA standards and VOTech components Grid computing with IVOA standards and VOTech components Nic Walton & Guy Rixon (IoA, Cambridge) Based on presentation to Euro-VO DCA Workshop Grid and the Virtual Observatory Garching, April 2008 Topics

More information

Design and Implementation of the Japanese Virtual Observatory (JVO) system Yuji SHIRASAKI National Astronomical Observatory of Japan

Design and Implementation of the Japanese Virtual Observatory (JVO) system Yuji SHIRASAKI National Astronomical Observatory of Japan Design and Implementation of the Japanese Virtual Observatory (JVO) system Yuji SHIRASAKI National Astronomical Observatory of Japan 1 Introduction What can you do on Japanese Virtual Observatory (JVO)?

More information

Europlanet IDIS: Adapting existing VO building blocks to Planetary Sciences

Europlanet IDIS: Adapting existing VO building blocks to Planetary Sciences Europlanet IDIS: Adapting existing VO building blocks to Planetary Sciences B. Cecconi, LESIA, Observatoire de Paris, France Cospar-2012, Mysore EPN/IDIS Building a planetary VO prototype VO = Virtual

More information

Astrophysics and the Grid: Experience with EGEE

Astrophysics and the Grid: Experience with EGEE Astrophysics and the Grid: Experience with EGEE Fabio Pasian INAF & VObs.it IVOA 2007 Interoperability Meeting Astro-RG session INAF experience with the grid (from the IVOA 2006 Interop): In INAF there

More information

VAPE Virtual observatory Aided Publishing for Education

VAPE Virtual observatory Aided Publishing for Education VAPE Virtual observatory Aided Publishing for Education http://ia2-edu.oats.inaf.it:8080/vape VAPE is an application for the publication of educational data in the Virtual Observatory (VO). VAPE has been

More information

The NOAO Data Lab Design, Capabilities and Community Development. Michael Fitzpatrick for the Data Lab Team

The NOAO Data Lab Design, Capabilities and Community Development. Michael Fitzpatrick for the Data Lab Team The NOAO Data Lab Design, Capabilities and Community Development Michael Fitzpatrick for the Data Lab Team What is it? Data Lab is Science Exploration Platform that provides:! Repository for large datasets

More information

Access to Multidimensional (Cube) Data in the VO

Access to Multidimensional (Cube) Data in the VO Access to Multidimensional (Cube) Data in the VO Use Cases, Analysis, and Architecture PREPARED BY ORGANIZATION DATE Douglas Tody NRAO April 15, 2013 Arnold Rots SAO Bruce Berriman IPAC Mark Cresitello-Dittmar

More information

Progress Report. Ian Evans On behalf of the Chandra Source Catalog Project Team. Chandra Users Committee Meeting October 25, 2010

Progress Report. Ian Evans On behalf of the Chandra Source Catalog Project Team. Chandra Users Committee Meeting October 25, 2010 Progress Report Ian Evans On behalf of the Chandra Source Catalog Project Team Chandra Users Committee Meeting October 25, 2010 Executive Summary Summary Catalog version 1.1 was released on 2010 Aug 10

More information

Large Scale Data Management of Astronomical Surveys with AstroSpark

Large Scale Data Management of Astronomical Surveys with AstroSpark Large Scale Data Management of Astronomical Surveys with AstroSpark Mariem BRAHEM 1,2, Karine ZEITOUNI 1, Laurent YEH 1 (1) DAVID Lab University of Versailles (2) CNES Centre National d Etudes Spatiale

More information

IVOA and European VO Efforts Status and Plans

IVOA and European VO Efforts Status and Plans IVOA and European VO Efforts Status and Plans Fabio Pasian AstroInformatics2010, Pasadena CA, 16-19 June 2010 The IVOA: http://ivoa.net Mission: To facilitate the international coordination and collaboration

More information

Virtual Observatory Tools. Khadija EL Bouchefry

Virtual Observatory Tools. Khadija EL Bouchefry Virtual Observatory Tools Khadija EL Bouchefry AVN School -HartRAO- Feb 22, 2016 The Virtual Observatory VO What it the Virtual Observatory? What are VO tools? How can we use VO tools (for our Own research)

More information

The Radio Astronomer s IT Toolkit

The Radio Astronomer s IT Toolkit The Radio Astronomer s IT Toolkit Tara Murphy Sydney Institute for Astronomy School of Information Technologies The University of Sydney 27th September 2010 Introduction IT Toolkit Scripting I Scripting

More information

Prototype. Towards an AVO Interoperability. Mark Allen Françoise Genova CDS & the AVO Work Area 2 team:

Prototype. Towards an AVO Interoperability. Mark Allen Françoise Genova CDS & the AVO Work Area 2 team: Towards an AVO Interoperability Prototype Mark Allen Françoise Genova CDS & the AVO Work Area 2 team: C. Arviset (ESA) P. Didelon (SAP/Terapix) S. Garrington (Jodrell Bank) R. Mann (ROE) A. Micol (ESO-ECF)

More information

Case Study: CyberSKA - A Collaborative Platform for Data Intensive Radio Astronomy

Case Study: CyberSKA - A Collaborative Platform for Data Intensive Radio Astronomy Case Study: CyberSKA - A Collaborative Platform for Data Intensive Radio Astronomy Outline Motivation / Overview Participants / Industry Partners Documentation Architecture Current Status and Services

More information

v1.4, 7/1/2017 EPN-TAP services: Virtis / Venus Express demo S. Erard, B. Cecconi, P. Le Sidaner, F. Henry, R. Savalle, C. Chauvin

v1.4, 7/1/2017 EPN-TAP services: Virtis / Venus Express demo S. Erard, B. Cecconi, P. Le Sidaner, F. Henry, R. Savalle, C. Chauvin v1.4, 7/1/2017 EPN-TAP services: Virtis / Venus Express demo S. Erard, B. Cecconi, P. Le Sidaner, F. Henry, R. Savalle, C. Chauvin Go to VESPA web site http://vespa.obspm.fr - Check "All VO" to access

More information

The Virtual Observatory and the IVOA

The Virtual Observatory and the IVOA The Virtual Observatory and the IVOA The Virtual Observatory Emergence of the Virtual Observatory concept by 2000 Concerns about the data avalanche, with in mind in particular very large surveys such as

More information

EPN-TAP services : VIRTIS-VENUS EXPRESS

EPN-TAP services : VIRTIS-VENUS EXPRESS EPN-TAP services : VIRTIS-VENUS EXPRESS Virtis / Venus Express demo Authors Change Log Steps Reference Authors S. Erard, B. Cecconi, P. Le Sidaner, F. Henry, R. Savalle, C. Chauvin Change Log Version Name

More information

Common Interface for Astronomical Data Service

Common Interface for Astronomical Data Service Common Interface for Astronomical Data Service Yuji Shirasaki National Astronomical Observatory of Japan, JVO VOQL+DAL Joint session Objective of this talk Contents Concept for adapting ADQL query interface

More information

v1.0, 18/3/2017 EPN-TAP services: Spectroscopy S. Erard, B. Cecconi, P. Le Sidaner, C. Chauvin

v1.0, 18/3/2017 EPN-TAP services: Spectroscopy S. Erard, B. Cecconi, P. Le Sidaner, C. Chauvin v1.0, 18/3/2017 EPN-TAP services: Spectroscopy S. Erard, B. Cecconi, P. Le Sidaner, C. Chauvin Go to VESPA web site http://vespa.obspm.fr - Check "All VO" to access public data services - Enter search

More information

The Virtual Observatory in Australia Connecting to International Initiatives. Peter Lamb. CSIRO Mathematical & Information Sciences

The Virtual Observatory in Australia Connecting to International Initiatives. Peter Lamb. CSIRO Mathematical & Information Sciences The Virtual Observatory in Australia Connecting to International Initiatives Peter Lamb CSIRO Mathematical & Information Sciences The Grid & escience Convergence of high-performance computing, huge data

More information

ALMA REMOTE MINING EXPERIMENT ARTEMIX. Yaye Awa Ba, Philippe. Salomé, Michel. Caillat (LERMA) with credits to : L. Loria, N.

ALMA REMOTE MINING EXPERIMENT ARTEMIX. Yaye Awa Ba, Philippe. Salomé, Michel. Caillat (LERMA) with credits to : L. Loria, N. ALMA REMOTE MINING EXPERIMENT Yaye Awa Ba, Philippe. Salomé, Michel. Caillat (LERMA) with credits to : L. Loria, N. Kasradze Archive and Data Mining Goals (i) Search by products not by instrumental configuration

More information

CDS. André Schaaff1, François-Xavier Pineau1, Gilles Landais1, Laurent Michel2 de Données astronomiques de Strasbourg, 2SSC-XMM-Newton

CDS. André Schaaff1, François-Xavier Pineau1, Gilles Landais1, Laurent Michel2 de Données astronomiques de Strasbourg, 2SSC-XMM-Newton Docker @ CDS André Schaaff1, François-Xavier Pineau1, Gilles Landais1, Laurent Michel2 1Centre de Données astronomiques de Strasbourg, 2SSC-XMM-Newton Paul Trehiou Université de technologie de Belfort-Montbéliard

More information

The Programmable Telescope

The Programmable Telescope The Programmable Telescope Tim Cornwell ASKAP Computing Lead New generation of radio telescopes Flourishing around the world Atacama Large Millimetre Array (ALMA) Expanded Very Large Array (EVLA) Square

More information

Exploring the Handling of Light Curves in VO tools. Petr Škoda. Jiří Nádvorník, David Andrešič

Exploring the Handling of Light Curves in VO tools. Petr Škoda. Jiří Nádvorník, David Andrešič Exploring the Handling of Light Curves in VO tools Petr Škoda Astronomical Institute, Czech Academy of Sciences Ondřejov Jiří Nádvorník, Faculty of Information Technology Czech Technical University, Prague

More information

TAP services integration at IA2 data center

TAP services integration at IA2 data center TAP services integration at IA2 data center Pietro Apollo INAF - Astronomical Observatory of Trieste Outline IA2TAP: TAP implementation 2 + 1 + 1 services TapSchemaManager: Summary a supporting web application

More information

Focus Session on Multi-dimensional Data

Focus Session on Multi-dimensional Data Focus Session on Multi-dimensional Data Introduction Mark Allen, Joe Lazio IVOA Interoperability Meeting, ESAC, Madrid, May 20, 2014 CoSADIE Project Science Priority Areas Multi-dimensional Data image:

More information

Packaging VO applications for Debian

Packaging VO applications for Debian Packaging VO applications for Debian Status and outlook Ole Streicher olebole@debian.org, ole@aip.de Shanghai, 2017-05-16 Ole Streicher (AIP Potsdam) Packaging VO applications for Debian Shanghai, 2017-05-16

More information

Query driven visualization of large scale multi-dimensional astronomical catalogs Buddelmeijer, Hugo

Query driven visualization of large scale multi-dimensional astronomical catalogs Buddelmeijer, Hugo University of Groningen Query driven visualization of large scale multi-dimensional astronomical catalogs Buddelmeijer, Hugo IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's

More information

P Structured Query Language for Virtual Observatory

P Structured Query Language for Virtual Observatory P1.1.23 Structured Query Language for Virtual Observatory Yuji Shirasaki National Astronomical Observatory of Japan, and Masahiro Tanaka (NAOJ), Satoshi Honda (NAOJ), Yoshihiko Mizumoto (NAOJ), Masatoshi

More information

Hands-on tutorial on usage the Kepler Scientific Workflow System

Hands-on tutorial on usage the Kepler Scientific Workflow System Hands-on tutorial on usage the Kepler Scientific Workflow System (including INDIGO-DataCloud extension) RIA-653549 Michał Konrad Owsiak (@mkowsiak) Poznan Supercomputing and Networking Center michal.owsiak@man.poznan.pl

More information

Use case: mapping sparse spatial data with TOPCAT

Use case: mapping sparse spatial data with TOPCAT Use case: mapping sparse spatial data with TOPCAT This use case describes a workflow related to large hyperspectral datasets. In this example you will use data from the VIRTIS/Rosetta experiment and study

More information

Daiquiri an VO ready solution for medium size data providers. Anastasia Galkin Jochen Klar Gal Matievic Harry Enke

Daiquiri an VO ready solution for medium size data providers. Anastasia Galkin Jochen Klar Gal Matievic Harry Enke Daiquiri an VO ready solution for medium size data providers Anastasia Galkin Jochen Klar Gal Matievic Harry Enke Asterics data provider forum, 27.06.2018 Daiquiri A framework for the publication of scientific

More information

Drowning in Data : VO to the rescue

Drowning in Data : VO to the rescue Drowning in Data : VO to the rescue A. Lawrence Institute for Astronomy, University of Edinburgh, Royal Observatory, Blackford Hill, Edinburgh EH9 3HJ, U.K.. (Scottish Universities Physics Alliance : SUPA)

More information

Structured Query Language for Virtual Observatory

Structured Query Language for Virtual Observatory Astronomical Data Analysis Software and Systems XIV ASP Conference Series, Vol. XXX, 2005 P. L. Shopbell, M. C. Britton, and R. Ebert, eds. P1-1-23 Structured Query Language for Virtual Observatory Yuji

More information

uws-client A command-line tool for UWS services Kristin Riebe GAVO, AIP 1 / 18

uws-client A command-line tool for UWS services Kristin Riebe GAVO, AIP 1 / 18 uws-client A command-line tool for UWS services Kristin Riebe GAVO, AIP 1 / 18 UWS Universal Worker Service VO standard: http://www.ivoa.net/documents/uws/; latest development version on Volute-repository:

More information

A VOSpace deployment: interoperability and integration in big infrastructure

A VOSpace deployment: interoperability and integration in big infrastructure ASTERICS DADI ESFRI Forum A VOSpace deployment: interoperability and integration in big infrastructure S. Bertocco Trieste 13-14 December 2017 Scope Provide our users with a local data storage and computation

More information

Theoretical Models in the Virtual Observatory

Theoretical Models in the Virtual Observatory Theoretical Models in the Virtual Observatory C. Rodrigo and E. Solano Abstract Although full interoperativity between theoretical and observational data in the framework of the Virtual Observatory would

More information

ALMA Software development. George KOSUGI: NAOJ, ALMA ICT-EA Manager

ALMA Software development. George KOSUGI: NAOJ, ALMA ICT-EA Manager ALMA Software development George KOSUGI: NAOJ, ALMA ICT-EA Manager Contents ALMA Software Developments in EU (ESO) ALMA Software Developments in NA (NRAO) ALMA+ Software Developments in EA (NAOJ) Development

More information

Extending the SDSS Batch Query System to the National Virtual Observatory Grid

Extending the SDSS Batch Query System to the National Virtual Observatory Grid Extending the SDSS Batch Query System to the National Virtual Observatory Grid María A. Nieto-Santisteban, William O'Mullane Nolan Li Tamás Budavári Alexander S. Szalay Aniruddha R. Thakar Johns Hopkins

More information

SIA V2 Analysis, Scope and Concepts. Alliance. Author(s): D. Tody (ed.), F. Bonnarel, M. Dolensky, J. Salgado (others TBA in next version)

SIA V2 Analysis, Scope and Concepts. Alliance. Author(s): D. Tody (ed.), F. Bonnarel, M. Dolensky, J. Salgado (others TBA in next version) International Virtual Observatory Alliance Simple Image Access Protocol V2 Analysis, Scope and Concepts Version 0.2 IVOA Note 2008 October 24 This version: ThisVersion-YYYYMMDD Latest version: http://www.ivoa.net/documents/latest/latest-version-name

More information

The Portal Aspect of the LSST Science Platform. Gregory Dubois-Felsmann Caltech/IPAC. LSST2017 August 16, 2017

The Portal Aspect of the LSST Science Platform. Gregory Dubois-Felsmann Caltech/IPAC. LSST2017 August 16, 2017 The Portal Aspect of the LSST Science Platform Gregory Dubois-Felsmann Caltech/IPAC LSST2017 August 16, 2017 1 Purpose of the LSST Science Platform (LSP) Enable access to the LSST data products Enable

More information

Gaia Catalogue and Archive Plans and Status

Gaia Catalogue and Archive Plans and Status Gaia Catalogue and Archive Plans and Status 29 June 2009 AS Gaia, Besançon William O Mullane Gaia Science Operations Development Manager Madrid 1 A little background Already heard about the Satellite from

More information

A RESTful catalog for simulations

A RESTful catalog for simulations Mem. S.A.It. Vol. 80, 365 c SAIt 2009 Memorie della A RESTful catalog for simulations R. Wagner Center for Astrophysics and Space Sciences, University of California at San Diego, La Jolla, CA 92093, e-mail:

More information

Spitzer Heritage Archive

Spitzer Heritage Archive Spitzer Heritage Archive Xiuqin Wu, Trey Roby, Loi Ly IRSA/SSC, California Institute of Technology, 100-22, Pasadena, CA, USA ABSTRACT The Spitzer Heritage Archive 1 will host all the raw and final reprocessed

More information

Building on Existing Communities: the Virtual Astronomical Observatory (and NIST)

Building on Existing Communities: the Virtual Astronomical Observatory (and NIST) Building on Existing Communities: the Virtual Astronomical Observatory (and NIST) Robert Hanisch Space Telescope Science Institute Director, Virtual Astronomical Observatory Data in astronomy 2 ~70 major

More information

VO TOOLS VARIETY IS THE SPICE OF VO LIFE. Pedro Osuna ESA-VO Research and Scientific Support Department European Space Agency

VO TOOLS VARIETY IS THE SPICE OF VO LIFE. Pedro Osuna ESA-VO Research and Scientific Support Department European Space Agency 85 VO TOOLS VARIETY IS THE SPICE OF VO LIFE Pedro Osuna ESA-VO Research and Scientific Support Department European Space Agency ABSTRACT The VO realm allows building of different clients to support the

More information

CDS X-match service API

CDS X-match service API CDS X-match service API François-Xavier Pineau 1, Thomas Boch 1 1 CDS, Observatoire Astronomique de Strasbourg IVOA Interop, Heidelberg François-Xavier Pineau (CDS) CDS X-match API 14/05/2013 1 / 9 Intro

More information

Spectra & images in VizieR. Gilles Landais (CDS) Laurent Michel (OAS) Pierre Ocvirk (CDS)

Spectra & images in VizieR. Gilles Landais (CDS) Laurent Michel (OAS) Pierre Ocvirk (CDS) Spectra & images in VizieR Gilles Landais (CDS) Laurent Michel (OAS) Pierre Ocvirk (CDS) G.Landais (CDS) IVOA Capetown, 2016 Introduction An indexation service dedicated for associated data spectra, images,

More information

ASKAP Pipeline processing and simulations. Dr Matthew Whiting ASKAP Computing, CSIRO May 5th, 2010

ASKAP Pipeline processing and simulations. Dr Matthew Whiting ASKAP Computing, CSIRO May 5th, 2010 ASKAP Pipeline processing and simulations Dr Matthew Whiting ASKAP Computing, CSIRO May 5th, 2010 ASKAP Computing Team Members Team members Marsfield: Tim Cornwell, Ben Humphreys, Juan Carlos Guzman, Malte

More information

DSpace Fedora. Eprints Greenstone. Handle System

DSpace Fedora. Eprints Greenstone. Handle System Enabling Inter-repository repository Access Management between irods and Fedora Bing Zhu, Uni. of California: San Diego Richard Marciano Reagan Moore University of North Carolina at Chapel Hill May 18,

More information

A.J. Faulkner K. Zarb-Adami

A.J. Faulkner K. Zarb-Adami AJ Faulkner K Zarb-Adami March 2015 LFAA LMC - Trieste Andrew Faulkner Kris Zarb-Adami SKA1-low requirements (after RBS) Frequency: 50MHz 350MHz Scan angle: >45 Bandwidth: 300MHz # of beams: >5 Sensitivity

More information

The Canadian CyberSKA Project

The Canadian CyberSKA Project The Canadian CyberSKA Project A. G. Willis (on behalf of the CyberSKA Project Team) National Research Council of Canada Herzberg Institute of Astrophysics Dominion Radio Astrophysical Observatory May 24,

More information

1 INTRODUCTION ABSTRACT

1 INTRODUCTION ABSTRACT The NOAO Data Laboratory: A conceptual overview Michael J. Fitzpatrick *, Knut Olsen, Frossie Economou, Elizabeth B. Stobie, T.C. Beers, Mark Dickinson, Patrick Norris, Abi Saha, Robert Seaman, David R.

More information

Velocity Cubes of Galaxies Discover /Propose /Extract SIAv2 /DataLink /AccessData

Velocity Cubes of Galaxies Discover /Propose /Extract SIAv2 /DataLink /AccessData Velocity Cubes of Galaxies Discover /Propose /Extract SIAv2 /DataLink /AccessData User Experience on Prototype Implementation José Enrique Ruiz Instituto de Astrofísica de Andalucía CSIC Fall 2014 IVOA

More information

NASA and International Open Standards and the Future of Space Weather Studies

NASA and International Open Standards and the Future of Space Weather Studies NASA and International Open Standards and the Future of Space Weather Studies D. Aaron Roberts NASA Goddard Space Flight Center ISWI2017, 4 August 2107 Virtual Observatory A virtual observatory is

More information

WIRR. Florian Rothmaier, Markus Demleitner. Zentrum für Astronomie Heidelberg. IVOA Interop, Madrid, May 18-23

WIRR. Florian Rothmaier, Markus Demleitner. Zentrum für Astronomie Heidelberg. IVOA Interop, Madrid, May 18-23 WIRR Florian Rothmaier, Markus Demleitner Zentrum für Astronomie Heidelberg IVOA Interop, Madrid, May 18-23 F. Rothmaier, M. Demleitner (ZAH) WIRR 2014-05-22 1 / 21 Outline 1 Introduction to WIRR 2 WIRR

More information

CSIRO ASKAP Science Data Archive CSIRO ASTRONOMY AND SPACE SCIENCE (CASS)

CSIRO ASKAP Science Data Archive CSIRO ASTRONOMY AND SPACE SCIENCE (CASS) CSIRO ASKAP Science Data Archive CSIRO ASTRONOMY AND SPACE SCIENCE (CASS) Jessica Chapman, ATUC Meeting, 5 December 2013 CSIRO ASKAP Science Data Archive (CASDA) Talk outline A: CASDA overview and timeline

More information

Collaborative Editing and Linking of Astronomy Vocabularies Using Semantic Mediawiki

Collaborative Editing and Linking of Astronomy Vocabularies Using Semantic Mediawiki Collaborative Editing and Linking of Astronomy Vocabularies Using Semantic Mediawiki Stuart Chalmers 1, Norman Gray 2, Iadh Ounis 1, and Alasdair Gray 3 1 Computing Science, University of Glasgow, Glasgow,

More information

Technological Challenges in the GAIA Archive

Technological Challenges in the GAIA Archive Technological Challenges in the GAIA Archive Juan Gonzalez jgonzale at sciops.esa.int Jesus Salgado jsalgado at sciops.esa.int ESA Science Archives Team IVOA Interop 2013, Heidelberg May 2013 Presentation

More information

DAME Web Application REsource Plugin Creator User Manual

DAME Web Application REsource Plugin Creator User Manual DAME Web Application REsource Plugin Creator User Manual DAMEWARE-MAN-NA-0016 Issue: 2.1 Date: March 20, 2014 Authors: S. Cavuoti, A. Nocella, S. Riccardi, M. Brescia Doc. : ModelPlugin_UserManual_DAMEWARE-MAN-NA-0016-Rel2.1

More information

Query driven visualization of astronomical catalogs

Query driven visualization of astronomical catalogs Exp Astron (2013) 35:283 300 DOI 10.1007/s10686-011-9263-0 ORIGINAL ARTICLE Query driven visualization of astronomical catalogs Hugo Buddelmeijer Edwin A. Valentijn Received: 8 August 2011 / Accepted:

More information

Archives Building System Infrastructure: Re-engineering ESA Space Based Missions' Archives ABSTRACT

Archives Building System Infrastructure: Re-engineering ESA Space Based Missions' Archives ABSTRACT Archives Building System Infrastructure: Re-engineering ESA Space Based Missions' Archives P. Osuna (1), J. Salgado (1), I. Ortiz (1), C. Arviset (1) (1) ESA-ESAC PoBox 78, 28691 Villanueva de la Cañada,

More information

SKA Regional Centre Activities in Australasia

SKA Regional Centre Activities in Australasia SKA Regional Centre Activities in Australasia Dr Slava Kitaeff CSIRO-ICRAR APSRC Project Engineer ERIDANUS National Project Lead Why SKA Regional Centres? SKA 1 Observatory Compute capacity: 100 Pflops

More information

chinaxiv: v1

chinaxiv: v1 SkyMouse: A smart interface for astronomical on-line resources and services Chen-Zhou CUI 1, Hua-Ping SUN 1, Yong-Heng ZHAO 1, Yu LUO 1, Da-Zhi QI 2 1. National Astronomical Observatories, Chinese Academy

More information

SDP Science Pipeline Management Use Case View

SDP Science Pipeline Management Use Case View SDP Science Pipeline Management Use Case View M. Ashdown TABLE OF CONTENTS 1. Primary Representation 2 2. Element Catalogue 2 2.1. Elements and Their Properties 2 2.1.1 Science Operations 2 2.1.3 Manage

More information

VO-CLOUD for Machine Learning. Petr Škoda. Lukáš Lopatovský, Andrej Palička, Lumír Mrkva Faculty of Informatics, Czech Technical University, Prague

VO-CLOUD for Machine Learning. Petr Škoda. Lukáš Lopatovský, Andrej Palička, Lumír Mrkva Faculty of Informatics, Czech Technical University, Prague VO-CLOUD for Machine Learning Petr Škoda Astronomical Institute Academy of Sciences Ondřejov Czech Republic Lukáš Lopatovský, Andrej Palička, Lumír Mrkva Faculty of Informatics, Czech Technical University,

More information

ESO Reflex (FinReflex)

ESO Reflex (FinReflex) ESO Reflex (FinReflex) A Graphical Workflow Engine for Data Reduction Tero Oittinen Observatory, University of Helsinki The Sampo Team CSC - Scientific Computing Ltd Observatory, University of Helsinki

More information

Data federations and its applications

Data federations and its applications Data federations and its applications Edwin A. Valentijn Prof Astronomical Information Technology Target- OmegaCEN Kapteyn 20 Oktober 2016 IAU Symp. Astro Informatics Sorrento Astro-WISE Data federations

More information

CloudMan cloud clusters for everyone

CloudMan cloud clusters for everyone CloudMan cloud clusters for everyone Enis Afgan usecloudman.org This is accessibility! But only sometimes So, there are alternatives BUT WHAT IF YOU WANT YOUR OWN, QUICKLY The big picture A. Users in different

More information

MATLAB. Senior Application Engineer The MathWorks Korea The MathWorks, Inc. 2

MATLAB. Senior Application Engineer The MathWorks Korea The MathWorks, Inc. 2 1 Senior Application Engineer The MathWorks Korea 2017 The MathWorks, Inc. 2 Data Analytics Workflow Business Systems Smart Connected Systems Data Acquisition Engineering, Scientific, and Field Business

More information

ESA Science Archives Architecture Evolution. Iñaki Ortiz de Landaluce Science Archives Team 13 th Sept 2013

ESA Science Archives Architecture Evolution. Iñaki Ortiz de Landaluce Science Archives Team 13 th Sept 2013 ESA Science Archives Architecture Evolution Iñaki Ortiz de Landaluce Science Archives Team 13 th Sept 2013 Outline Introduction: ESA Science Archives Archives Architecture Evolution User Interfaces and

More information

Chapter 18: Web-based Tools NED VO Services

Chapter 18: Web-based Tools NED VO Services The National Virtual Observatory Book ASP Conference Series, Vol. 382, 2008 M. J. Graham, M. J. Fitzpatrick, and T. A. McGlynn, eds. Chapter 18: Web-based Tools NED VO Services Joseph M. Mazzarella (and

More information

Simple Spectral Access Protocol V1.1. Virtual. Alliance

Simple Spectral Access Protocol V1.1. Virtual. Alliance International Virtual Observatory Alliance Simple Spectral Access Protocol Version 1.1 IVOA Recommendation, February 10 2012 This version: http://www.ivoa.net/documents/ssa Latest version: http://www.ivoa.net/documents/latest/ssa.html

More information

ASKAP Data Flow ASKAP & MWA Archives Meeting

ASKAP Data Flow ASKAP & MWA Archives Meeting ASKAP Data Flow ASKAP & MWA Archives Meeting Ben Humphreys ASKAP Software and Computing Project Engineer 25 th March 2013 ASTRONOMY AND SPACE SCIENCE ASKAP @ Murchison Radioastronomy Observatory Australian

More information

Existing Tools in HEP and Particle Astrophysics

Existing Tools in HEP and Particle Astrophysics Existing Tools in HEP and Particle Astrophysics Richard Dubois richard@slac.stanford.edu R.Dubois Existing Tools in HEP and Particle Astro 1/20 Outline Introduction: Fermi as example user Analysis Toolkits:

More information

Introduction CASA. Radio Interferometry. Anita Richards. with thanks to. rest of the CASA teams. UK ALMA Regional Centre

Introduction CASA. Radio Interferometry. Anita Richards. with thanks to. rest of the CASA teams. UK ALMA Regional Centre Radio Interferometry Introduction to packages and formats CASA Anita Richards with thanks to Anita Dirk PetryRichards (ESO) and the UK ALMA Regional Centre rest of the CASA teams JBCA, University of Manchester

More information

getdata Implementation in SPLAT-VO

getdata Implementation in SPLAT-VO getdata Implementation in SPLAT-VO Margarida Castro Neves IVOA INTEROP Heidelberg, May 2013 SPLAT-VO up to now SPLAT is a graphical tool for displaying, comparing, modifying and analysing astronomical

More information

Designing the Future Data Management Environment for [Radio] Astronomy. JJ Kavelaars Canadian Astronomy Data Centre

Designing the Future Data Management Environment for [Radio] Astronomy. JJ Kavelaars Canadian Astronomy Data Centre Designing the Future Data Management Environment for [Radio] Astronomy JJ Kavelaars Canadian Astronomy Data Centre 2 Started working in Radio Data Archiving as Graduate student at Queen s in 1993 Canadian

More information

What s New in MATLAB May 16, 2017

What s New in MATLAB May 16, 2017 What s New in MATLAB May 16, 2017 2017 The MathWorks, Inc. 1 Agenda MATLAB Foundation Working with Data Building & Sharing MATLAB Applications Application Specific Enhancements Summary and Wrap-up 2 Agenda

More information

IVOA Spectral Energy Distribution (SED) Data Model

IVOA Spectral Energy Distribution (SED) Data Model International Virtual Observatory Alliance IVOA Spectral Energy Distribution (SED) Data Model Version 1.0 IVOA Working Draft, 2012 October 15 This version: WD-SEDDM-1.0-20121015 Previous version(s): http://www.ivoa.net/internal/ivoa/interopmay2011sed/seddm-20110515.pdf

More information

Data Processing for the Square Kilometre Array Telescope

Data Processing for the Square Kilometre Array Telescope Data Processing for the Square Kilometre Array Telescope Streaming Workshop Indianapolis th October Bojan Nikolic Astrophysics Group, Cavendish Lab University of Cambridge Email: b.nikolic@mrao.cam.ac.uk

More information

HiPS IVOA standard process

HiPS IVOA standard process IVOA standard process Interop may 2016 Cape Town South Africa Presented by Thomas Boch [CDS] Daniel Durand [CADC] Plan 1) Recap on 2) State of the art 3) Network 4) Progress towards an IVOA standard 5)

More information

A Tour of LSST Data Management. Kian- Tat Lim DM Project Engineer and System Architect

A Tour of LSST Data Management. Kian- Tat Lim DM Project Engineer and System Architect A Tour of LSST Data Management Kian- Tat Lim DM Project Engineer and System Architect Welcome Aboard Choo Yut Shing @flickr, CC BY-NC-SA 2.0 2 What We Do Accept and archive images and metadata Generate

More information

(1) (2) Goal of the tutorial: Estimation of radii and masses of star-hosting planets using VOSA.

(1) (2) Goal of the tutorial: Estimation of radii and masses of star-hosting planets using VOSA. Title: Determination of stellar physical parameters using VOSA. Author: Enrique Solano. CAB (INTA-CSIC). Spanish Virtual Observatory. September 2017. Scientific background: This science case comes from

More information

LOFAR Data Storage and Handling. Ger van Diepen ASTRON. On behalf of Imaging Pipeline Team

LOFAR Data Storage and Handling. Ger van Diepen ASTRON. On behalf of Imaging Pipeline Team LOFAR Data Storage and Handling Ger van Diepen ASTRON On behalf of Imaging Pipeline Team -1- Outline LOFAR Imaging Pipeline data flow and data format Data Handling Tools -2- Imaging Pipeline data flow

More information

Scaling MATLAB. for Your Organisation and Beyond. Rory Adams The MathWorks, Inc. 1

Scaling MATLAB. for Your Organisation and Beyond. Rory Adams The MathWorks, Inc. 1 Scaling MATLAB for Your Organisation and Beyond Rory Adams 2015 The MathWorks, Inc. 1 MATLAB at Scale Front-end scaling Scale with increasing access requests Back-end scaling Scale with increasing computational

More information

The IVOA in 2008: Assessment and Future Roadmap

The IVOA in 2008: Assessment and Future Roadmap International Virtual Observatory Alliance The IVOA in 2008: Assessment and Future Roadmap Version 0.5 IVOA Note 2008-07-07 This version: Version 0.5-7 th of July 2008 Latest versions: http://www.ivoa.net/internal/ivoa/technicalmilestones/ivoaroadmap-2007-final.pdf

More information

Part III. Issues in Search Computing

Part III. Issues in Search Computing Part III Issues in Search Computing Introduction to Part III: Search Computing in a Nutshell Prior to delving into chapters discussing search computing in greater detail, we give a bird s eye view of its

More information

HiPS Hierarchical Progressive Survey

HiPS Hierarchical Progressive Survey International Virtual Observatory Alliance HiPS Hierarchical Progressive Survey Version 1.0 IVOA Note 15 th October 2015 Previous version(s): None Authors: Pierre Fernique [CDS] Mark Allen [CDS] Thomas

More information