The Portal Aspect of the LSST Science Platform. Gregory Dubois-Felsmann Caltech/IPAC. LSST2017 August 16, 2017
|
|
- Rudolph Holmes
- 5 years ago
- Views:
Transcription
1 The Portal Aspect of the LSST Science Platform Gregory Dubois-Felsmann Caltech/IPAC LSST2017 August 16,
2 Purpose of the LSST Science Platform (LSP) Enable access to the LSST data products Enable visualization and exploration of the LSST data Provide an interface for added-value processing and analysis close to the data Provide access to documentation: Data content, data quality, data processing, software, survey, Observatory systems Enable users to access contextual knowledge of the LSST survey and data, and facilitate their understanding of the relationships among the data products. Context: Support LSST data rights scientists, Science Collaborations, and LSST Project staff Needs to be simple enough to engage general users and flexible enough to meet the needs of experienced and ambitious users. Users will grow and adapt with time. 2
3 The Science Platform Vision Provide a Portal with access to all LSST data products, visualization and exploration tools, documentation, and structured workflows that guide the users to discover and understand the data and their semantic connections. Provide a flexible, interactive computational environment (Python Notebook) with access to the LSST Data Products, computing, and storage, and with pre-provisioned access to installed versions of the LSST Python software stack. Underpin these user environments with a set of externally available APIs providing access to the Data Products, primarily based on IVOA standards; a computational infrastructure; a flexible LSST and user storage infrastructure; and a database system supporting both the Project data products and users own databases. Enable the users to create workflows that cross between the Portal and Notebook environments and the use of the APIs as their needs dictate. 3
4 Vision of the Science Platform Portal Enables discovery and exploration of the LSST data with structured workflows. Contextual information about the semantics of the LSST data is used to guide the workflow and the users. Make it easy to share, analyze, and visualize results between the structured Portal environment and the flexible Notebook environment Notebook Enables exploration and analysis of the LSST data with flexible workflows. Environment has access to tools developed by LSST as well as outside tools APIs Unifying Infrastructure 4
5 Science Platform Underpinnings Portal User Workflows Notebook APIs and Middleware LSST Data Products LSE-163 LSST Databases L1, L2, Cal, EFD LSST Files (e.g., Images) User Databases User Storage User Computing LSST Stack Data Access Center Infrastructure (or equivalent for other instances) (container deployment, batch computing, storage, identity management, ) 5
6 The Science Platform Vision Provide a Portal with access to all LSST data products, visualization and exploration tools, documentation, and structured workflows that guide the users to discover and understand the data and their semantic connections. Provide a flexible, interactive computational environment (Python Notebook) with access to the LSST Data Products, computing, and storage, and with pre-provisioned access to installed versions of the LSST Python software stack. Underpin these user environments with a set of externally available APIs providing access to the Data Products, primarily based on IVOA standards; a computational infrastructure; a flexible LSST and user storage infrastructure; and a database system supporting both the Project data products and users own databases. Enable the users to create workflows that cross between the Portal and Notebook environments and the use of the APIs as their needs dictate. 6
7 The Portal Aspect of the Platform Data Discovery lays out the full breadth of the LSST data with documentation Provides both data-product/table-oriented discovery and all-sky exploration Data Connections presents the semantic links between data Data Query supports both basic (UI-driven) and ADQL query building Provides access to both the LSST data and standards-compliant external data Data Visualization provides LSST-aware visualizations: images, tabular data, more Exploratory Data Analysis brushing and linking, filtering, synthetic columns, histogramming, basic astronomical tools such as time-series analysis User Data Access read/write access to workspace and Level 3 Data Products (user DBs) Provides structured environment for the novice Provides a starting point and reference for the expert, with a seamless transition to interactive analysis in the Notebook Aspect Dedicated portals support Observatory processes (QC/V&V, commissioning) The Portal also provides a control interface to the Alert Filtering & Distribution services 7
8 Portal Implementation The Portal is based on the Firefly framework and libraries for the construction of astronomical archive interfaces Firefly originated with the Spitzer Heritage Archive and provides the underpinnings of the NASA Infrared Science Archive (IRSA) Firefly has a client-server, distributed architecture that enables scalable handling of large result sets and large numbers of users The Firefly server is a Java application The Firefly client is a Javascript application built on the React framework Firefly provides a variety of native visualization tools (images, plots, tables) and a shared data model for query results that supports brushing and linking and other exploratory data analysis operations Connection to Python the Portal will rely on the LSST stack and the Science Platform s computing resources to enable LSST-specific extensions to the core Firefly capabilities Example: the visualization of the LSST footprint / de-blending model 8
9 Discovery and Connections Provides structured environment to guide user in exploring LSST data Highlight the most important science data products but also provide access to all other released data, including Reformatted Engineering and Facilities Database (EFD) Meta data content, related document (written by SUIT or other systems) Data connections (examples): Find all the Processed Visit Images (PVIs) used to make a coadded image Display the images that an object was extracted from Display the light curve data for a selected object 9
10 Data Query Provide customized query panels to support contextual workflows for a finite set of data products (~10) Provide a generic query builder for all LSST data products with metadata information, description and data type to help users construct desired queries, as well as ability to issue an ADQL statement 10
11 Data Visualization and Exploration Brushing and linking data displays: Images, tables, plots, and histograms Use LSST pipeline modules to enable LSST-specific data visualization Footprint, deblending model 11
12 More visualizations Flexible layout scheme allows assembling many linked visualizations 12
13 Many Faces of Firefly 13
14 Portal Workspace Connections Provide access to user workspace and user databases User workspace: private file-oriented read-write storage (VOSpace) User databases: import user data to join; retain and export query results Access controls for user data (enabling collaboration) Provide UI for user to understand their storage and compute resources Provide UI for user to manage query history 14
15 Portal Documentation Guide users to documentation of various types SUIT team will write online help, a user guide, and API documentation Portal will provide links to other documentation: data products, science pipeline code, survey strategy, data quality reports, etc. 15
16 The Science Platform Vision Provide a Portal with access to all LSST data products, visualization and exploration tools, and structured workflows that guide the users to discover and understand the data and their semantic connections. Provide a flexible, interactive computational environment (Python Notebook) with access to the LSST Data Products, computing, and storage, and with pre-provisioned access to installed versions of the LSST Python software stack. Underpin these user environments with a set of externally available APIs providing access to the Data Products, primarily based on IVOA standards; a computational infrastructure; a flexible LSST and user storage infrastructure; and a database system supporting both the Project data products and users own databases. Enable the users to create workflows that cross between the Portal and Notebook environments and the use of the APIs as their needs dictate. 16
17 Cross-Aspect Connections Portal Query/Visualize: xyz User Workflows Notebook Analyze: xyz Data/Query ID: xyz Data/Query ID: xyz APIs Unifying Infrastructure Connections enable sharing of data between components and therefore more complex workflows and analysis 17
18 Cross-Aspect Connections Users are not confined to one aspect or the other The design provides simple data connections among all the aspects of the Science Platform Enabled by the common DAX architecture and computing infrastructure Enabled by the use of Javascript tools for visualization, and the APIs of the Portal s Firefly infrastructure Find or create data in one aspect; view or analyze that data in another aspect Queries are shareable across the Portal and the Notebook, e.g.: Build a query in the Portal UI; verify the results by browsing it in the UI; access the results from the Notebook for further analysis Code complex ADQL query in the Notebook; browse results in the Portal Capture a query formulated in the Portal as code reusable later as a Notebook-driven query Connections can be made either through identity (DAX knows the queries you have recently performed) or through simple UI actions (e.g., copy/paste of a query token between windows) Moving from data discovery to analysis We expect to provide a one click means of launching a fresh notebook with pre-configured access to the results of data identified in the Portal Large query support DAX interfaces support paging Portal will integrate this with user-level paging Still thinking about what the ultimate constraints will be LSST will provide a separate Bulk Download Service for very large-scale exports 18
19 Deployments of the Science Platform Customers of the Science Platform LSST Data Rights Scientists, Science Collaborations, and LSST Project staff Deployments US and Chilean Data Access Centers Supporting LSST s science users Commissioning Cluster Supporting the process of commissioning the Summit systems (Telescope, Camera, OCS), and providing resources for the Observatory engineering team in the longer run Science Validation Environment Supporting QC, verification, and validation work on software releases and on Data Releases Integration Environment (a.k.a. Prototype Data Access Center PDAC) Analysis & Developer Support Domain Supporting integration and test of the Science Platform itself, pre-release verification of the LSP 19
20 Deployment Schedule Integration Environment (i.e., PDAC): now Initial version of PDAC was released in December 2016 Started with demonstration of integration of basic Portal Aspect tools with DAX APIs Regular updates with additional data and functionality are planned (next slide) Science Validation Environment: end of 2017, maturing in 2018 Planned to support the Science Pipelines development and DM verification & validation activities Initially focused on the HSC public-release data Key initial features: add Notebook Aspect, add basic user database support Commissioning Cluster: mid 2019 Supports clean-room testing of ComCam and the main Camera, and spectrograph operations All Aspects; key initial features: generic table access and support for EFD data access US Data Access Center: 2021 Provides outside access to commissioning data; use for Commissioning of DM starts earlier! Chilean Data Access Center:
21 PDAC Evolution PDACv1 December 2016 SDSS Stripe 82 data, basic Portal functionality Tests basic integration of Portal tools with Qserv & DAX services PDACv2 Now (July 2017) Add WISE data (AllWise catalog tables, image access) NEOWISE single-epoch photometry later as ingest files available from IRSA Scaling tests for Qserv; additional Portal features Basic login capabilities PDACv3 Late 2018 Add HSC data Visualizations ready for LSSTCam support; Portal UX improvements Notebook Aspect (JupyterLab) added Authentication and authorization used throughout User workspace User testing of each version PDACv1: DMTR-22 21
22 PDAC Evolution (2) PDACv4 Fall 2019 Portal configuration to support ComCam data All-sky visualizations; further UX improvements Full user table support PDACv Next-to-database processing Prototype of DAC Portal UX Continued use of PDAC to deploy new versions all the way through start of operations PDAC will be used for (internal) system integration and scaling tests, and User testing will be performed at each major release; we plan to reach out to a slowly growing set of science users to 22
23 Access for Data Rights Holders Full access to the Data Access Centers Science Platform environments will come with the start of operations We plan to release commissioning data to data rights holders before that, but Expect a months-long period of analysis by the team before the data are released This will be on a best-effort basis by the pre-operations team The current commitment is only to provide a bulk download facility 23
24 Portal Demo Demonstration of the Portal Aspect in the current version of PDAC 24
25 Science Platform Identity Provider Browser Web Portal Firefly Servers DB (QServ, Other) Browser Firefly Widgets JupyterLab Servers (managed by JupyterHub) Jupyter Client DAX User https: External Users of LSST APIs TAP, SIA https: VOSpace (WebDAV) IPython Kernel Firefly Python microservices Image Storage User Computing Parallel/Batch Computing User User Storage 25
26 IPAC Identity Provider Browser Web Portal Firefly Servers (load-balanced) DB (QServ, Other) Browser Firefly Widgets JupyterLab Servers (managed by JupyterHub) Jupyter Client DAX User https: External Users of LSST APIs TAP, SIA https: VOSpace (WebDAV) IPython Kernel Firefly Python microservices Image Storage User Computing Parallel/Batch Computing User User Storage 26
Science User Interface and Tools: Status. David R. Ciardi & Xiuqin Wu On Behalf of the SUIT Team at IPAC
Science User Interface and Tools: Status David R. Ciardi & Xiuqin Wu On Behalf of the SUIT Team at IPAC 1 Building the SUIT Vision Given the speed with which web technologies evolve, SUIT was intentionally
More informationThe IPAC Research Archives. Steve Groom IPAC / Caltech
The IPAC Research Archives Steve Groom IPAC / Caltech IPAC overview The Infrared Processing and Analysis Center (IPAC) at Caltech is dedicated to science operations, data archives, and community support
More informationVisualiza(on in IRSA Services using Firefly
Visualiza(on in IRSA Services using Firefly Emmanuel Joliet Caltech / IPAC ejoliet@caltech.edu ADASS XXVII College Park, MD Data driven (archives) IRSA hosts >1PB of data from over 15 projects Data extracnon,
More informationCC-IN2P3 / NCSA Meeting May 27-28th,2015
The IN2P3 LSST Computing Effort Dominique Boutigny (CNRS/IN2P3 and SLAC) on behalf of the IN2P3 Computing Team CC-IN2P3 / NCSA Meeting May 27-28th,2015 OSG All Hands SLAC April 7-9, 2014 1 LSST Computing
More informationThe NOAO Data Lab Design, Capabilities and Community Development. Michael Fitzpatrick for the Data Lab Team
The NOAO Data Lab Design, Capabilities and Community Development Michael Fitzpatrick for the Data Lab Team What is it? Data Lab is Science Exploration Platform that provides:! Repository for large datasets
More informationA Tour of LSST Data Management. Kian- Tat Lim DM Project Engineer and System Architect
A Tour of LSST Data Management Kian- Tat Lim DM Project Engineer and System Architect Welcome Aboard Choo Yut Shing @flickr, CC BY-NC-SA 2.0 2 What We Do Accept and archive images and metadata Generate
More informationEuclid Archive Science Archive System
Euclid Archive Science Archive System Bruno Altieri Sara Nieto, Pilar de Teodoro (ESDC) 23/09/2016 Euclid Archive System Overview The EAS Data Processing System (DPS) stores the data products metadata
More informationSpitzer Heritage Archive
Spitzer Heritage Archive Xiuqin Wu, Trey Roby, Loi Ly IRSA/SSC, California Institute of Technology, 100-22, Pasadena, CA, USA ABSTRACT The Spitzer Heritage Archive 1 will host all the raw and final reprocessed
More informationTHE EUCLID ARCHIVE SYSTEM: A DATA-CENTRIC APPROACH TO BIG DATA
THE EUCLID ARCHIVE SYSTEM: A DATA-CENTRIC APPROACH TO BIG DATA Rees Williams on behalf of A.N.Belikov, D.Boxhoorn, B. Dröge, J.McFarland, A.Tsyganov, E.A. Valentijn University of Groningen, Groningen,
More informationQuality assurance in the ingestion of data into the CDS VizieR catalogue and data services
Quality assurance in the ingestion of data into the CDS VizieR catalogue and data services VizieR Staff and contributors: Astronomers: P.Ocvirk, C. Bot, S.Derriere, A.Nebot Engineers: G.Landais, T.Boch,
More informationThe Materials Data Facility
The Materials Data Facility Ben Blaiszik (blaiszik@uchicago.edu), Kyle Chard (chard@uchicago.edu) Ian Foster (foster@uchicago.edu) materialsdatafacility.org What is MDF? We aim to make it simple for materials
More informationOracle WebCenter Interaction: Roadmap for BEA AquaLogic User Interaction. Ajay Gandhi Sr. Director of Product Management Enterprise 2.
Oracle WebCenter Interaction: Roadmap for BEA AquaLogic User Interaction Ajay Gandhi Sr. Director of Product Management Enterprise 2.0 and Portals 1 Agenda Enterprise 2.0 and Portal Product Strategy AquaLogic
More informationConcept of Operations for the LSST Data Facility Services
Large Synoptic Survey Telescope (LSST) Concept of Operations for the LSST Data Facility Services D. Petravick and M. Butler and M. Gelman LDM-230 Latest Revision: 2018-07-17 This LSST document has been
More informationDatabase Developers Forum APEX
Database Developers Forum APEX 20.05.2014 Antonio Romero Marin, Aurelien Fernandes, Jose Rolland Lopez De Coca, Nikolay Tsvetkov, Zereyakob Makonnen, Zory Zaharieva BE-CO Contents Introduction to the Controls
More informationA VO-friendly, Community-based Authorization Framework
A VO-friendly, Community-based Authorization Framework Part 1: Use Cases, Requirements, and Approach Ray Plante and Bruce Loftis NCSA Version 0.1 (February 11, 2005) Abstract The era of massive surveys
More informationTAP services integration at IA2 data center
TAP services integration at IA2 data center Pietro Apollo INAF - Astronomical Observatory of Trieste Outline IA2TAP: TAP implementation 2 + 1 + 1 services TapSchemaManager: Summary a supporting web application
More informationVIRTUAL OBSERVATORY TECHNOLOGIES
VIRTUAL OBSERVATORY TECHNOLOGIES / The Johns Hopkins University Moore s Law, Big Data! 2 Outline 3 SQL for Big Data Computing where the bytes are Database and GPU integration CUDA from SQL Data intensive
More informationOracle Service Cloud Integration for Developers Ed 1
Oracle University Contact Us: Local: 1800 103 4775 Intl: +91 80 67863102 Oracle Service Cloud Integration for Developers Ed 1 Duration: 5 Days What you will learn The class covers how to extend the Service
More informationThe Virtual Observatory and the IVOA
The Virtual Observatory and the IVOA The Virtual Observatory Emergence of the Virtual Observatory concept by 2000 Concerns about the data avalanche, with in mind in particular very large surveys such as
More informationSummary of Data Management Principles
Large Synoptic Survey Telescope (LSST) Summary of Data Management Principles Steven M. Kahn LPM-151 Latest Revision: June 30, 2015 Change Record Version Date Description Owner name 1 6/30/2015 Initial
More informationRENKU - Reproduce, Reuse, Recycle Research. Rok Roškar and the SDSC Renku team
RENKU - Reproduce, Reuse, Recycle Research Rok Roškar and the SDSC Renku team Renku-Reana workshop @ CERN 26.06.2018 Goals of Renku 1. Provide the means to create reproducible data science 2. Facilitate
More informationNational Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology WISE Archive.
Bruce Berriman / Steve Groom Infrared Science Archive (IRSA), IPAC/Caltech GBB/SLG - 1 WSDC Functional Block Diagram White Sands JPL UCLA HRP H/K MOS Maneuvers SOC Science Team Images FTP Site Ancillary
More informationEuropeana Core Service Platform
Europeana Core Service Platform DELIVERABLE D7.1: Strategic Development Plan, Architectural Planning Revision Final Date of submission 30 October 2015 Author(s) Marcin Werla, PSNC Pavel Kats, Europeana
More informationTHE EUCLID ARCHIVE SYSTEM: A DATA-CENTRIC APPROACH TO BIG DATA
THE EUCLID ARCHIVE SYSTEM: A DATA-CENTRIC APPROACH TO BIG DATA Sara Nieto on behalf of B.Altieri, G.Buenadicha, J. Salgado, P. de Teodoro European Space Astronomy Center, European Space Agency, Spain O.R.
More informationSentinet for Microsoft Azure SENTINET
Sentinet for Microsoft Azure SENTINET Sentinet for Microsoft Azure 1 Contents Introduction... 2 Customer Benefits... 2 Deployment Topologies... 3 Cloud Deployment Model... 3 Hybrid Deployment Model...
More informationUsage of the Astro Runtime
A PPARC funded project Usage of the Astro Runtime Noel Winstanley nw@jb.man.ac.uk AstroGrid, Jodrell Bank, UK AstroGrid Workbench A Rich GUI Client for the VO http://www.astrogrid.org/desktop Workbench
More informationIl Mainframe e il paradigma dell enterprise mobility. Carlo Ferrarini zsystems Hybrid Cloud
Il Mainframe e il paradigma dell enterprise mobility Carlo Ferrarini carlo_ferrarini@it.ibm.com zsystems Hybrid Cloud Agenda Exposing enterprise assets in the API Economy Era Deliver natural APIs from
More informationCopyright is owned by the Author of the thesis. Permission is given for a copy to be downloaded by an individual for the purpose of research and
Copyright is owned by the Author of the thesis. Permission is given for a copy to be downloaded by an individual for the purpose of research and private study only. The thesis may not be reproduced elsewhere
More informationOracle Service Cloud Integration for Developers Ed 1
Oracle University Contact Us: Local: 0845 777 7 711 Intl: +44 845 777 7 711 Oracle Service Cloud Integration for Developers Ed 1 Duration: 5 Days What you will learn The class covers how to extend the
More informationUsing the Herschel Science Archive
Using the Herschel Science Archive 2015 SOFIA Observers' Workshop Bernhard Schulz (NHSC/IPAC) The Herschel Space Observatory 3.5-m cryogenically cooled telescope, located in L2 Range: 55 650 mic Telescope
More informationDistributed Archive System for the Cherenkov Telescope Array
Distributed Archive System for the Cherenkov Telescope Array RIA-653549 Eva Sciacca, S. Gallozzi, A. Antonelli, A. Costa INAF, Astrophysical Observatory of Catania INAF, Astronomical Observatory of Rome
More informationNot just an App. Server
Israel JBoss User Group Session 01 / 16.3.2006 JBoss Not just an App. Server By : Lior Kanfi Tikal Hosted by Tikal. w w w. t i k a l k. c o m Cost-Benefit Open Source Agenda Introduction» The problem domain
More informationMicrosoft SharePoint 2010 The business collaboration platform for the Enterprise and the Web. We have a new pie!
Microsoft SharePoint 2010 The business collaboration platform for the Enterprise and the Web We have a new pie! 2 Introduction Key Session Objectives Agenda More Scalable More Flexible More Features Intranet
More informationActivator Library. Focus on maximizing the value of your data, gain business insights, increase your team s productivity, and achieve success.
Focus on maximizing the value of your data, gain business insights, increase your team s productivity, and achieve success. ACTIVATORS Designed to give your team assistance when you need it most without
More informationArcGIS Enterprise: Portal Administration BILL MAJOR CRAIG CLEVELAND
ArcGIS Enterprise: Portal Administration BILL MAJOR CRAIG CLEVELAND Agenda Welcome & Introduction to ArcGIS Enterprise Portal for ArcGIS - Basic Configuration - Advanced Configuration - Deploying Apps
More informationExploiting Virtual Observatory and Information Technology: Techniques for Astronomy
Exploiting Virtual Observatory and Information Technology: Techniques for Astronomy Nicholas Walton AstroGrid Project Scientist Institute of Astronomy, The University of Cambridge Lecture #3 Goal: Applications
More informationThe Smithsonian/NASA Astrophysics Data System
The Smithsonian/NASA Astrophysics Data System Status Report Alberto Accomazzi Michael Kurtz Harvard-Smithsonian Center for Astrophysics http://ads.harvard.edu The ADS Project Established in 1989 (before
More informationTechnology for the Virtual Observatory. The Virtual Observatory. Toward a new astronomy. Toward a new astronomy
Technology for the Virtual Observatory BRAVO Lecture Series, INPE, Brazil July 23-26, 2007 1. Virtual Observatory Summary 2. Service Architecture and XML 3. Building and Using Services 4. Advanced Services
More informationOracle Service Cloud Integration for Develope
Oracle Uni Contact Us: 08 Oracle Service Cloud Integration for Develope Durat5 Da What you will learn The class covers how to extend the Service Cloud objec applicable to all APIs before moving on to specific
More informationThe Herschel Data Processing System: History, Status and latest Developments
The Herschel Data Processing System: History, Status and latest Developments Stephan Ott Herschel Science Data Processing Development Manager Herschel Science Data Processing Coordinator Herschel Science
More informationDesigning the Future Data Management Environment for [Radio] Astronomy. JJ Kavelaars Canadian Astronomy Data Centre
Designing the Future Data Management Environment for [Radio] Astronomy JJ Kavelaars Canadian Astronomy Data Centre 2 Started working in Radio Data Archiving as Graduate student at Queen s in 1993 Canadian
More informationThe Now Platform Reference Guide
The Now Platform Reference Guide A tour of key features and functionality START Introducing the Now Platform Digitize your business with intelligent apps The Now Platform is an application Platform-as-a-Service
More informationAzure DevOps. Randy Pagels Intelligent Cloud Technical Specialist Great Lakes Region
Azure DevOps Randy Pagels Intelligent Cloud Technical Specialist Great Lakes Region What is DevOps? People. Process. Products. Build & Test Deploy DevOps is the union of people, process, and products to
More informationRed Hat Virtualization Increases Efficiency And Cost Effectiveness Of Virtualization
Forrester Total Economic Impact Study Commissioned by Red Hat January 2017 Red Hat Virtualization Increases Efficiency And Cost Effectiveness Of Virtualization Technology organizations are rapidly seeking
More informationWISE Science Data Center
WISE R. Cutri Infrared Processing and Analysis Center RMC: 28-1 MOS Functional Block Diagram TDRSS WHITE SANDS COMPLEX TDRSS Uplink ENGINEERING OPERATIONS SYSTEM (JPL) AND ESMC EOS OPERATIONS Command Generation
More informationFusion Registry 9 SDMX Data and Metadata Management System
Registry 9 Data and Management System Registry 9 is a complete and fully integrated statistical data and metadata management system using. Whether you require a metadata repository supporting a highperformance
More informationAbstract. Introduction. The Virtual Astronomy Multimedia Project
The Virtual Astronomy Multimedia Project The Virtual Astronomy Multimedia Project Adrienne Gauthier 1, Lars Lindberg Christensen 2, Robert Hurt 3 & Ryan Wyatt 4 1 Steward Observatory, University of Arizona(agauthier@as.arizona.edu)
More informationSimile Tools Workshop Summary MacKenzie Smith, MIT Libraries
Simile Tools Workshop Summary MacKenzie Smith, MIT Libraries Intro On June 10 th and 11 th, 2010 a group of Simile Exhibit users, software developers and architects met in Washington D.C. to discuss the
More informationBEAWebLogic. Portal. Overview
BEAWebLogic Portal Overview Version 10.2 Revised: February 2008 Contents About the BEA WebLogic Portal Documentation Introduction to WebLogic Portal Portal Concepts.........................................................2-2
More informationPYRAMID Headline Features. April 2018 Release
PYRAMID 2018.03 April 2018 Release The April release of Pyramid brings a big list of over 40 new features and functional upgrades, designed to make Pyramid s OS the leading solution for customers wishing
More informationMothra: A Large-Scale Data Processing Platform for Network Security Analysis
Mothra: A Large-Scale Data Processing Platform for Network Security Analysis Tony Cebzanov Software Engineering Institute Carnegie Mellon University Pittsburgh, PA 15213 REV-03.18.2016.0 1 Agenda Introduction
More informationFull Stack Web Developer Nanodegree Syllabus
Full Stack Web Developer Nanodegree Syllabus Build Complex Web Applications Before You Start Thank you for your interest in the Full Stack Web Developer Nanodegree! In order to succeed in this program,
More informationArchitectural Design. Architectural Design. Software Architecture. Architectural Models
Architectural Design Architectural Design Chapter 6 Architectural Design: -the design the desig process for identifying: - the subsystems making up a system and - the relationships between the subsystems
More informationCase Study: CyberSKA - A Collaborative Platform for Data Intensive Radio Astronomy
Case Study: CyberSKA - A Collaborative Platform for Data Intensive Radio Astronomy Outline Motivation / Overview Participants / Industry Partners Documentation Architecture Current Status and Services
More informationWISE Data Processing Overview
WISE Data Processing Overview R. Cutri and the WSDC Team @ IPAC 1 WISE Will Release Three Primary Science Data Products Image Atlas - Calibrated images covering the sky in the four WISE bands. Photometric
More informationDemystifying the Cloud With a Look at Hybrid Hosting and OpenStack
Demystifying the Cloud With a Look at Hybrid Hosting and OpenStack Robert Collazo Systems Engineer Rackspace Hosting The Rackspace Vision Agenda Truly a New Era of Computing 70 s 80 s Mainframe Era 90
More informationNational Health Service
National Health Service How one of the world s largest health care providers chose Ionic to boost worker productivity and agility ionicframework.com/resources/case-studies Customer Spotlight national health
More informationThe Astro Runtime. for data access. Noel Winstanley Jodrell Bank, AstroGrid. with the part of Noel played by John Taylor, IfA Edinburgh/AstroGrid
A PPARC funded project The Astro Runtime for data access Noel Winstanley Jodrell Bank, AstroGrid with the part of Noel played by John Taylor, IfA Edinburgh/AstroGrid The Astro Runtime uniform access to
More informationTechnical Overview. Access control lists define the users, groups, and roles that can access content as well as the operations that can be performed.
Technical Overview Technical Overview Standards based Architecture Scalable Secure Entirely Web Based Browser Independent Document Format independent LDAP integration Distributed Architecture Multiple
More informationService Mesh and Microservices Networking
Service Mesh and Microservices Networking WHITEPAPER Service mesh and microservice networking As organizations adopt cloud infrastructure, there is a concurrent change in application architectures towards
More informationStream and Batch Processing in the Cloud with Data Microservices. Marius Bogoevici and Mark Fisher, Pivotal
Stream and Batch Processing in the Cloud with Data Microservices Marius Bogoevici and Mark Fisher, Pivotal Stream and Batch Processing in the Cloud with Data Microservices Use Cases Predictive maintenance
More informationSHAREPOINT 2010 OVERVIEW FOR DEVELOPERS RAI UMAIR SHAREPOINT MENTOR MAVENTOR
SHAREPOINT 2010 OVERVIEW FOR DEVELOPERS RAI UMAIR SHAREPOINT MENTOR MAVENTOR About Rai Umair SharePoint Mentor with Maventor 8+ years of experience in SharePoint Development, Training and Consulting APAC
More informationCosmic Peta-Scale Data Analysis at IN2P3
Cosmic Peta-Scale Data Analysis at IN2P3 Fabrice Jammes Scalable Data Systems Expert LSST Database and Data Access Software Developer Yvan Calas Senior research engineer LSST deputy project leader at CC-IN2P3
More informationArcGIS for Server: Administration and Security. Amr Wahba
ArcGIS for Server: Administration and Security Amr Wahba awahba@esri.com Agenda ArcGIS Server architecture Distributing and scaling components Implementing security Monitoring server logs Automating server
More informationUnidata and data-proximate analysis and visualization in the cloud
Unidata and data-proximate analysis and visualization in the cloud Mohan Ramamurthy and Many Unidata Staff 1 June 2017 Modeling in the Cloud Workshop Unidata: A program of the community, by the community,
More informationIntroducing Oracle Machine Learning
Introducing Oracle Machine Learning A Collaborative Zeppelin notebook for Oracle s machine learning capabilities Charlie Berger Marcos Arancibia Mark Hornick Advanced Analytics and Machine Learning Copyright
More information<Insert Picture Here>
Oracle Forms Modernization with Oracle Application Express Marc Sewtz Software Development Manager Oracle Application Express Oracle USA Inc. 540 Madison Avenue,
More informationSolidFire and Ceph Architectural Comparison
The All-Flash Array Built for the Next Generation Data Center SolidFire and Ceph Architectural Comparison July 2014 Overview When comparing the architecture for Ceph and SolidFire, it is clear that both
More informationPangeo. A community-driven effort for Big Data geoscience
Pangeo A community-driven effort for Big Data geoscience !2 What would you like to have and why? Pangeo s vision for scientific computing in the big-data era Pangeo s Website pangeo-data.org !3 Hello!
More informationData Management System (DMS) Requirements
LARGE SYNOPTIC SURVEY TELESCOPE Large Synoptic Survey Telescope (LSST) Data Management System (DMS) Requirements Gregory Dubois-Felsmann, Tim Jenness LSE-61 Latest Revision: 2018-09-18 This LSST document
More informationThe 60-Minute Guide to Development Tools for IBM Lotus Domino, IBM WebSphere Portal, and IBM Workplace Applications
The 60-Minute Guide to Development Tools for IBM Lotus Domino, IBM WebSphere Portal, and IBM Workplace Stuart Duguid Portal & Workplace Specialist TechWorks, IBM Asia-Pacific Overview / Scope The aim of
More informationWHITEPAPER. Pipelining Machine Learning Models Together
WHITEPAPER Pipelining Machine Learning Models Together Table of Contents Introduction 2 Performance and Organizational Benefits of Pipelining 4 Practical Use Case: Twitter Sentiment Analysis 5 Practical
More informationTime Domain Alerts from LSST & ZTF
Time Domain Alerts from LSST & ZTF Eric Bellm University of Washington LSST DM Alert Production Science Lead ZTF Project Scientist -> ZTF Survey Scientist for the LSST Data Management Team and the ZTF
More informationWeb AppBuilder Presented by
Web AppBuilder Presented by Agenda Product overview Web AppBuilder for ArcGIS tour What s new in the ArcGIS Online June 2016 update Customization Community and Resources Summary The ArcGIS Platform enables
More informationOracle Enterprise Manager 11g Ops Center 2.5 Hands-on Lab
Oracle Enterprise Manager 11g Ops Center 2.5 Hands-on Lab Introduction to Enterprise Manager 11g Oracle Enterprise Manager 11g is the centerpiece of Oracle's integrated IT management strategy, which rejects
More informationData Management Subsystem Requirements
Large Synoptic Survey Telescope (LSST) Data Management Subsystem Requirements Gregory Dubois-Felsmann LSE-61 Latest Revision Date: February 1, 2016 This LSST document has been approved as a Content-Controlled
More informationLuckily, our enterprise had most of the back-end (services, middleware, business logic) already.
2 3 4 The point here is that for real business applications, there is a connected back-end for services. The mobile part of the app is just a presentation layer that is unique for the mobile environment.
More informationAD105 Introduction to Application Development for the IBM Workplace Managed Client
AD105 Introduction to Application Development for the IBM Workplace Managed Client Rama Annavajhala, IBM Workplace Software, IBM Software Group Sesha Baratham, IBM Workplace Software, IBM Software Group
More informationIntroduction to Grid Computing
Milestone 2 Include the names of the papers You only have a page be selective about what you include Be specific; summarize the authors contributions, not just what the paper is about. You might be able
More informationDocker and Oracle Everything You Wanted To Know
Docker and Oracle Everything You Wanted To Know June, 2017 Umesh Tanna Principal Technology Sales Consultant Oracle Sales Consulting Centers(SCC) Bangalore Safe Harbor Statement The following is intended
More informationSCALING LIKE TWITTER WITH APACHE MESOS
Philip Norman & Sunil Shah SCALING LIKE TWITTER WITH APACHE MESOS 1 MODERN INFRASTRUCTURE Dan the Datacenter Operator Alice the Application Developer Doesn t sleep very well Loves automation Wants to control
More informationNo Limits Cloud Introducing the HPE Helion Cloud Suite July 28, Copyright 2016 Vivit Worldwide
No Limits Cloud Introducing the HPE Helion Cloud Suite July 28, 2016 Copyright 2016 Vivit Worldwide Brought to you by Copyright 2016 Vivit Worldwide Hosted By Jeff Jamieson VP Sales & Marketing Whitlock
More informationSAS IS OPEN (FOR BUSINESS) MATT MALCZEWSKI, SAS CANADA
SAS IS OPEN (FOR BUSINESS) MATT MALCZEWSKI, SAS CANADA ACKNOWLEDGEMENTS TAMARA DULL, SAS BEST PRACTICES STEVE HOLDER, NATIONAL ANALYTICS LEAD, SAS CANADA TINA SCHWEIHOFER, SENIOR SOLUTION SPECIALIST, SAS
More informationMeltem Özturan misprivate.boun.edu.tr/ozturan/mis515
Meltem Özturan misprivate.boun.edu.tr/ozturan/mis515 1 2 1 Selecting the Best Alternative Major Activities in the Analysis Phase Gather information Define system requirements Prototype for feasibility
More informationThe Canadian CyberSKA Project
The Canadian CyberSKA Project A. G. Willis (on behalf of the CyberSKA Project Team) National Research Council of Canada Herzberg Institute of Astrophysics Dominion Radio Astrophysical Observatory May 24,
More informationSAS, OPEN SOURCE & VIYA MATT MALCZEWSKI, SAS CANADA
SAS, OPEN SOURCE & VIYA MATT MALCZEWSKI, SAS CANADA ACKNOWLEDGEMENTS TAMARA DULL, SAS BEST PRACTICES STEVE HOLDER, NATIONAL ANALYTICS LEAD, SAS CANADA TINA SCHWEIHOFER, SENIOR SOLUTION SPECIALIST, SAS
More informationSnapCenter Software 4.0 Concepts Guide
SnapCenter Software 4.0 Concepts Guide May 2018 215-12925_D0 doccomments@netapp.com Table of Contents 3 Contents Deciding whether to use the Concepts Guide... 7 SnapCenter overview... 8 SnapCenter architecture...
More informationTHE NATIONAL DATA SERVICE(S) & NDS CONSORTIUM A Call to Action for Accelerating Discovery Through Data Services we can Build Ed Seidel
THE NATIONAL DATA SERVICE(S) & NDS CONSORTIUM A Call to Action for Accelerating Discovery Through Data Services we can Build Ed Seidel National Center for Supercomputing Applications University of Illinois
More informationIntegrating Anonymous & Authenticated Access to VO Services. Patrick Dowler Canadian Astronomy Data Centre
Integrating Anonymous & Authenticated Access to VO Services Patrick Dowler Canadian Astronomy Data Centre 2016-05-10 Authentication at CADC anonymous access multiple authentication mechanisms supported
More informationSAS IS OPEN (FOR BUSINESS) MATT MALCZEWSKI, SAS CANADA
SAS IS OPEN (FOR BUSINESS) MATT MALCZEWSKI, SAS CANADA ACKNOWLEDGEMENTS TAMARA DULL, SAS BEST PRACTICES STEVE HOLDER, NATIONAL ANALYTICS LEAD, SAS CANADA TINA SCHWEIHOFER, SENIOR SOLUTION SPECIALIST, SAS
More informationAdvanced Solutions of Microsoft SharePoint Server 2013 Course Contact Hours
Advanced Solutions of Microsoft SharePoint Server 2013 Course 20332 36 Contact Hours Course Overview This course examines how to plan, configure, and manage a Microsoft SharePoint Server 2013 environment.
More informationAdvanced Solutions of Microsoft SharePoint 2013
Course 20332A :Advanced Solutions of Microsoft SharePoint 2013 Page 1 of 9 Advanced Solutions of Microsoft SharePoint 2013 Course 20332A: 4 days; Instructor-Led About the Course This four-day course examines
More informationKnowledge-based Grids
Knowledge-based Grids Reagan Moore San Diego Supercomputer Center (http://www.npaci.edu/dice/) Data Intensive Computing Environment Chaitan Baru Walter Crescenzi Amarnath Gupta Bertram Ludaescher Richard
More informationJUNE Driving mission success. Modernizing the Navy Marine Corps Intranet
JUNE 2018 Driving mission success Modernizing the Navy Marine Corps Intranet It is with great pleasure that I introduce you to our new company, Perspecta. Perspecta Inc., the new combination of DXC Technology
More informationFabasoft Cloud. boundless digital records management. 16/06/17 1
Fabasoft Cloud boundless digital records management 16/06/17 www.fabasoft.com 1 Fabasoft Cloud Main Use Cases Manufacturing / Collaboration: Individual modelling of Fabasoft Cloud enables realisation of
More informationCloud Computing For Researchers
Cloud Computing For Researchers August, 2016 Compute Canada is often asked about the potential of outsourcing to commercial clouds. This has been investigated as an alternative or supplement to purchasing
More informationSysML model of Exoplanet Archive Functionality and Activities Solange Ramirez a, and the NASA Exoplanet Archive Team a
SysML model of Exoplanet Archive Functionality and Activities Solange Ramirez a, and the NASA Exoplanet Archive Team a a NASA Exoplanet Science Institute, California Institute of Technology, 1200 East
More informationSAP BW 3.5 Enhanced Reporting Capabilities SAP AG
SAP BW 3.5 Enhanced Reporting Capabilities SAP AG Learning Objectives As a result of this lecture, you will: Be familiar with Business Explorer (BEx) suite 3.5 Know the available new features Understand
More informationIBM. PDF file of IBM Knowledge Center topics. IBM Operations Analytics for z Systems. Version 2 Release 2
IBM Operations Analytics for z Systems IBM PDF file of IBM Knowledge Center topics Version 2 Release 2 IBM Operations Analytics for z Systems IBM PDF file of IBM Knowledge Center topics Version 2 Release
More informationMicrosoft SharePoint Server 2013 Plan, Configure & Manage
Microsoft SharePoint Server 2013 Plan, Configure & Manage Course 20331-20332B 5 Days Instructor-led, Hands on Course Information This five day instructor-led course omits the overlap and redundancy that
More information