Not e: The new Babar Comput ing Model is st ill under development. Everything I present here today is still under discussion within Babar.
|
|
- Kristopher Lucas
- 5 years ago
- Views:
Transcription
1 1. Computer Model Working Group 2. Analysis Model J. Walsh 3. Event Store Technologies 4. Computing/Analysis Sites 5. Implementation/Migration Not e: The new Babar Comput ing Model is st ill under development. Everything I present here today is still under discussion within Babar. 1
2 Babar Comput ing Model est ablished end of 2000 changes in computing environment require review Babar Computing Review: April, 2002 large luminosity of PEP-II puts big burden on Babar computing resources Analysis Groups produce huge ntuples that essentially duplicate micro-dst information not scalable with luminosity two event store technologies, Root/IO (Kanga/Root) and Objectivity burden on Computing Group several other issues raised: role of remote sites, etc. Computer Model Working Group 2 - update Babar Computing Model. So far work concentrated in two main areas 1. New proposal for analysis model 2. Event store technology - Root vs. Objectivity debate Plus, will comment on Remote sites Tier A, Tier C, etc. 2
3 design luminosity (3x10 33 ) exceeded in 2001 already expect 3 times current data sample in 2005 where we are now 3
4 Comput ing Model Wor king Gr oup 2: Member s Members: David Brown/LBL Claudio Campagnari Andreas Hoecker Hassan Jawahery (co-chair) Yury Kolomensky (co-chair) David Lange Mike Roney Aaron Roodman Anders Ryd Bernhard Spaan John Walsh Fergus Wilson Technical Experts: Jacek Becla Fabrizio Bianchi Nicole Chevalier Nicolo De Groot Gregory Dubois-Felsmann Peter Elmer Steffen Luitz Mauro Morandin Ex-Officio: Stephen Gowdy CC Rainer Bartoldus DepCC Richard Mount SCS Dominique Boutigny Tier-A Rep. Livio Lanceri DepPAC 4
5 Analysis: performed exclusively on micro format Beta/Framework is analysis program, C++ based Central Skims produce subsets of data pertinent to various analyses Analysis Groups (AWG s) often produce ntuples (or rootuples) that are large and redundant (contain same info as micro) Fortran (or root scripts) analyze ntuples (rootuples) Event Store: Originally only in Objectivity Kanga/Root developed for micro format only, to enhance analysis performance, data distribution micro currently maintained in Objy and Kanga/Root Computing/Analysis Sites: Full copy of micro data available at SLAC, IN2P3, RAL Production reprocessing in place at INFN-Padova Numerous institutes produce MC at remote sites Tier A Sites 5
6 Data formats: Mini: new format with detailed detector information available. New Micro: upgraded form of current micro, allow faster access, customizable content Tag (nano-dst): no major changes, general cleanup Note: large RECO and RAW objects no longer written to event store Skims: New Micro will make centralized skims more useful and efficient Large ntuple production: Hopefully, rendered obsolete, freeing up resources (CPU, disk space and manpower) 6
7 New f or mat int r oduced over t he last year : contains essentially full detector information track hits, calorimeter crystals, DRC hits, etc. efficiently packed to optimize space about 8 kbytes per event (compare to micro: 2 kbytes/event) increased analysis capability w.r.t. micro, e.g.: track extrapolation through detector material follow changing conditions (e.g. SVT alignment) event display etc. 7
8 Additional characteristics: customization larger and slower than micro-dst: develop coherent staging system to retrieve events from tape. Target access times: < 1 hr for small (< 100 events) samples < 1 day for medium (< 1 k events) samples < 2-4 weeks for large samples exact use pattern of mini not really predictable need to remain flexible on implementation 8
9 Radical improvement w.r.t. current micro-dst 1. Dual usage: 1. regular framework/beta job (current Babar norm) 2. interactive use with Root 2. Customizable content option to store detector info or not additional user info can be added composite candidates different mass hypo track fits, etc. 3. High speed: the aim is to reach 1 khz with framework/beta will require Beta development current rate: few tens of Hz higher read rates envisioned with Root access (at cost of reduced functionality) 9
10 Impact on users: much analysis in Babar done at ntuple level ntuple analysis code will have to be adapted/converted to new-micro (use of paw/fortran discouraged) potentially disruptive Comment on Obj ect ivit y: since interactive Root access is a basic feature of the new-micro Objectivity event store is not an option new-micro will be in Root/IO format 10
11 Current system: hybrid wit h Obj ect ivit y at SLAC and I N2P3 and Kanga/Root at RAL, INFN-Padova Problems with Objectivity: lock collisions Prompt Reconstruction and Simulation Production performance issues poor record of scaling with luminosity: every jump in data sample has been accompanied by Objy problems distribution difficulties getting data samples to Tier C sites other HEP experiments have dropped Objy as an option concerns about viability of Objectivity Company we don t have source code how much expertise will be around in 2007? 11
12 Kanga/Root much easier maintenance easier to export smaller event size (although Objy event size is decreasing with deployment of compression and redesign of navigational info) more efficient CPU usage becoming HEP standard easy to attract manpower to support Kanga/Root 12
13 So, why not dr op Obj y and go wit h Kanga/ Root syst em? Cost of migration: effort and disruption: estimates ranged from 1 to 2 years to achieve migration most in Babar agree a switch that takes more than 2 years is probably not worth doing. Kanga/Root has some technical issues that need to be addressed: file server to handle huge number of files lack of transactions lack of cross-file associations (e.g. mini-to-micro navigation) bookkeeping staging system Political/human issues. Note: conditions database implemented in Objectivity too costly (estimate 2-3 years) to convert to Root-based DB Babar relationship with Objy will continue in any case Work to address these issues is ongoing (not just in Babar context) probably no showstoppers, but it is work. 13
14 Alt er nat ive t o Kanga/ Root -only system: a hybrid system where: new-micro in Kanga/Root format only everything else (event reconstruction, simulation production, mini format) in Objectivity Hybr id syst em has advant age of easier, lessdisr upt ive migr at ion, but we st ill need t o support 2 event store technologies Final decision/ r ecommendat ion on event st or e coming soon 14
15 The Working Group is just starting on this subject just present the issues Role of Tier A sites - large site that reduces significantly computing burden at SLAC Primarily analysis: IN2P3, RAL Production: INFN-Padova Issues: data replication at Tier A s data partitioning at Tier A s (micro, mini, beam data, MC) transparent access to data across Tier A s (BabarGrid) specialization of Tier A s: skimming, (re-)processing, etc. Role of Tier C sites smaller sites at remote institutes main contribution so far in MC production (majority of MC events produced away from SLAC) analysis at Tier C s has been difficult due to problems with data distribution need to resolve with new Computing Model 15
16 Mini Already implemented in Objectivity (minor fixes, improvements ongoing) Feasibility of Root implementation has been studied could be ready by early 2003 New -micro Dual usage (Beta and Root) prototype implementation has been achieved. Additional development needed: 1. customization 2. persistent composites 3. Beta/Framework optimization 16
17 Essential requirement: minimal disturbance to Babar capability to produce physics results Mini currently doing reprocessing in Padova of all data, producing mini format output the mini is new feature, so disruption of ongoing analyses is minimal New-micro exploit Babar s data replication to ease migration maintain old-micro at SLAC and IN2P3 sites introduce new-micro at RAL site users have choice of format during transition period Dependence on other parts of Computing Model use of Tier A sites choice of event store technology, etc. 17
18 Babar is currently updating its computing model, to be able to deal with large increase in data set in the coming years A new analysis model, based on the new-micro and mini data formats has been proposed and largely agreed to. the mini will permit more in-depth analysis the new-micro will eliminate largely wasteful/redundant ntuples The working group is also considering the future of event store technologies employed in Babar. Should Objectivity event store be dropped in favor of Root-based technology? Is Kanga/Root ready to be used as a full-scale event store? Does a hybrid system do enough to alleviate the problems of Objy? An important part of the new model will be how best to use remote computing/analysis sites: Tier A and Tier C Work starting on this subject within the Working Group 18
19 19
20 The customization features of the new-micro make it an attractive tool to use with Centralized Skims The idea is t hat each Analysis Wor king Gr oup (AWG) will provide the appropriate event selection and content customization to the Central Skim group Small skims will be encouraged: deep-copies, which provide fast access, will be possible for small skims (< few % selection rate) In addition to skims, a generic new-micro containing all physics events will be available important for new analyses Aiming for increased frequency for Central Skims every 3 months feasibility being evaluated 20
21 The Tag f or mat will cont inue t o be maint ained Opt imizat ion/ cleanup t o r emove unused or redundant information should get a f act or of 2 size reduction 21
22 Deep copy copy full event to new location faster read rate more disk space Pointer (shallow) copy write pointer only slower read rate less disk space Ev 1 Ev 2 Ev 3 Ev 4 deep copy Ev 2 Ev 4 shallow copy Ptr 2 Ptr 4 22
23 1. Mature analysis (like sin2 ) could create a Mini skim of a relatively small number of events and work from that 2. An analysis with loose skim cuts (2-body charmless) would customize a new micro skim, dropping unneeded info and saving B candidates. Mini could be used near end of analysis when number of events is sufficiently reduced. 3. A new analysis would use allevents generic new micro to explore concept and define cuts. Final analysis could require a customized new micro skim or a mini skim (if event sample is small enough). 4. An AWG could produce a skim that serves many analyses. Specific analyses could make pointer skims of the skim, or deep copy skims if small enough. 5. etc. 23
24 This document was created with Win2PDF available at The unregistered version of Win2PDF is for evaluation or non-commercial use only.
Computing. DOE Program Review SLAC. Rainer Bartoldus. Breakout Session 3 June BaBar Deputy Computing Coordinator
Computing DOE Program Review SLAC Breakout Session 3 June 2004 Rainer Bartoldus BaBar Deputy Computing Coordinator 1 Outline The New Computing Model (CM2) New Kanga/ROOT event store, new Analysis Model,
More informationOptimizing Parallel Access to the BaBar Database System Using CORBA Servers
SLAC-PUB-9176 September 2001 Optimizing Parallel Access to the BaBar Database System Using CORBA Servers Jacek Becla 1, Igor Gaponenko 2 1 Stanford Linear Accelerator Center Stanford University, Stanford,
More informationThe BABAR Database: Challenges, Trends and Projections
SLAC-PUB-9179 September 2001 The BABAR Database: Challenges, Trends and Projections I. Gaponenko 1, A. Mokhtarani 1, S. Patton 1, D. Quarrie 1, A. Adesanya 2, J. Becla 2, A. Hanushevsky 2, A. Hasan 2,
More informationThe CMS Computing Model
The CMS Computing Model Dorian Kcira California Institute of Technology SuperComputing 2009 November 14-20 2009, Portland, OR CERN s Large Hadron Collider 5000+ Physicists/Engineers 300+ Institutes 70+
More informationDistributed Offline Data Reconstruction in BABAR
Distributed Offline Data Reconstruction in BABAR Anders Ryd California Institute of Technology, Pasadena, CA 91125 Alberto Crescente, Alvise Dorigo, Fulvio Galeazzi, Mauro Morandin, Roberto Stroili, Gionni
More informationComputing & Software. DOE Program Review. Rainer Bartoldus. Experimental Research Breakout Session 15 June 2005 SLAC
Computing & Software DOE Program Review SLAC Experimental Research Breakout Session 15 June 2005 Rainer Bartoldus SLAC 1 Outline Data Production Overview Getting the events from the detector into the plot:
More informationThe BaBar Computing Model *
SLAC PUB 9964 April 1997 The BaBar Computing Model * N. Geddes Rutherford Appleton Laboratory, Chilton, Didcot, England OX11 0QX Representing the BaBar Collaboration Abstract The BaBar experiment will
More informationLHCb Computing Resources: 2019 requests and reassessment of 2018 requests
LHCb Computing Resources: 2019 requests and reassessment of 2018 requests LHCb-PUB-2017-019 09/09/2017 LHCb Public Note Issue: 0 Revision: 0 Reference: LHCb-PUB-2017-019 Created: 30 th August 2017 Last
More informationA Generic Multi-node State Monitoring Subsystem
A Generic Multi-node State Monitoring Subsystem James A. Hamilton SLAC, Stanford, CA 94025, USA Gregory P. Dubois-Felsmann California Institute of Technology, CA 91125, USA Rainer Bartoldus SLAC, Stanford,
More informationLHCb Computing Resources: 2018 requests and preview of 2019 requests
LHCb Computing Resources: 2018 requests and preview of 2019 requests LHCb-PUB-2017-009 23/02/2017 LHCb Public Note Issue: 0 Revision: 0 Reference: LHCb-PUB-2017-009 Created: 23 rd February 2017 Last modified:
More informationOn the Verge of One Petabyte - the Story Behind the BaBar Database System
SLAC-PUB-9889 * On the Verge of One Petabyte - the Story Behind the BaBar Database System Adeyemi Adesanya, Tofigh Azemoon, Jacek Becla, Andrew Hanushevsky, Adil Hasan, Wilko Kroeger, Artem Trunov, Daniel
More informationInstallation of CMSSW in the Grid DESY Computing Seminar May 17th, 2010 Wolf Behrenhoff, Christoph Wissing
Installation of CMSSW in the Grid DESY Computing Seminar May 17th, 2010 Wolf Behrenhoff, Christoph Wissing Wolf Behrenhoff, Christoph Wissing DESY Computing Seminar May 17th, 2010 Page 1 Installation of
More informationData Analysis in ATLAS. Graeme Stewart with thanks to Attila Krasznahorkay and Johannes Elmsheuser
Data Analysis in ATLAS Graeme Stewart with thanks to Attila Krasznahorkay and Johannes Elmsheuser 1 ATLAS Data Flow into Analysis RAW detector data and simulated RDO data are reconstructed into our xaod
More informationClustering and Reclustering HEP Data in Object Databases
Clustering and Reclustering HEP Data in Object Databases Koen Holtman CERN EP division CH - Geneva 3, Switzerland We formulate principles for the clustering of data, applicable to both sequential HEP applications
More informationComputing at Belle II
Computing at Belle II CHEP 22.05.2012 Takanori Hara for the Belle II Computing Group Physics Objective of Belle and Belle II Confirmation of KM mechanism of CP in the Standard Model CP in the SM too small
More informationHigh-Energy Physics Data-Storage Challenges
High-Energy Physics Data-Storage Challenges Richard P. Mount SLAC SC2003 Experimental HENP Understanding the quantum world requires: Repeated measurement billions of collisions Large (500 2000 physicist)
More informationSpanish Tier-2. Francisco Matorras (IFCA) Nicanor Colino (CIEMAT) F. Matorras N.Colino, Spain CMS T2,.6 March 2008"
Spanish Tier-2 Francisco Matorras (IFCA) Nicanor Colino (CIEMAT) Introduction Report here the status of the federated T2 for CMS basically corresponding to the budget 2006-2007 concentrate on last year
More informationDistributing BaBar Data using the Storage Resource Broker (SRB)
Distributing BaBar Data using the Storage Resource Broker (SRB) W. Kröger (SLAC), L. Martin (Univ. Paris VI et VII), D. Boutigny (LAPP - CNRS/IN2P3), A. Hanushevsky (SLAC), A. Hasan (SLAC) For the BaBar
More informationHOW DATA DEDUPLICATION WORKS A WHITE PAPER
HOW DATA DEDUPLICATION WORKS A WHITE PAPER HOW DATA DEDUPLICATION WORKS ABSTRACT IT departments face explosive data growth, driving up costs of storage for backup and disaster recovery (DR). For this reason,
More informationINTRODUCTION TO THE ANAPHE/LHC++ SOFTWARE SUITE
INTRODUCTION TO THE ANAPHE/LHC++ SOFTWARE SUITE Andreas Pfeiffer CERN, Geneva, Switzerland Abstract The Anaphe/LHC++ project is an ongoing effort to provide an Object-Oriented software environment for
More informationFirst LHCb measurement with data from the LHC Run 2
IL NUOVO CIMENTO 40 C (2017) 35 DOI 10.1393/ncc/i2017-17035-4 Colloquia: IFAE 2016 First LHCb measurement with data from the LHC Run 2 L. Anderlini( 1 )ands. Amerio( 2 ) ( 1 ) INFN, Sezione di Firenze
More informationBelle & Belle II. Takanori Hara (KEK) 9 June, 2015 DPHEP Collaboration CERN
1 Belle & Belle II Takanori Hara (KEK) takanori.hara@kek.jp 9 June, 2015 DPHEP Collaboration Workshop @ CERN 2 Belle Data Belle : started in 1999, data-taking completed in 2010 still keep analysing the
More informationSoftware and computing evolution: the HL-LHC challenge. Simone Campana, CERN
Software and computing evolution: the HL-LHC challenge Simone Campana, CERN Higgs discovery in Run-1 The Large Hadron Collider at CERN We are here: Run-2 (Fernando s talk) High Luminosity: the HL-LHC challenge
More informationLHCb Computing Status. Andrei Tsaregorodtsev CPPM
LHCb Computing Status Andrei Tsaregorodtsev CPPM Plan Run II Computing Model Results of the 2015 data processing 2016-2017 outlook Preparing for Run III Conclusions 2 HLT Output Stream Splitting 12.5 khz
More informationPhysics Analysis Software Framework for Belle II
Physics Analysis Software Framework for Belle II Marko Starič Belle Belle II collaboration Jožef Stefan Institute, Ljubljana CHEP 2015 M. Starič (IJS) Physics Analysis Software Okinawa, 13-17 April 2015
More informationPrompt data reconstruction at the ATLAS experiment
Prompt data reconstruction at the ATLAS experiment Graeme Andrew Stewart 1, Jamie Boyd 1, João Firmino da Costa 2, Joseph Tuggle 3 and Guillaume Unal 1, on behalf of the ATLAS Collaboration 1 European
More informationCS 318 Principles of Operating Systems
CS 318 Principles of Operating Systems Fall 2018 Lecture 16: Advanced File Systems Ryan Huang Slides adapted from Andrea Arpaci-Dusseau s lecture 11/6/18 CS 318 Lecture 16 Advanced File Systems 2 11/6/18
More informationStephen J. Gowdy (CERN) 12 th September 2012 XLDB Conference FINDING THE HIGGS IN THE HAYSTACK(S)
Stephen J. Gowdy (CERN) 12 th September 2012 XLDB Conference FINDING THE HIGGS IN THE HAYSTACK(S) Overview Large Hadron Collider (LHC) Compact Muon Solenoid (CMS) experiment The Challenge Worldwide LHC
More informationSummary of the LHC Computing Review
Summary of the LHC Computing Review http://lhc-computing-review-public.web.cern.ch John Harvey CERN/EP May 10 th, 2001 LHCb Collaboration Meeting The Scale Data taking rate : 50,100, 200 Hz (ALICE, ATLAS-CMS,
More informationSendouts Release Notes Version 8.8
Sendouts Release Notes Version 8.8 Contents Ease of Use New Lookups Featuring Type Ahead Technology 2 New Match and Advance Process 3 Editable Snapshot 5 Updated Resume Split Screen & More Resume Views
More informationSECURE CLOUD BACKUP AND RECOVERY
SECURE CLOUD BACKUP AND RECOVERY Learn more about how KeepItSafe can help to reduce costs, save time, and provide compliance for online backup, disaster recovery-as-a-service, mobile data protection, and
More informationMIS Systems & Infrastructure Lifecycle Management 1. Week 12 April 7, 2016
MIS 5203 Lifecycle Management 1 Week 12 April 7, 2016 Study Objectives Systems Implementation Data Migration Change Over 2 Phase 1 Feasibility Phase 2 Requirements Which ones of these activities are part
More informationSpotfire and Tableau Positioning. Summary
Licensed for distribution Summary So how do the products compare? In a nutshell Spotfire is the more sophisticated and better performing visual analytics platform, and this would be true of comparisons
More informationStrategies for Single Instance Storage. Michael Fahey Hitachi Data Systems
Strategies for Single Instance Storage Michael Fahey Hitachi Data Systems Abstract Single Instance Strategies for Storage Single Instance Storage has become a very popular topic in the industry because
More informationMapping Multi-Million Gate SoCs on FPGAs: Industrial Methodology and Experience
Mapping Multi-Million Gate SoCs on FPGAs: Industrial Methodology and Experience H. Krupnova CMG/FMVG, ST Microelectronics Grenoble, France Helena.Krupnova@st.com Abstract Today, having a fast hardware
More informationCMS HLT production using Grid tools
CMS HLT production using Grid tools Flavia Donno (INFN Pisa) Claudio Grandi (INFN Bologna) Ivano Lippi (INFN Padova) Francesco Prelz (INFN Milano) Andrea Sciaba` (INFN Pisa) Massimo Sgaravatto (INFN Padova)
More informationData preservation for the HERA experiments at DESY using dcache technology
Journal of Physics: Conference Series PAPER OPEN ACCESS Data preservation for the HERA experiments at DESY using dcache technology To cite this article: Dirk Krücker et al 2015 J. Phys.: Conf. Ser. 66
More informationThe ATLAS EventIndex: an event catalogue for experiments collecting large amounts of data
The ATLAS EventIndex: an event catalogue for experiments collecting large amounts of data D. Barberis 1*, J. Cranshaw 2, G. Dimitrov 3, A. Favareto 1, Á. Fernández Casaní 4, S. González de la Hoz 4, J.
More informationCS 318 Principles of Operating Systems
CS 318 Principles of Operating Systems Fall 2017 Lecture 16: File Systems Examples Ryan Huang File Systems Examples BSD Fast File System (FFS) - What were the problems with the original Unix FS? - How
More informationSingle Instance Storage Strategies
Single Instance Storage Strategies Michael Fahey, Hitachi Data Systems SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals may use this
More informationContents 1 Introduction 2 2 Design and Implementation The BABAR Framework Requirements and Guidelines
SLAC PUB 9253 BABAR PUB 02/005 June 2002 KANGA(ROO): Handling the micro-dst of the BABAR Experiment with ROOT T. J. Adye 1, A. Dorigo 2, R. Dubitzky 3, A. Forti 4, S. J. Gowdy 5;10, G. Hamel de Monchenault
More informationALICE ANALYSIS PRESERVATION. Mihaela Gheata DASPOS/DPHEP7 workshop
1 ALICE ANALYSIS PRESERVATION Mihaela Gheata DASPOS/DPHEP7 workshop 2 Outline ALICE data flow ALICE analysis Data & software preservation Open access and sharing analysis tools Conclusions 3 ALICE data
More informationOperational Aspects of Dealing with the Large BaBar Data Set
Operational Aspects of Dealing with the Large BaBar Data Set Tofigh Azemoon, Adil Hasan, Wilko Kröger, Artem Trunov SLAC Computing Services, Stanford, CA 94025, USA On Behalf of the BaBar Computing Group
More informationEventStore A Data Management System
EventStore A Data Management System Valentin Kuznetsov with Chris Jones, Dan Riley, Gregory Sharp Cornell University CLEO-c The CLEO-c experiment started in 2003 main physics topics are precise studies
More informationATLAS NOTE. December 4, ATLAS offline reconstruction timing improvements for run-2. The ATLAS Collaboration. Abstract
ATLAS NOTE December 4, 2014 ATLAS offline reconstruction timing improvements for run-2 The ATLAS Collaboration Abstract ATL-SOFT-PUB-2014-004 04/12/2014 From 2013 to 2014 the LHC underwent an upgrade to
More informationCSE Traditional Operating Systems deal with typical system software designed to be:
CSE 6431 Traditional Operating Systems deal with typical system software designed to be: general purpose running on single processor machines Advanced Operating Systems are designed for either a special
More informationVirtual Memory. Kevin Webb Swarthmore College March 8, 2018
irtual Memory Kevin Webb Swarthmore College March 8, 2018 Today s Goals Describe the mechanisms behind address translation. Analyze the performance of address translation alternatives. Explore page replacement
More informationIntermedia s Private Cloud Exchange
Intermedia s Private Cloud Exchange This is a practical guide to implementing Intermedia s Private Cloud Exchange on AWS. Intermedia, the world s independent provider of Hosted Exchange, and AWS, the leading
More informationData Flow & Leve1 1 Pipeline
Data Flow & Leve1 1 Pipeline High level specs in L3 & L4 documents: Level 4 - LAT-SS-00505-01 Level 3 - LAT-SS-00020-01 Pipeline Server Implementation Plan - LAT-TD-00773-01 (draft in review) Database
More informationMonte Carlo Production on the Grid by the H1 Collaboration
Journal of Physics: Conference Series Monte Carlo Production on the Grid by the H1 Collaboration To cite this article: E Bystritskaya et al 2012 J. Phys.: Conf. Ser. 396 032067 Recent citations - Monitoring
More informationA L I C E Computing Model
CERN-LHCC-2004-038/G-086 04 February 2005 A L I C E Computing Model Computing Project Leader Offline Coordinator F. Carminati Y. Schutz (Editors on behalf of the ALICE Collaboration) i Foreword This document
More informationThe ATLAS EventIndex: Full chain deployment and first operation
The ATLAS EventIndex: Full chain deployment and first operation Álvaro Fernández Casaní Instituto de Física Corpuscular () Universitat de València CSIC On behalf of the ATLAS Collaboration 1 Outline ATLAS
More informationLHC Computing Models
LHC Computing Models Commissione I 31/1/2005 Francesco Forti,, Pisa Gruppo di referaggio Forti (chair), Belforte, Menasce, Simone, Taiuti, Ferrari, Morandin, Zoccoli Outline Comparative analysis of the
More informationIBM TS7700 grid solutions for business continuity
IBM grid solutions for business continuity Enhance data protection and business continuity for mainframe environments in the cloud era Highlights Help ensure business continuity with advanced features
More informationSimile Tools Workshop Summary MacKenzie Smith, MIT Libraries
Simile Tools Workshop Summary MacKenzie Smith, MIT Libraries Intro On June 10 th and 11 th, 2010 a group of Simile Exhibit users, software developers and architects met in Washington D.C. to discuss the
More informationSegregating Data Within Databases for Performance Prepared by Bill Hulsizer
Segregating Data Within Databases for Performance Prepared by Bill Hulsizer When designing databases, segregating data within tables is usually important and sometimes very important. The higher the volume
More informationData services for LHC computing
Data services for LHC computing SLAC 1 Xavier Espinal on behalf of IT/ST DAQ to CC 8GB/s+4xReco Hot files Reliable Fast Processing DAQ Feedback loop WAN aware Tier-1/2 replica, multi-site High throughout
More informationPERFORMANCE INVESTIGATION TOOLS & TECHNIQUES. 7C Matthew Morris Desynit
PERFORMANCE INVESTIGATION TOOLS & TECHNIQUES 7C Matthew Morris Desynit Desynit > Founded in 2001 > Based in Bristol, U.K > Customers worldwide > Technology Mix 2E/Plex Java &.Net Web & mobile applications
More informationStatus of PID. PID in in Release Muon Identification Influence of of G4-Bug on on PID. BABAR Collaboration Meeting, Oct 1st 2005
Status of PID PID in in Release 18 18 Run Run 3,, Run Run 5 Muon Identification Influence of of G4-Bug on on PID The PID-Group: David Aston (*), Bipul Bhuyan (*), Thorsten Brandt, Kevin Flood, Jonathan
More informationHyperconvergence and Medical Imaging
Hyperconvergence and Medical Imaging A recent survey found the top three challenges facing medical IT departments with regard to data storage are: 1. Lack of flexibility Requirements for dedicated hardware
More informationData Base and Computing Resources Management
Data Base and Computing Resources Management Harut Avakian(JLab) "CLAS12 Ready for Science" Review September 25 2017 Clas12 databases(ccdb/rcdb) Policies for clas12 dbases ccdb rcdb Sharing resources between
More informationHEP replica management
Primary actor Goal in context Scope Level Stakeholders and interests Precondition Minimal guarantees Success guarantees Trigger Technology and data variations Priority Releases Response time Frequency
More informationTieto s itap Offering
Tieto s itap Offering say goodbye to worries related to managing Servers & IT infrastructure Jimi Inge Lead Service Architect MZZ Managed Services and Transformation jimi.inge@tieto.com itap An Overview
More informationRsyslog: going up from 40K messages per second to 250K. Rainer Gerhards
Rsyslog: going up from 40K messages per second to 250K Rainer Gerhards What's in it for you? Bad news: will not teach you to make your kernel component five times faster Perspective user-space application
More informationHFIP Architecture and Real-Time Workflows. 14 April 2011
HFIP Architecture and Real-Time Workflows 14 April 2011 1 Overview HFIP System at ESRL Current Configuration Upgrade Options HSM Tape Discussion Construction Real-Time Workflows 2 HFIP System Current HFIP
More informationMigration With Duda.
Migration With Duda A Comprehensive Guide to the Opportunities and Considerations that Come with Website Migration for DIY and DIFM Solutions Providers. www.dudamobile.com Table of Contents Introduction
More informationStandards and Practices
Standards and Practices S&P Article ID: SAP-005 Title: Best Practices for Server Configuration Description: Procedures to provide quality, consistency, and reliability during the server build process.
More informationPRIMEQUEST 400 Series & SQL Server 2005 Technical Whitepaper (November, 2005)
PRIMEQUEST 400 Series & SQL Server 2005 Technical Whitepaper (November, 2005) Fujitsu Limited PRIMEQUEST 400 Series & SQL Server 2005 Technical White Paper PRIMEQUEST 400 Series Server & SQL Server 2005
More informationWorkload Management. Stefano Lacaprara. CMS Physics Week, FNAL, 12/16 April Department of Physics INFN and University of Padova
Workload Management Stefano Lacaprara Department of Physics INFN and University of Padova CMS Physics Week, FNAL, 12/16 April 2005 Outline 1 Workload Management: the CMS way General Architecture Present
More informationLHCb Computing Strategy
LHCb Computing Strategy Nick Brook Computing Model 2008 needs Physics software Harnessing the Grid DIRC GNG Experience & Readiness HCP, Elba May 07 1 Dataflow RW data is reconstructed: e.g. Calo. Energy
More informationCompact Muon Solenoid: Cyberinfrastructure Solutions. Ken Bloom UNL Cyberinfrastructure Workshop -- August 15, 2005
Compact Muon Solenoid: Cyberinfrastructure Solutions Ken Bloom UNL Cyberinfrastructure Workshop -- August 15, 2005 Computing Demands CMS must provide computing to handle huge data rates and sizes, and
More informationSLAC Participation in ATLAS Su Dong
SLAC Participation in ATLAS Su Dong Jun/07/06 Su Dong SLAC DOE Review: ATLAS participation 1 LHC: Part of Energy Frontier Strategy The recognition of the synergy between LHC and ILC is growing in the HEP
More informationMachine Learning in Data Quality Monitoring
CERN openlab workshop on Machine Learning and Data Analytics April 27 th, 2017 Machine Learning in Data Quality Monitoring a point of view Goal Maximize the best Quality Data for physics analysis Data
More informationLHCb Distributed Conditions Database
LHCb Distributed Conditions Database Marco Clemencic E-mail: marco.clemencic@cern.ch Abstract. The LHCb Conditions Database project provides the necessary tools to handle non-event time-varying data. The
More informationSymantec NetBackup 7 for VMware
V-Ray visibility into virtual machine protection Overview There s little question that server virtualization is the single biggest game-changing trend in IT today. Budget-strapped IT departments are racing
More informationSpecifying and Prototyping
Contents Specifying and Prototyping M. EVREN KIYMAÇ 2008639030 What is Specifying? Gathering Specifications Specifying Approach & Waterfall Model What is Prototyping? Uses of Prototypes Prototyping Process
More informationFOUR WAYS TO LOWER THE COST OF REPLICATION
WHITE PAPER I JANUARY 2010 FOUR WAYS TO LOWER THE COST OF REPLICATION How an Ultra-Efficient, Virtualized Storage Platform Brings Disaster Recovery within Reach for Any Organization FOUR WAYS TO LOWER
More informationPerformance Pack. Benchmarking with PlanetPress Connect and PReS Connect
Performance Pack Benchmarking with PlanetPress Connect and PReS Connect Contents 2 Introduction 4 Benchmarking results 5 First scenario: Print production on demand 5 Throughput vs. Output Speed 6 Second
More informationPARALLEL PROCESSING OF LARGE DATA SETS IN PARTICLE PHYSICS
PARALLEL PROCESSING OF LARGE DATA SETS IN PARTICLE PHYSICS MARINA ROTARU 1, MIHAI CIUBĂNCAN 1, GABRIEL STOICEA 1 1 Horia Hulubei National Institute for Physics and Nuclear Engineering, Reactorului 30,
More informationLHCb Computing Resource usage in 2017
LHCb Computing Resource usage in 2017 LHCb-PUB-2018-002 07/03/2018 LHCb Public Note Issue: First version Revision: 0 Reference: LHCb-PUB-2018-002 Created: 1 st February 2018 Last modified: 12 th April
More informationChallenges and Evolution of the LHC Production Grid. April 13, 2011 Ian Fisk
Challenges and Evolution of the LHC Production Grid April 13, 2011 Ian Fisk 1 Evolution Uni x ALICE Remote Access PD2P/ Popularity Tier-2 Tier-2 Uni u Open Lab m Tier-2 Science Uni x Grid Uni z USA Tier-2
More informationChapter 11: File System Implementation. Objectives
Chapter 11: File System Implementation Objectives To describe the details of implementing local file systems and directory structures To describe the implementation of remote file systems To discuss block
More informationOverview of ATLAS PanDA Workload Management
Overview of ATLAS PanDA Workload Management T. Maeno 1, K. De 2, T. Wenaus 1, P. Nilsson 2, G. A. Stewart 3, R. Walker 4, A. Stradling 2, J. Caballero 1, M. Potekhin 1, D. Smith 5, for The ATLAS Collaboration
More informationCombining Complementary Formal Verification Strategies to Improve Performance and Accuracy
Combining Complementary Formal Verification Strategies to Improve Performance and Accuracy David Owen June 15, 2007 2 Overview Four Key Ideas A Typical Formal Verification Strategy Complementary Verification
More informationThe GAP project: GPU applications for High Level Trigger and Medical Imaging
The GAP project: GPU applications for High Level Trigger and Medical Imaging Matteo Bauce 1,2, Andrea Messina 1,2,3, Marco Rescigno 3, Stefano Giagu 1,3, Gianluca Lamanna 4,6, Massimiliano Fiorini 5 1
More informationProductively Testing the Scalability of MT & TM to the Limit! And Beyond?
[Translating and the Computer 23: papers from the Aslib conference held on 29 & 30 November 2001] Productively Testing the Scalability of MT & TM to the Limit! And Beyond? Jon Wells MLT (MultiLingual Technology)
More informationDell helps you simplify IT
Dell helps you simplify IT Workshops the first step. Reduce desktop and data center complexity. Improve productivity. Innovate. Dell IT Consulting Services New Edition 2011 Introduction Are you spending
More informationMigrating to Object Data Management
Migrating to Object Data Management Arthur M. Keller * Stanford University and Persistence Software Paul Turner Persistence Software Abstract. We discuss issues of migrating to object data management.
More informationWHITEPAPER. Embracing Containers & Microservices for future-proof application modernization
WHITEPAPER Embracing Containers & Microservices for future-proof application modernization The need for application modernization: Legacy applications are typically based on a monolithic design, which
More informationUnderstanding Managed Services
Understanding Managed Services The buzzword relating to IT Support is Managed Services, and every day more and more businesses are jumping on the bandwagon. But what does managed services actually mean
More informationProgress on G4 FDIRC Simulation. Doug Roberts University of Maryland
Progress on G4 FDIRC Simulation Doug Roberts University of Maryland Since SLAC Workshop Spent some time trying to streamline and speed-up the reconstruction technique Needed quicker turnaround on resolution
More informationScalable Access to SAS Data Billy Clifford, SAS Institute Inc., Austin, TX
Scalable Access to SAS Data Billy Clifford, SAS Institute Inc., Austin, TX ABSTRACT Symmetric multiprocessor (SMP) computers can increase performance by reducing the time required to analyze large volumes
More informationVeritas InfoScale Enterprise for Oracle Real Application Clusters (RAC)
Veritas InfoScale Enterprise for Oracle Real Application Clusters (RAC) Manageability and availability for Oracle RAC databases Overview Veritas InfoScale Enterprise for Oracle Real Application Clusters
More informationExisting Tools in HEP and Particle Astrophysics
Existing Tools in HEP and Particle Astrophysics Richard Dubois richard@slac.stanford.edu R.Dubois Existing Tools in HEP and Particle Astro 1/20 Outline Introduction: Fermi as example user Analysis Toolkits:
More informationFileWave 10 Webinar Q&A
FileWave 10 Webinar Q&A When will 10 be released? October 14 th, but you can sign up today to get into the beta program. Link: www.filewave.com/beta-program How stable is the beta? Should we use it for
More informationMulti-threaded, discrete event simulation of distributed computing systems
Multi-threaded, discrete event simulation of distributed computing systems Iosif C. Legrand California Institute of Technology, Pasadena, CA, U.S.A Abstract The LHC experiments have envisaged computing
More informationData Processing and Analysis Requirements for CMS-HI Computing
CMS-HI Computing Specifications 1 Data Processing and Analysis Requirements for CMS-HI Computing Charles F. Maguire, Version August 21 Executive Summary The annual bandwidth, CPU power, data storage, and
More informationHOW TO: Upgrade Windows XP to Windows 7 with Windows Easy Transfer
HOW TO: Upgrade Windows XP to Windows 7 with Windows Easy Transfer Upgrade Windows XP to Windows 7 with Windows Easy Transfer Upgrade option for XP users like Windows Vista. In addition, if you completely
More informationData Analysis in Experimental Particle Physics
Data Analysis in Experimental Particle Physics C. Javier Solano S. Grupo de Física Fundamental Facultad de Ciencias Universidad Nacional de Ingeniería Data Analysis in Particle Physics Outline of Lecture
More informationDaily, Weekly or Monthly Partitions? A discussion of several factors for this important decision
Daily, Weekly or Monthly Partitions? A discussion of several factors for this important decision Copyright 2006 Mercury Consulting Published in July 2006 Conventions The following typographical conventions
More information