Continuation Report/Proposal: Vanderbilt CMS Tier 2 Computing Project Reporting Period: November 1, 2010 to March 31, 2012

Transcription

1 Continuation Report/Proposal for DOE Grant Number: DE SC May 15, 2012 Continuation Report/Proposal: Vanderbilt CMS Tier 2 Computing Project Reporting Period: November 1, 2010 to March 31, ) Applicant Institution: Vanderbilt University 2) Institutional Address: Department of Physics and Astronomy Box 1807 Station B Vanderbilt University Nashville, TN ) PIs at this institution: Prof. Charles F. Maguire (Project Director) Department of Physics and Astronomy Box 1807 Station B Vanderbilt University Nashville, TN Telephone: (615) charles.f.maguire@vanderbilt.edu 4) DOE Grant Number: DE SC ) DOE Office of Science Program Office: Nuclear Physics, Heavy Ion 6) DOE Office of Science Program Contact: Dr. James Sowinski

2 Continuation Report/Proposal for DOE Grant Number: DE SC Introduction The mission of the Vanderbilt Tier 2 CMS Computing Project 1 is to be the primary computing resource for the CMS-HI research group investigating the production of the Quark Gluon Plasma as produced in relativistic heavy ion collisions at the Large Hadron Collider. The Project has been initially funded over a three-year period, November 1, 2010 to October 31, The exact funding scenario is described in the original budget justification document, which is attached in the first section of the Appendix to this report. Spending authorization for the project was granted on November 1, 2010 by the DOE Office of Science program contact at the time, Dr. Gulshan Rai. A Project Management and Acquisition Plan, with three associated Memoranda of Understanding, are the guiding documents for implementing the mission of the Project. The five-year plan of hardware acquisition and staff support was detailed in the PMAP, along with the annual costs of these components. Two tables summarizing these categories of the Project and their annual costs are provided in Section 2 of this report. The eventual cumulative 5-year cost to develop the Project was calculated to be $2.40M. The decision was made to fund the Project initially for 3 years at a total cost of $1.84M, with $1.74M being provided for the first 2 years and $0.10M being provided for the third year in this initial phase. The precise allocations of these funds, as originally estimated in 2010, is contained in the first section of the Appendix. 2 This continuation report presents a justification for the final $0.10M funding award to the Project in its third year. This report will summarize the actual experiences in carrying out the Project mission as well as the expenditures incurred as of March 31, A brief history of the performance and achievements of the Project in meeting its stated deliverables and milestones will also be presented. In addition, this report will propose the tasks to be done, and their costs, for the remaining duration of the initial 3-year funding period. The management structure of this Project, as originally described in the PMAP, is given in the second Appendix section of this report. 2 Actual Project Development as Compared to the Project Plan The development of the Vanderbilt CMS Tier 2 Computing Project has been closely matched to the performance of the LHC facility for delivering heavy ion collision events. The original PMAP document was composed in 2010, before any heavy ion collisions had ever taken place at the LHC. The best assumptions available then for the performance of the machine, and also the proposed LHC schedule known in , were used to develop a Project constructions plan of hardware acquisitions. This construction plan is shown in Table 1. The costs listed in Table 1 are for CPU nodes, disk storage pricing, and for operating staff support, all at the Vanderbilt Tier 2. In addition, the Table 2 gives the estimated costs of tape storage at the FNAL Tier 1, where this site functions as the CMS-mandated secondary storage archive center for the HI data sets. The first heavy ion collisions at the LHC took place in November 2010, about 10 days after the funding authorization for the Project. The performance of the LHC in this first heavy ion run was an unqualified success. Even more so, in the second heavy ion run which took place in November 1 A glossary of acronym definitions is provided in the third Appendix section of this report. 2 Since the spending authorization was granted as of November 1, 2010, then that date is being taken as the official start of the Project for purposes of this report.

3 Continuation Report/Proposal for DOE Grant Number: DE SC , the performance of the LHC was nothing short of spectacular. Far more heavy ion data were recorded in 2011 by the CMS detector than had been anticipated in the original PMAP. This huge success in fact had been anticipated in the few months prior to November The CMS computing management was able to persuade the Tier 1 computing center at Lyon, France to host a significant amount of data (230 TB) of particular interest to the French heavy ion physicists. Without this storage commitment from the French group, which had been presented as a hopeful but unconfirmed possibility in the PMAP, then there would not have been enough storage space available to take advantage of the excellent heavy ion collision performance of the LHC. Table 1: Original Projected Expenditures for the Vanderbilt Tier 2 Center Category FY11 FY12 FY13 FY14 FY15 Total Compute/Disk Acquisitions New CPUs (cores) New CPUs (HS06) Total CPUs (cores) Total CPUs (HS06) New Disk (TB) Total Disk (TB) Hardware and Staffing Costs to the DOE CPUs $137,600 $196,000 $264,000 $112,000 $0 $709,600 Disk $121,250 $56,000 $45,000 $15,255 $0 $237,505 Total Hardware $258,850 $252,000 $309,000 $127,255 $0 $947,105 Staffing (DOE Cost) $180,476 $188,285 $195,816 $203,649 $211,795 $980,021 Staff+Hardware Total $439,326 $440,285 $504,816 $330,904 $211,795 $1,927,126 Staffing Support Decomposition (FTEs) By DOE By Vanderbilt Staffing (Vanderbilt Cost) $180,476 $188,285 $195,816 $203,648 $211,795 $980,021 CPU, Disk, and FTE Cost Assumptions Cost/core with 3 GB Disk cost per TB Total cost per FTE $120,317 $125,523 $130,544 $135,766 $141,197 Table 2: Original Funding Profile for Fermilab Tier 1 Tape Archive Category FY11 FY12 FY13 FY14 FY15 Total Tape Volume (PB) Cost to DOE $94,000 $103,000 a $40,000 $116,000 $120,000 $473,000 a Includes a $25,000 capital charge for the purchase of an LT05 tape drive The most significant impact of the performance of the LHC in producing far more heavy ion collisions

4 Continuation Report/Proposal for DOE Grant Number: DE SC data volume than expected has been to change the ratio of disk purchases to CPU purchases for the Project. For example, the first two years of purchases were expected to result in 765 TB of disk storage. Instead, 960 TB of disk storage has been purchased, while correspondingly fewer CPUs have been purchased in order to stay within the annual budget constraints. The reduction in CPUs purchases has been somewhat proportionately less than the increase in disk purchases because the Dell Computer Company has made an extremely attractive CPU configuration available to the LHC experiment collaboration members. The specific hardware purchases made in the first two years, as of March 31, 2012, were as follows: 1) 60 dual quad compute nodes and 3 dual quad gateway nodes Dell R410 nodes with 2.4 GHz processors, 24 GB memory 2) 19 dual hex compute nodes Dell R410 nodes with 2.93 GHz processors, 48 GB memory 3) 20 depots with 72 GB raw; 48 GB usable per depot after RAID 5 redundancy 4) 1 network switch Extreme X650t 5) 2 compute rack switches Extreme X460 6) a secondary 10 Gbps switch Dell PowerConnect ) 8 infrastructure nodes (SE6, SE7, SE8, SE9, SE10, FSCK server, server for network testing, L-Server node The first three items above constitute the bulk of the CPUs and the storage system. The item 7) can be classified as necessary infrastructure to meld the CPUs and the storage system together. As of March 31, 2012 the Project had 704 CPU cores and 960 TB of disk available for externally submitted physics analysis production. In addition, there are 24 CPU cores available in the gateway nodes, for purposes of software development and job testing. 3 Performance of the Tier 2 Project, November 2010 to March 2011 Even before Project spending authorization was received on November 1, 2010 there had been discussions with the Project s technical advisory committee on the scope of the first set of hardware purchases. This set of hardware purchases was intended to meet the initial deliverables and milestones of the Project. In turn these deliverables and milestones were coupled to the acquisition of the first HI data at the LHC in the November 2010 running period. Essentially it was promised that the HI RECO files from the 2011 run would be received at Vanderbilt in time for the collaboration s physicists to analyze the data before the May 2011 Quark Matter conference. The RECO files, with a volume of 190 TB, were produced at the CERN Tier 0 in February 2011, and the first transfers of those files to Vanderbilt began on March 6, The transfers were completed in 19 days, meaning an average rate of 10 TB/day. This rate was exactly as specified in the original Project proposal. This initial transfer was not without some difficulties, effectively providing a series of learning curve issues. The CMS transfer system, called PhEDEx, had to be tuned to the particular configurations of the Vanderbilt storage system. The I/O layer of the storage system was itself just in its first generation,

5 Continuation Report/Proposal for DOE Grant Number: DE SC with some known deficiencies. On some days the transfer rate exceeded 20 TB/day, while on other days there were outages in which no files were transfers. These outages had to be studied and repaired. Nonetheless, by March 25 all the HI RECO files has been transferred. Preceding and simultaneous to this transfer effort members of the HI and HEP groups at Vanderbilt were intensely preparing the Tier 2 to accept remotely submitted physics analysis jobs. Such jobs are entered into the site by the CMS remote batch system called CRAB. Again, this task required the adaptation of the CMS software to the local batch system (PBS), including some repair of the middleware Open Science Grid (OSG) package on which the CRAB system is dependent. The Vanderbilt system was opened to external CRAB job submission in early April 2011, thus allowing CMS physicists the opportunity to process the full 2010 HI data set for the mid-may Quark Matter 2011 conference. By all accounts, the CMS physicists made a highly competitive, and in some cases unique, impact on the advancement of the understanding of the Quark Gluon Plasma at this conference using this complete data set. Figure 1: PhEDEx rates and quality plots for the transfer of HI 2010 RAW data from FNAL to Vanderbilt in August, The peak transfer rates (left side) were above 350 MB/s corresponding to 24 TB/day. In June 2011 after the Quark Matter conference, the Tier 2 Project members continued working on the next generation of the local storage software system. The new generation of this storage software was installed in mid-july In early August 2011 a week-long data transfer challenge exercise was conducted with FNAL. The goal of this exercise was to transfer an average of 20 TB/day over one week, to be ready for the HI 2011 data taking period coming in November. The new storage software system also had better, dynamic error-correction features to maximize the efficiency of the data transfer process. The exercise used the 150 TB of HI 2010 RAW data which were still on disks at FNAL for this purpose. Although there were again some incidental problems during this week-long transfer (and some of these were external to Vanderbilt), the complete transfer was accomplished in the 7 day period to meet the goal of 20 TB/day. The instantaneous transfer rates and the quality of the data transfers (i.e. how many transfers worked without needing a re-try) are shown in Figure 1. After this exercise the Tier 2 Project was then certified ready to receive the HI 2011 run data, as had been stipulated in the deliverables and milestones list. During this Summer 2011 period the Tier 2 project members consulted with the CMS-HI group on the purchase order decisions for the upcoming HI run. Given the optimism about how well the LHC

6 Continuation Report/Proposal for DOE Grant Number: DE SC was expected to deliver HI collision data, the decision was made to purchase more disk space than had been originally planned in the PMAP. This new hardware was commissioned in September 2011, in sufficient time before the HI run. During the run itself, the data transfer operations proceeded very smoothly, a consequence of all the preparation which had been done in the months before. A total of 385 TB was transferred in 21 days, including a few days when the LHC was not producing data. The Tier 2 Project also went beyond its original scope for the 2011 Run in that a prompt skimming task was successfully commissioned. The prompt skimming task involves selecting special sets of events from the full RECO files, and making a much smaller volume of enriched sample RECO files. In this case the enrichment was based on looking for high p T jets. The prompt skimming process is heavily I/O intensive, and had always been done at a full scale Tier 1 facility in CMS. Prompt skimming has not been done before at any CMS Tier 2 since these have typically less powerful I/O hardware systems. Nevertheless, the HI group at Vanderbilt volunteered to develop a special I/O package in the CMS framework which would make uses of native local storage software commands to overcome these limitations. The local prompt skimming was successfully demonstrated only a few days before the HI 2011 run began. From the large 385 TB set of RECO files an enriched set of only 10 TB was produced, which could easily be copied to smaller computer sites. These prompt skim files in fact enabled a first rapid publication of the HI 2011 data analysis in the Spring Figure 2: Three weeks of daily monitoring of the Vanderbilt Tier 2 in early 2012 by the CMS site status system. The one Red mark on February 7 in the Old SAM Availability metric was due to a flaw in an obsolete component of the external monitoring system. The new version recorded 100% site availablity for this particular metric on that day. Like all Tier 2 systems in CMS, the performance of the Vanderbilt site is monitoring continuously by external software systems, as illustrated in Figure 2. Specifically, seven different metrics are measured, corresponding to successfully submitted external jobs, and the ability to send and receive data files using the standard CMS data transfer software. Sites receive a daily Site Readiness Status mark. It is stipulated that a well-performing Tier 2 site should achieve an overall passing mark on at least

7 Continuation Report/Proposal for DOE Grant Number: DE SC % of the week-days. The marks in the week-end days, given by the gray-shaded columns in Figure 2 are not counted in this 80% passing threshold. 4 Future Project Development as Compared to the Project Plan The future Project development discussion can be separated into near-term and long-term phases. The near-term phase corresponds to completing the initial 3-year Project construction, scheduled for purposes of this report to finish in October The long-term phase address the post-construction period in which there will be continued operating costs as well as a plan for hardware replacements. This continuation report will concentrate on the near-term phase, with the expectation that the postreconstruction phase will be addressed in a new Project proposal written in early Coincidentally, these two phases coincide with a major change in operations of the LHC itself. According to the present understandings, which will be revisited at the end of June 2012, the LHC will go into shutdown mode at the end of calendar The shutdown may last 18 months or more. The purpose of the shutdown is to make upgrades to the dipole magnets of the collider such that these may be safely operated at the maximum magnetic field needed to bend 7 TeV protons as originally designed. The third heavy ion run is planned to occur before this 18 month shutdown begins. In the PMAP document the third year of the Project had been projected as the shutdown year for the LHC. Hence, no major milestones or deliverables were set for most of Instead, the reality is that the group is very busy planning for what will be needed for the HI run in The main technical group in CMS making the plan for the run is the High Level Trigger team which implements the physics goals of the data taking. These physics goals are determined by the heavy ion Physics Interest Groups (PInGs), based on simulations of the events. Here again there is much uncertainty because most, if not all, the HI collisions in 2012 will be for protons on lead. These collisions will probe the cold nuclear matter effects at the LHC energy regime, much as the deuteron on gold collisions did for the RHIC energy regime. The cold nuclear matter effects serve as an important cross check on the physics conclusions deriving from the analyses of lead on lead collision events. The HLT decisions for the proton on lead events are also constrained by the downstream computing resources in CMS, just as in the proton on proton collisions. The rate of events being accepted by the HLT must be consistent with the rate that these events can be promptly reconstructed at the CERN Tier 0, and the rate at which these events can be transferred from the Tier 0 to external sites such as FNAL and Vanderbilt. Finally, the HLT decisions are constrained in terms of the total volume of the produced data. Given the approximate three weeks of collisions, a total volume amount of approximately 500 TB (RAW + RECO) is reasonable to transfer to FNAL and Vanderbilt. A factor of two more volume would be likely impossible to handle. By comparison, the data volumes at RHIC are approaching this magnitude, but those volumes are obtained after several months of running, not several weeks. The formal meetings of the heavy ion HLT 2012 run study group have just begun as of this report writing in May The Tier 2 Project team members are attending these HLT study group meetings. A decision will be made in late June on the hardware purchases for the HI 2012 run, based on the information provided by the HLT study group as well as the scheduling information presented by the LHC management. There is some possibility that the HI 2012 run may be postponed until February Whether this will happen will be known for certain in late June If the next HI run is

8 Continuation Report/Proposal for DOE Grant Number: DE SC postponed until February 2013, then there is no immediate need to begin hardware purchases in early July. Instead, we can use the Summer 2012 period to study more the physics simulations for protons on lead, as well as take advantage of any price improvements on the hardware. As a rough estimate, the Tier 2 Project team is considering a purchase of 700 TB of new disk storage, and 500 more CPU cores to accommodate the HI 2012 run production and data analysis. Again, there was no study at the time of the PMAP composition for this LHC collision scenario, and this is uncharted territory for the Project. 5 Project Budget The actual expenditures for the Project are adhering closely to the original budget justification document. The hardware mix has been adjusted to be consistent with the substantially better performance of the the LHC compared to what was projected two years ago. As of the last quarterly Project report, extending up to March 31, 2012 (17 months into the Project s initial three-year phase) the high level category expenditures have been as follows 1) Total hardware expenses have been $461.2K. 2) Staff operating expenses have totaled $262.4K. 3) Tape archive costs are estimated as $169.0K. 3 The cumulative cost of the above items is $892.6K, leaving an unencumbered balance of $947.4K based on the three-year Project budget of $1,840K, or $847.4K unencumbered balance presently at Vanderbilt. The total $1,840K amount is being provided in two successive periods of $1,740K and $100K. The plan for using the Project balance of $892.6K is as follows, based on the original budget justification (see Tables 1 and 2) and assuming a final date of October 31, This final date is three years after the start of spending authorization. 1) Future hardware expenses $486K 2) Future staff operating expenses $329K 3) Future tape archive costs $78K Again, these amounts are generally consistent with the original PMAP projections, except for the additional tape archive costs in item 3). The original PMAP did not foresee an LHC run in calendar year 2012, but in calendar years 2013 and The item 3) moves part of those two out years of tape costs into FY 2013 when they will actually be needed. The staff operating costs in item 2) are for the period April 2012 to October These are about $25K higher than estimated in the original PMAP, reflecting slightly increased salary costs due to staff promotions. There is a serious concern at this time that the cost of disk storage during calendar year 2012 will not be according to what was estimated in 2010 and quoted in Table 1. Thus the hardware expense in item 1) may be somewhat underestimated. The country of Thailand has unique manufacturing facilities 3 A $66K actual cost for the 2010 data is in process of being reimbursed to FNAL, and $103K is the estimated cost for archiving the larger set of 2011 data.

9 Continuation Report/Proposal for DOE Grant Number: DE SC for critical disk storage components. All of these manufacturing facilities were destroyed in flooding during The result has been a classic surge in prices according to the law of supply and demand, as much as a factor of two in a few weeks time in early Although the pricing surge has abated somewhat, there are still large fluctuations in the price and major disk inventories are scarce. In this respect, a delay of the 2012 purchases to later than June, may be beneficial assuming that there is a corresponding delay in the next HI run. The Project management team will contact the DOE program manager if it becomes certain that there will be a serious negative impact on the budget plan. Lastly, although it is past the scope of the present 3-year Project budget, one can anticipate some part of the future operating costs starting in November The Table 1 shows staff costs of of more than $200K in each of the two years starting in November Similarly from Table 2, it can be assumed that the tape archive costs will be approximately $100K after the LHC returns to operational status with new HI runs. There will also be replacement costs for some of the hardware which has either become obsolete and cost inefficient to maintain, or else has simply failed after the warranty period. The precise calculation for these replacement costs will be material for a new Project proposal document to be written in early calendar 2013.

10 Continuation Report/Proposal for DOE Grant Number: DE SC A Original Budget Justification for CMS-HI Computing Project (August 2010) A funding proposal for a project to develop a computational resource which will meet the majority of the computing needs of the CMS-HI research program in the U.S. has been made. This project is be funded in two consecutive time segments: August 15, 2010 to August 14, 2012, and August 15, 2012 to August 14, The following budget is requested: First time period, August 2010 to August 2012 Personnel Costs, item B2 $285,588 This cost comprises 53 Person-Months of effort by 6 technical staff at Vanderbilt s ACCRE computer center, calculated at an annual FTE rate of $64,666. These technical staff will be responsible for the installation and maintenance of the computer hardware to be purchased for this project. The staff will also insure that the software to utilize the hardware will function properly, and that the external network connections are working at the desired rates. Fringe Benefits, item C $71,968 This is calculated a the rate of 25.2% on the salary amount shown in item B2. Permanent Equipment, item D $1,184,000 This amount consists first of computer hardware in the amount of $947,000 comprising computer cores and associated disk space, for processing the data from heavy ion collisions at the LHC recorded by the CMS detector. A second amount is $237,000 which will provide tape archival storage of the raw data and the processed results. Total Direct Costs, item H $1,541,566 This is the sum of the salary, fringe benefits, and the hardware costs. Indirect Costs, item I $198,444. This is the overhead charge on the salary plus fringe benefit costs, based on a rate of 55.5% during this two year period. Total Project Cost, item L $1,740,000 The sum of all the previously costed items. Second time period, August 2012 to August 2013 Personnel Costs, item B2 $51,200 This cost comprises 9 Person-Months of effort by 2 technical staff at Vanderbilt s ACCRE computer center, calculated at an annual FTE rate of $68,267. These staff will have the same duties as described previously. In addition, this staff effort will be supplemented by staff supported by Vanderbilt University. Fringe Benefits, item C $12,902 This is calculated a the rate of 25.2% on the salary amount shown in item B2. Total Direct Costs, item H $64,102 This is the sum of the salary and fringe benefits. Indirect Costs, item I $35,897 This is the overhead charge on the salary plus fringe benefit costs, based on a rate of 56% during this third year period. Total Project Cost, item L $100,000 The sum of all the previously costed items.

11 Continuation Report/Proposal for DOE Grant Number: DE SC B Project Management Structure Description from the PMAP Technical Advisory Commi=ee Bolek Wyslouch, Chair HI Physics Convenors (2) Tier0 Data Ops Liaison FNAL Tier1 Liaison ACCRE Technical Manager ACCRE OperaIons Manager Financial Advisory Board Carie Kennedy, Chair Physics Finance Staff Office of Nuclear Physics Program Manager Gulshan Rai Vanderbilt Tier2 Project Manager Charles Maguire CMS- HI ProducGon Local Manager VU Post- Doc TBA Tier2 Review Board Ken Bloom, Chair VU HEP Technical Liaison Dan Engh Figure 3: Management Organization Chart for the Vanderbilt Tier 2 equipment project Prof. Charles Maguire of Vanderbilt University is the designated Project Manager having ultimate responsibility for the disposition of the project funds. In this role he will be assisted by a Technical Advisory board chaired by Prof. Boleslaw Wyslouch, who is the overall US CMS-HI Project Manager. The technical advisory board will consist of the two Heavy Ion physics conveners designated by CMS management, liaison persons from the CMS Tier 0 and FNAL Tier 1 data operations groups, and the technical and operations managers of the ACCRE organization. It will be the responsibility of this technical advisory board to provide input to the Tier 2 Project Manager on the decisions for annual equipment purchases and to advise on the operational policies and priorities for the Vanderbilt Tier 2 facility. A second advisory committee consisting of the ACCRE financial manager and the financial staff of the Vanderbilt Department of Physics and Astronomy will monitor the expenditures on this project for both hardware and ACCRE technical staff. There is already in the US CMS organization a Tier 2 review board headed by Prof. Ken Bloom of the University of Nebraska. For the past several years this board has been monitoring the performance of the existing US Tier 2 facilities which are associated with the Fermilab Tier 1 facility. 4 4 On May 14, 2012 there was an external review of the Vanderbilt Tier 2 storage system by a team of experts assembled by Prof. Bloom.

12 Continuation Report/Proposal for DOE Grant Number: DE SC C Glossary of Acronyms Included in the PMAP - ACCRE - Advanced Computing Center for Research and Education at Vanderbilt University - AlCa - Alignment and Calibration data, a specific set of data files designed to diagnose the alignment and calibration constants needed to process experimental data - AOD - Analyzed Object Data, a streamlined set of data files designed to be processed quickly for experimental analysis - CERN - Originally European Center for Nuclear Research on the border between Switzerland and France, but now meaning the major high energy physics laboratory hosting the Large Hadron Collider (LHC) accelerator - CERN-SPS - The super-proton-synchrotron accelerator at CERN, now one of the accelerator stages of the LHC - CMS - Compact Muon Solenoid experiment collaboration, one of the big experiment collaborations at the LHC - CMS-HI - CMS Heavy Ion program - CMSSW = CMS software - CMSSW x y z - a specific release of CMSSW - CPU - central processing unit - DQM - Data Quality Monitoring - ESD - Event Summary Data, a special set of data files giving global summary information about given sets of data taking time periods in an experiment - Fermilab - Fermi National Accelerator Laboratory - FNAL - Fermi National Accelerator Laboratory - GB - gigabyte, bytes, where one byte is a measure of computer memory or disk storage sufficient to hold one character of text - Gbps - Gigabit per second, a measure of network file transfer speed - HEP - high energy physics - HI - heavy ion - HLT - High Level Trigger - HS06 - A standard measure of CPU processing power adopted by all the high energy physics experiments at CERN after LHC - Large Hadron Collider, the major new accelerator constructed at CERN and designed to reach collision energies of 7 TeV on 7 TeV for protons

13 Continuation Report/Proposal for DOE Grant Number: DE SC LNS - the Laboratory for Nuclear Science at MIT - L-Store - a disk storage system for extremely large volumes of data - L-Server - hardware unit in direct support of of the L-Store system - MIT - Massachusetts Institute of Technology - MOU - Memorandum of Understanding; there are 3 MOUs associated with this PMAP: one addressing the CERN Tier 0 data production and transfer responsibilities, the second addressing the Fermilab Tier1 1 data archiving responsibilities, and the third addressing the Tier 2 installation and operations responsibilities of ACCRE - PAG - Physics Analysis Group, a set of CMS members focused on a number of related physics analysis topics - PAT - physics analysis tools, a collection of software packages in CMS which are designed to facilitate data analysis - Pb + Pb - Lead-Lead collisions or data taken at the LHC. - PB - petabytes, a measure of disk or tape storage meaning bytes - PhEDEx - Physics Event Data Export, the ensemble of software which for the routine transport of large file systems in CMS - PHENIX - One of the experiment collaborations at the Relativistic Heavy Ion Collider, standing for Pioneering High Energy Nuclear Ion experiment. - PMAP - Project Management and Acquisition Plan - pp - proton - proton, as in proton-proton collisions or proton-proton data. - QCD - Quantum Chromo Dynamics - RECO - Reconstructed data files, the first processing stage of the raw data files in the CMSSW system, containing extra information to assist the first analyses of the data - re-reco - A second or third reconstruction pass over the raw data files, or a subset of these files, which is done with improved calibration constants or better event reconstruction algorithms - RHI - relativistic heavy ion - RHIC - relativistic heavy ion collider - SE - storage element, a hardware unit designed to transfer data efficiently into or out of the storage system - TB - terabytes, a measure of disk or tape storage meaning bytes - UIC - University of Illinois at Chicago - VUA&S - The School of Arts & Science division of Vanderbilt University

14 Continuation Report/Proposal for DOE Grant Number: DE SC VUMC - The Medical Center division of Vanderbilt University - VUSE - The School of Engineering division of Vanderbilt University - WLCG - worldwide LHC computing grid - ZDC - Zero Degree Calorimeter