Data Management. Enabling Grids for E-sciencE. Vladimir Slavnic Scientific Computing Laboratory Institute of Physics Belgrade, Serbia
|
|
|
- Shavonne Davis
- 6 years ago
- Views:
Transcription
1 Data Management Vladimir Slavnic Scientific Computing Laboratory Institute of Physics Belgrade, Serbia Academic and Educational Grid Initiative of Serbia Feb. 19, 2009 A E G I S
2 Contents Storage element LFC Concept lfc and lcg commands Globus data management
3 Storage element Types Classic SE LCG Disk pool manager CASTOR Storage Resource Manager (SRM)
4 LFC LCG File Catalogue (LFC) Maintain mappings between LFN(s), GUID and SURL(s) GRID file
5 File on GRID Grid Unique IDentifier (GUID) guid:<40_bytes_unique_string> guid:38ed3f60-c402-11d7-a6b0-f53ee5a37e1d Logical File Name (LFN) lfn:<anything_you_want> lfn:importantresults/test1240.dat
6 File on GRID Storage URL (SURL) or Physical File Name (PFN) <sfn srm>://<se_hostname>/<some_string> srm://srm.cern.ch/castor/cern.ch/grid/dteam/doe/file1 Transport URL (TURL) <protocol>://<some_string> gsiftp://tbed0101.cern.ch/data/dteam/doe/file1
7 LFC LFC architecture
8 File on GRID
9 LFC Directory structure /grid/<vo>/<you_create_it> /grid/aegis/vlada VO members have rw permissions in their directory Unix-like commands
10 LFC commands echo $LFC_HOST lfc-ls List file/directory entries in a directory lfc-mkdir Create directory lfc-ln Make a symbolic link to a file/directory lfc-ls List file/directory entries in a directory lfc-chmod Change access mode of a LFC file/directory lfc-chown Change owner and group of a LFC file/directory lfc-getacl Get file/directory access control lists lfc-setacl Set file/directory access control lists...
11 LFC commands examples Listing the entries of a LFC directory $ lfc-ls /grid/aegis/vlada novi_fajl rezult Creating directories in the LFC $ lfc-mkdir /grid/aegis/vlada/novi_dir $ lfc-ls -l /grid/aegis/vlada drwxrwxr-x Feb 19 00:30 novi_dir -rw-rw-r Feb 18 01:08 novi_fajl -rw-rw-r Feb 15 00:30 rezult
12 LFC commands examples Creation of symbolic links $ lfc-ln -s /grid/aegis/vlada/rezult \ /grid/aegis/vlada/rezult_link $ lfc-ls -l /grid/aegis/vlada/rezult_link lrwxrwxrwx Feb 19 00:42 /grid/aegis/vlada/rezult_link -> /grid/aegis/vlada/rezult Adding metadata information to LFC entries $ lfc-setcomment /grid/aegis/vlada/rezult "best result" $ lfc-ls --comment /grid/aegis/vlada/rezult /grid/aegis/vlada/rezult best result
13 LFC commands examples Removing LFNs from the LFC $ lfc-rm -r /grid/aegis/vlada/novi_dir Print the ACL of a directory $ lfc-getacl /grid/aegis/vlada/ # file: /grid/aegis/vlada/ # owner: /C=RS/O=AEGIS/OU=Institute of Physics Belgrade/CN=Vladimir Slavnic # group: aegis user::rwx group::rwx other::r-x #effective:rwx default:user::rwx default:group::rwx default:other::r-x
14 lcg_utils LCG Data Management Tools High level tools CLI, API Hides interaction between LFC and SE
15 lcg_utils Replica Management echo $LCG_GFAL_INFOSYS lcg-cp Copies a Grid file to a local destination (download) lcg-cr Copies a file to a SE and registers the file in the catalogue (upload) lcg-del Deletes one file (either one replica or all replicas) lcg-rep Copies a file from one SE to another SE and registers it in the catalogue (replicate) lcg-gt Gets the TURL for a given SURL and transfer protocol
16 lcg_utils File Catalogue Interaction lcg-aa Adds an alias in the catalogue for a given GUID lcg-ra Removes an alias in the catalogue for a given GUID lcg-rf Registers in the catalogue a file residing on an SE lcg-uf Unregisters in the the catalogue a file residing on an SE lcg-la Lists the aliases for a given LFN, GUID or SURL lcg-lr Lists the replicas for a given LFN, GUID or SURL lcg-ls Lists file information for given SURLs or LFNs
17 lcg_utils examples Upload a file $ lcg-cr file:/home/vlada/raf/mpi.jdl guid:830e7a82-f9fb-4c04-aafd-e24a5f25acdb specify lfn: $ lcg-cr -l lfn:/grid/aegis/vlada/mpi \ file:/home/vlada/raf/mpi.jdl guid:25fdcd16-bc c1a-8c597fb33194 Replicate a file (one replica per SE) $ lcg-rep -d grid15.rcub.bg.ac.yu \ lfn:/grid/aegis/vlada/mpi
18 lcg_utils examples List replicas $ lcg-lr lfn:/grid/aegis/vlada/mpi srm://grid15.rcub.bg.ac.yu/dpm/rcub.bg.ac.yu/home/ae gis/generated/ /file8f99889c-c00a-4b7b- 89d3-d9abf66ba103 srm://se.phy.bg.ac.yu/dpm/phy.bg.ac.yu/home/aegis/ge nerated/ /file576fbae0-ba6a-4b21-a205-3d115b2cf7fb List guid $ lcg-lg lfn:/grid/aegis/vlada/mpi guid:25fdcd16-bc c1a-8c597fb33194
19 lcg_utils examples Listing files and directories $ lcg-ls -l lfn:/grid/aegis/vlada/mpi -rw-rw-r lfn:/grid/aegis/vlada/mpi Copying files out of the Grid (download) $ lcg-cp lfn:/grid/aegis/vlada/mpi \ file:/home/vlada/raf/down/mpi Deleting replicas lcg-del srm://grid15.rcub.bg.ac.yu/dpm/rcub.bg.ac.yu/home/ae gis/generated/ /file36d25d0d-ee61-477eb667-40b a4 $ lcg-del -a lfn:/grid/aegis/vlada/mpi
20 Low level tools Globus data management - edg-gridftp - globus-url-copy Careful!
21 Useful links
22 Thank you!
glite Middleware Usage
glite Middleware Usage Dusan Vudragovic dusan@phy.bg.ac.yu Scientific Computing Laboratory Institute of Physics Belgrade, Serbia Nov. 18, 2008 www.eu-egee.org EGEE and glite are registered trademarks Usage
glite Data Management System Hands-on
glite Data Management System Hands-on Antonio Calanducci National Institute of Nuclear Physics (INFN) - Catania EGEE Grid tutorial for Users and Sysadmin Barcelona, 14th-18th April 2008 www.eu-egee.org
Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, November 2008
Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, 13-14 November 2008 Outline Introduction SRM Storage Elements in glite LCG File Catalog (LFC) Information System Grid Tutorial, 13-14
AMGA tutorial. Enabling Grids for E-sciencE
AMGA tutorial Vladimir Slavnić slavnic@phy.bg.ac.yu Scientific Computing Laboratory Institute of Physics Belgrade, Serbia Sep. 19, 2008 www.eu-egee.org Arda Metadata Catalogue Project Data about data Simple
Consorzio COMETA - Progetto PI2S2. DMS API glite. Salvatore Scifo Consorzio Cometa (PI2S2) - Catania. Corso introduttivo al Grid Computing
Consorzio COMETA - Progetto PI2S2 FESR DMS API glite Salvatore Scifo Consorzio Cometa (PI2S2) - Catania Corso introduttivo al Grid Computing Lezione 13 - glite middleware (Data Management - Parte 4) Catania,
glite Grid Services Overview
The EPIKH Project (Exchange Programme to advance e-infrastructure Know-How) glite Grid Services Overview Antonio Calanducci INFN Catania Joint GISELA/EPIKH School for Grid Site Administrators Valparaiso,
Grid services. Enabling Grids for E-sciencE. Dusan Vudragovic Scientific Computing Laboratory Institute of Physics Belgrade, Serbia
Grid services Dusan Vudragovic dusan@phy.bg.ac.yu Scientific Computing Laboratory Institute of Physics Belgrade, Serbia Sep. 19, 2008 www.eu-egee.org Set of basic Grid services Job submission/management
Introduction to SRM. Riccardo Zappi 1
Introduction to SRM Grid Storage Resource Manager Riccardo Zappi 1 1 INFN-CNAF, National Center of INFN (National Institute for Nuclear Physic) for Research and Development into the field of Information
File Access Control Lists (ACLs)
File Access Control Lists (ACLs) Exercise Setup These exercises assume you are using RHEL 7.2 or CentOS 7.2 Create the following users and assignment passwords if these users do not already exist on your
Experience of Data Grid simulation packages using.
Experience of Data Grid simulation packages using. Nechaevskiy A.V. (SINP MSU), Korenkov V.V. (LIT JINR) Dubna, 2008 Contant Operation of LCG DataGrid Errors of FTS services of the Grid. Primary goals
DIRAC data management: consistency, integrity and coherence of data
Journal of Physics: Conference Series DIRAC data management: consistency, integrity and coherence of data To cite this article: M Bargiotti and A C Smith 2008 J. Phys.: Conf. Ser. 119 062013 Related content
Grid Data Management
Grid Data Management Week #4 Hardi Teder hardi@eenet.ee University of Tartu March 6th 2013 Overview Grid Data Management Where the Data comes from? Grid Data Management tools 2/33 Grid foundations 3/33
Understanding StoRM: from introduction to internals
Understanding StoRM: from introduction to internals 13 November 2007 Outline Storage Resource Manager The StoRM service StoRM components and internals Deployment configuration Authorization and ACLs Conclusions.
Beob Kyun KIM, Christophe BONNAUD {kyun, NSDC / KISTI
2010. 6. 17 Beob Kyun KIM, Christophe BONNAUD {kyun, cbonnaud}@kisti.re.kr NSDC / KISTI 1 1 2 Belle Data Transfer Metadata Extraction Scalability Test Metadata Replication Grid-awaring of Belle data Test
Scientific data management
Scientific data management Storage and data management components Application database Certificate Certificate Authorised users directory Certificate Certificate Researcher Certificate Policies Information
LCG-2 and glite Architecture and components
LCG-2 and glite Architecture and components Author E.Slabospitskaya www.eu-egee.org Outline Enabling Grids for E-sciencE What are LCG-2 and glite? glite Architecture Release 1.0 review What is glite?.
Actual4Test. Actual4test - actual test exam dumps-pass for IT exams
Actual4Test http://www.actual4test.com Actual4test - actual test exam dumps-pass for IT exams Exam : 1z1-449 Title : Oracle Big Data 2017 Implementation Essentials Vendor : Oracle Version : DEMO Get Latest
HDP HDFS ACLs 3. Apache HDFS ACLs. Date of Publish:
3 Apache HDFS ACLs Date of Publish: 2018-07-15 http://docs.hortonworks.com Contents Apache HDFS ACLs... 3 Configuring ACLs on HDFS... 3 Using CLI Commands to Create and List ACLs... 3 ACL Examples... 4
Grid Data Management
Grid Data Management Data Management Distributed community of users need to access and analyze large amounts of data Fusion community s International ITER project Requirement arises in both simulation
Unix File System. Class Meeting 2. * Notes adapted by Joy Mukherjee from previous work by other members of the CS faculty at Virginia Tech
Unix File System Class Meeting 2 * Notes adapted by Joy Mukherjee from previous work by other members of the CS faculty at Virginia Tech Unix File System The file system is your interface to: physical
FREE SCIENTIFIC COMPUTING
Institute of Physics, Belgrade Scientific Computing Laboratory FREE SCIENTIFIC COMPUTING GRID COMPUTING Branimir Acković March 4, 2007 Petnica Science Center Overview 1/2 escience Brief History of UNIX
Assume that username is cse. The user s home directory will be /home/cse. You may remember what the relative pathname for users home directory is: ~
Introduction to Open Source Software Development Spring semester, 2017 School of Computer Science and Engineering, Pusan National University Joon-Seok Kim LINUX: COMMANDS Review Lab #1 2 Create Directories
Architecture Proposal
Nordic Testbed for Wide Area Computing and Data Handling NORDUGRID-TECH-1 19/02/2002 Architecture Proposal M.Ellert, A.Konstantinov, B.Kónya, O.Smirnova, A.Wäänänen Introduction The document describes
CS 307: UNIX PROGRAMMING ENVIRONMENT KATAS FOR EXAM 1
CS 307: UNIX PROGRAMMING ENVIRONMENT KATAS FOR EXAM 1 Prof. Michael J. Reale Fall 2014 COMMAND KATA 0 Command Kata 0: Preparation First, go to ~/cs307 cd ~/cs307 Make directory dkata0 and go to it mkdir
CMSC421: Principles of Operating Systems
CMSC421: Principles of Operating Systems Nilanjan Banerjee Assistant Professor, University of Maryland Baltimore County nilanb@umbc.edu http://www.csee.umbc.edu/~nilanb/teaching/421/ Principles of Operating
Unix Filesystem. January 26 th, 2004 Class Meeting 2
Unix Filesystem January 26 th, 2004 Class Meeting 2 * Notes adapted by Christian Allgood from previous work by other members of the CS faculty at Virginia Tech Unix Filesystem! The filesystem is your interface
Chapter Two. Lesson A. Objectives. Exploring the UNIX File System and File Security. Understanding Files and Directories
Chapter Two Exploring the UNIX File System and File Security Lesson A Understanding Files and Directories 2 Objectives Discuss and explain the UNIX file system Define a UNIX file system partition Use the
Adding SRM Functionality to QCDGrid. Albert Antony
Adding SRM Functionality to QCDGrid Albert Antony MSc in High Performance Computing The University of Edinburgh Year of Presentation: 2007 Abstract This dissertation discusses an attempt to add Storage
DataGRID. Lead Partner: Document status:
DataGRID EDG REPLICATION METADATA USER GUIDE TESTBED 2.0 Document identifier: EDMS id: Work package: Partner(s): Lead Partner: Document status: Author(s): File: WP02: Data Management CERN, PPARC, HIP,
Week 2 Lecture 3. Unix
Lecture 3 Unix Terminal and Shell 2 Terminal Prompt Command Argument Result 3 Shell Intro A system program that allows a user to execute: shell functions (e.g., ls -la) other programs (e.g., eclipse) shell
Philippe Charpentier PH Department CERN, Geneva
Philippe Charpentier PH Department CERN, Geneva Outline Disclaimer: These lectures are not meant at teaching you how to compute on the Grid! I hope it will give you a flavor on what Grid Computing is about
Grid Computing Middleware. Definitions & functions Middleware components Globus glite
Seminar Review 1 Topics Grid Computing Middleware Grid Resource Management Grid Computing Security Applications of SOA and Web Services Semantic Grid Grid & E-Science Grid Economics Cloud Computing 2 Grid
Service Availability Monitor tests for ATLAS
Service Availability Monitor tests for ATLAS Current Status Work in progress Alessandro Di Girolamo CERN IT/GS Critical Tests: Current Status Now running ATLAS specific tests together with standard OPS
Grid Computing. Olivier Dadoun LAL, Orsay. Introduction & Parachute method. Socle 2006 Clermont-Ferrand Orsay)
virtual organization Grid Computing Introduction & Parachute method Socle 2006 Clermont-Ferrand (@lal Orsay) Olivier Dadoun LAL, Orsay dadoun@lal.in2p3.fr www.dadoun.net October 2006 1 Contents Preamble
glite/egee in Practice
glite/egee in Practice Alex Villazon (DPS, Innsbruck) Markus Baumgartner (GUP, Linz) With material from www.eu-egee.org ISPDC 2007 5-8 July 2007 Hagenberg, Austria EGEE-II INFSO-RI-031688 Overview Introduction
Processes. Shell Commands. a Command Line Interface accepts typed (textual) inputs and provides textual outputs. Synonyms:
Processes The Operating System, Shells, and Python Shell Commands a Command Line Interface accepts typed (textual) inputs and provides textual outputs. Synonyms: - Command prompt - Shell - CLI Shell commands
Grid Infrastructure For Collaborative High Performance Scientific Computing
Computing For Nation Development, February 08 09, 2008 Bharati Vidyapeeth s Institute of Computer Applications and Management, New Delhi Grid Infrastructure For Collaborative High Performance Scientific
A Login Shell interface for INFN-GRID
A Login Shell interface for INFN-GRID S.Pardi2,3, E. Calloni1,2, R. De Rosa1,2, F. Garufi1,2, L. Milano1,2, G. Russo1,2 1Università degli Studi di Napoli Federico II, Dipartimento di Scienze Fisiche, Complesso
CASTORFS - A filesystem to access CASTOR
Journal of Physics: Conference Series CASTORFS - A filesystem to access CASTOR To cite this article: Alexander Mazurov and Niko Neufeld 2010 J. Phys.: Conf. Ser. 219 052023 View the article online for
StoRM configuration. namespace.xml
StoRM configuration. namespace.xml 13 November 2007 Outline About this talk Mapping concepts Namespace concepts Namespace algorithms Namespace in practise Mapping Concepts Mapping concepts Mapping The
Metadaten Workshop 26./27. März 2007 Göttingen. Chimera. a new grid enabled name-space service. Martin Radicke. Tigran Mkrtchyan
Metadaten Workshop 26./27. März Chimera a new grid enabled name-space service What is Chimera? a new namespace provider provides a simulated filesystem with additional metadata fast, scalable and based
The UNIX File System
The UNIX File System Magnus Johansson May 9, 2007 1 UNIX file system A file system is created with mkfs. It defines a number of parameters for the system, such as: bootblock - contains a primary boot program
Chapter 10: File-System Interface
Chapter 10: File-System Interface Objectives: To explain the function of file systems To describe the interfaces to file systems To discuss file-system design tradeoffs, including access methods, file
The UNIX File System
The UNIX File System Magnus Johansson (May 2007) 1 UNIX file system A file system is created with mkfs. It defines a number of parameters for the system as depicted in figure 1. These paremeters include
Chapter 10: File-System Interface
Chapter 10: File-System Interface Objectives: To explain the function of file systems To describe the interfaces to file systems To discuss file-system design tradeoffs, including access methods, file
Working with Basic Linux. Daniel Balagué
Working with Basic Linux Daniel Balagué How Linux Works? Everything in Linux is either a file or a process. A process is an executing program identified with a PID number. It runs in short or long duration
Basic UNIX commands. HORT Lab 2 Instructor: Kranthi Varala
Basic UNIX commands HORT 59000 Lab 2 Instructor: Kranthi Varala Client/Server architecture User1 User2 User3 Server (UNIX/ Web/ Database etc..) User4 High Performance Compute (HPC) cluster User1 Compute
File system links. Week Overview. Hard and symbolic links Process management
ULI101 Week 08 File system links Week Overview Hard and symbolic links Process management What is a file system Link? A link is a pointer to a file. This pointer associates a file name with a number called
Files
http://www.cs.fsu.edu/~langley/cop3353-2013-1/reveal.js-2013-02-11/02.html?print-pdf 02/11/2013 10:55 AM Files A normal "flat" file is a collection of information. It's usually stored somewhere reasonably
Introduction to Computing
Chapter 1 Introduction to Computing Unix is an operating system. In a unix environment, the fundamental layer is the hardware which provides the service the users need. The hardware include the CPU, memory,
National University of Computer and Emerging Sciences Operating System Lab - 02 Lab Manual
National University of Computer and Emerging Sciences Operating System Lab - 02 Lab Manual Objective This lab is all about running commands in Ubuntu Terminal and compiling C program in Ubuntu Table of
Unix Guide. Meher Krishna Patel. Created on : Octorber, 2017 Last updated : December, More documents are freely available at PythonDSP
Unix Guide Meher Krishna Patel Created on : Octorber, 2017 Last updated : December, 2017 More documents are freely available at PythonDSP Table of contents Table of contents i 1 Unix commands 1 1.1 Unix
CMSC421: Principles of Operating Systems
CMSC421: Principles of Operating Systems Nilanjan Banerjee Assistant Professor, University of Maryland Baltimore County nilanb@umbc.edu http://www.csee.umbc.edu/~nilanb/teaching/421/ Principles of Operating
Grid Computing. Olivier Dadoun LAL, Orsay Introduction & Parachute method. APC-Grid February 2007
Grid Computing Introduction & Parachute method APC-Grid February 2007 Olivier Dadoun LAL, Orsay http://flc-mdi.lal.in2p3.fr dadoun@lal.in2p3.fr www.dadoun.net October 2006 1 Contents Machine Detector Interface
30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy
Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy Why the Grid? Science is becoming increasingly digital and needs to deal with increasing amounts of
Computer Systems and Architecture
Computer Systems and Architecture Introduction to UNIX Stephen Pauwels University of Antwerp October 2, 2015 Outline What is Unix? Getting started Streams Exercises UNIX Operating system Servers, desktops,
The glite middleware. Presented by John White EGEE-II JRA1 Dep. Manager On behalf of JRA1 Enabling Grids for E-sciencE
The glite middleware Presented by John White EGEE-II JRA1 Dep. Manager On behalf of JRA1 John.White@cern.ch www.eu-egee.org EGEE and glite are registered trademarks Outline glite distributions Software
Unix Basics. Systems Programming Concepts
Concepts Unix directories Important Unix file commands man, pwd, ls, mkdir, cd, cp, mv File and directory access rights through permission settings Using chmod to change permissions Other important Unix
Welcome to getting started with Ubuntu Server. This System Administrator Manual. guide to be simple to follow, with step by step instructions
Welcome to getting started with Ubuntu 12.04 Server. This System Administrator Manual guide to be simple to follow, with step by step instructions with screenshots INDEX 1.Installation of Ubuntu 12.04
Chelonia User s manual
NORDUGRID NORDUGRID-MANUAL-14 28/9/2011 Chelonia User s manual Zsombor Nagy Jon Nilsen Salman Zubair Toor zsombor@niif.hu j.k.nilsen@usit.uio.no salman.toor@it.uu.se Contents 1 Clients for Chelonia 2 1.1
( PROPOSAL ) THE AGATA GRID COMPUTING MODEL FOR DATA MANAGEMENT AND DATA PROCESSING. version 0.6. July 2010 Revised January 2011
( PROPOSAL ) THE AGATA GRID COMPUTING MODEL FOR DATA MANAGEMENT AND DATA PROCESSING version 0.6 July 2010 Revised January 2011 Mohammed Kaci 1 and Victor Méndez 1 For the AGATA collaboration 1 IFIC Grid
GridNEWS: A distributed Grid platform for efficient storage, annotating, indexing and searching of large audiovisual news content
1st HellasGrid User Forum 10-11/1/2008 GridNEWS: A distributed Grid platform for efficient storage, annotating, indexing and searching of large audiovisual news content Ioannis Konstantinou School of ECE
Introduction to the UNIX command line
Introduction to the UNIX command line Steven Abreu Introduction to Computer Science (ICS) Tutorial Jacobs University s.abreu@jacobs-university.de September 19, 2017 Overview What is UNIX? UNIX Shell Commands
DiGS (Version 3.1) Setup Guide
DiGS (Version 3.1) Setup Guide George Beckett, Daragh Byrne, Radosław Ostrowski, James Perry, Eilidh Grant 10th May 2010 1 Contents Preface 3 1 An Overview of DiGS 1 1.1 A typical DiGS-powered infrastructure...........................
Grid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms
Grid Computing 1 Resource sharing Elements of Grid Computing - Computers, data, storage, sensors, networks, - Sharing always conditional: issues of trust, policy, negotiation, payment, Coordinated problem
CHAPTER 1 UNIX FOR NONPROGRAMMERS
CHAPTER 1 UNIX FOR NONPROGRAMMERS The man command is used to display the manual entry associated with word entered as argument. The -k option is used displays a list of manual entries that contain entered
Outline. File Systems. File System Structure. CSCI 4061 Introduction to Operating Systems
Outline CSCI 4061 Introduction to Operating Systems Instructor: Abhishek Chandra File Systems Directories File and directory operations Inodes and metadata Links 2 File Systems An organized collection
g-eclipse A Framework for Accessing Grid Infrastructures Nicholas Loulloudes Trainer, University of Cyprus (loulloudes.n_at_cs.ucy.ac.
g-eclipse A Framework for Accessing Grid Infrastructures Trainer, University of Cyprus (loulloudes.n_at_cs.ucy.ac.cy) EGEE Training the Trainers May 6 th, 2009 Outline Grid Reality The Problem g-eclipse
Data Management 1. Grid data management. Different sources of data. Sensors Analytic equipment Measurement tools and devices
Data Management 1 Grid data management Different sources of data Sensors Analytic equipment Measurement tools and devices Need to discover patterns in data to create information Need mechanisms to deal
DataGrid EDG-BROKERINFO USER GUIDE. Document identifier: Date: 06/08/2003. Work package: Document status: Deliverable identifier:
DataGrid Document identifier: Date: 06/08/2003 Work package: Document status: WP1-WP2 DRAFT Deliverable identifier: Abstract: This document presents what is the BrokerInfo file, the edg-brokerinfo command
dcache Introduction Course
GRIDKA SCHOOL 2013 KARLSRUHER INSTITUT FÜR TECHNOLOGIE KARLSRUHE August 29, 2013 dcache Introduction Course Overview Chapters I, II and Ⅴ Christoph Anton Mitterer christoph.anton.mitterer@lmu.de ⅤIII.
Group Editing of Files and Web Sites
Introduction Some research groups like to maintain a project/research group web page. We recommend that a single individual perform this task. Any member of the group may contribute and provide edits for
DIRAC File Replica and Metadata Catalog
DIRAC File Replica and Metadata Catalog A.Tsaregorodtsev 1, S.Poss 2 1 Centre de Physique des Particules de Marseille, 163 Avenue de Luminy Case 902 13288 Marseille, France 2 CERN CH-1211 Genève 23, Switzerland
A scalable storage element and its usage in HEP
AstroGrid D Meeting at MPE 14 15. November 2006 Garching dcache A scalable storage element and its usage in HEP Martin Radicke Patrick Fuhrmann Introduction to dcache 2 Project overview joint venture between
CENG 334 Computer Networks. Laboratory I Linux Tutorial
CENG 334 Computer Networks Laboratory I Linux Tutorial Contents 1. Logging In and Starting Session 2. Using Commands 1. Basic Commands 2. Working With Files and Directories 3. Permission Bits 3. Introduction
Computer Systems and Architecture
Computer Systems and Architecture Stephen Pauwels Computer Systems Academic Year 2018-2019 Overview of the Semester UNIX Introductie Regular Expressions Scripting Data Representation Integers, Fixed point,
CEG 333 Introduction to UNIX Wright State University Midterm Examination #1
CEG 333 Introduction to UNIX Wright State University Midterm Examination #1 Fall Quarter, 2005 Name: Student Number: READ THESE INSTRUCTIONS This is an open-book exam. The use of the notes contained in
AMGA metadata catalogue system
AMGA metadata catalogue system Hurng-Chun Lee ACGrid School, Hanoi, Vietnam www.eu-egee.org EGEE and glite are registered trademarks Outline AMGA overview AMGA Background and Motivation for AMGA Interface,
Linux Operating System Environment Computadors Grau en Ciència i Enginyeria de Dades Q2
Linux Operating System Environment Computadors Grau en Ciència i Enginyeria de Dades 2017-2018 Q2 Facultat d Informàtica de Barcelona This first lab session is focused on getting experience in working
Outline. Structure of a UNIX command
Outline Structure of Unix Commands Command help (man) Log on (terminal vs. graphical) System information (utility) File and directory structure (path) Permission (owner, group, rwx) File and directory
2-Type Fire Retardant Closures
2-Type Fire Retardant Closures 2-Type Closures that can really take the heat. The 2-Type Fire Retardant Closure is completely self-contained and capable of withstanding a 15 minute horizontal or vertical
The Unix Shell. Permissions
The Unix Shell Copyright Software Carpentry 2010 This work is licensed under the Creative Commons Attribution License See http://software-carpentry.org/license.html for more information. shell shell pwd,
Links, basic file manipulation, environmental variables, executing programs out of $PATH
Links, basic file manipulation, environmental variables, executing programs out of $PATH Laboratory of Genomics & Bioinformatics in Parasitology Department of Parasitology, ICB, USP The $PATH PATH (which
Operating systems fundamentals - B10
Operating systems fundamentals - B10 David Kendall Northumbria University David Kendall (Northumbria University) Operating systems fundamentals - B10 1 / 12 Introduction Basics of protection and security
Operating Systems. Engr. Abdul-Rahman Mahmood MS, PMP, MCP, QMR(ISO9001:2000) alphapeeler.sf.net/pubkeys/pkey.htm
Operating Systems Engr. Abdul-Rahman Mahmood MS, PMP, MCP, QMR(ISO9001:2000) armahmood786@yahoo.com alphasecure@gmail.com alphapeeler.sf.net/pubkeys/pkey.htm http://alphapeeler.sourceforge.net pk.linkedin.com/in/armahmood
The AMGA Metadata Service
The AMGA Metadata Service Antonio Calanducci National Institute of Nuclear Physics (INFN) - Catania EGEE Grid tutorial for Users and Sysadmin Barcelona, 14th-18th April 2008 www.eu-egee.org EGEE and glite
File Security Lock Down Your Data. Brian Reames January 22, 2012
File Security Lock Down Your Data Brian Reames January 22, 2012 Table of Contents 1.0 Basic Linux Permissions...4 1.1 Determining Permissions... 5 1.2 File Permissions vs. Directory Permissions... 6 1.3
CST8207: GNU/Linux Operating Systems I Lab Six Linux File System Permissions. Linux File System Permissions (modes) - Part 1
Student Name: Lab Section: Linux File System Permissions (modes) - Part 1 Due Date - Upload to Blackboard by 8:30am Monday March 12, 2012 Submit the completed lab to Blackboard following the Rules for
File-System Interface. File Structure. File Concept. File Concept Access Methods Directory Structure File-System Mounting File Sharing Protection
TDIU11 Operating Systems File-System Interface File-System Interface [SGG7/8/9] Chapter 10 File Concept Access Methods Directory Structure File-System Mounting File Sharing Protection How the file system
CIS-331 Exam 2 Fall 2015 Total of 105 Points Version 1
Version 1 1. (20 Points) Given the class A network address 117.0.0.0 will be divided into multiple subnets. a. (5 Points) How many bits will be necessary to address 4,000 subnets? b. (5 Points) What is
Chapter 9: File System Interface
Chapter 9: File System Interface File System Interface File Concept Computers store information on different [physical] media Flash Drives, Magnetic disk, Optical Disks, Magnetic Tapes OS provides a uniform
CIS-331 Spring 2016 Exam 1 Name: Total of 109 Points Version 1
Version 1 Instructions Write your name on the exam paper. Write your name and version number on the top of the yellow paper. Answer Question 1 on the exam paper. Answer Questions 2-4 on the yellow paper.
The Integration of Grid Technology with OGC Web Services (OWS) in NWGISS for NASA EOS Data
The Integration of Grid Technology with OGC Web Services (OWS) in NWGISS for NASA EOS Data Liping Di, Aijun Chen, Wenli Yang and Peisheng Zhao achen6@gmu.edu; achen@laits.gmu.edu Lab for Advanced Information
The glite middleware. Ariel Garcia KIT
The glite middleware Ariel Garcia KIT Overview Background The glite subsystems overview Security Information system Job management Data management Some (my) answers to your questions and random rumblings
Oracle EXAM - 1Z Oracle Solaris Certified Associate Exam. Buy Full Product.
Oracle EXAM - 1Z0-876 Oracle Solaris Certified Associate Exam Buy Full Product http://www.examskey.com/1z0-876.html Examskey Oracle 1Z0-876 exam demo product is here for you to test the quality of the
A Replica Location Grid Service Implementation
A Replica Location Grid Service Implementation Mary Manohar, Ann Chervenak, Ben Clifford, Carl Kesselman Information Sciences Institute, University of Southern California Marina Del Rey, CA 90292 {mmanohar,
11/10/2011. Directory Structures (continued)
1 2 3 4 Guide to Parallel Operating Systems with Chapter 6 Directory Commands Objectives Describe directory structures Display directory structures Navigate directory structures Work with directories Work
Files (review) and Regular Expressions. Todd Kelley CST8207 Todd Kelley 1
Files (review) and Regular Expressions Todd Kelley kelleyt@algonquincollege.com CST8207 Todd Kelley 1 midterms (Feb 11 and April 1) Files and Permissions Regular Expressions 2 Sobel, Chapter 6 160_pathnames.html
Aliases are set manually or in a login script. Aliases that were set manually will be gone the next time you login.
Page 1 and 2: question without commands. Page 3 7 : questions with answers. Aliases are set manually or in a login script. Aliases that were set manually will be gone the next time you login. 1. List your
Introduction to the Linux Command Line
Introduction to the Linux Command Line May, 2015 How to Connect (securely) ssh sftp scp Basic Unix or Linux Commands Files & directories Environment variables Not necessarily in this order.? Getting Connected