16.04.02 Final Project Report Document information Project Title HP Tool Repository of SESAR standard HP methods and tools Project Number 16.04.02 Project Manager DFS Deliverable Name 16.04.02 Final Project Report Deliverable ID D06 Edition 00.01.00 Template Version 03.00.00 Task contributors Airbus, DFS, Eurocontrol, ENAV, NATMIG Abstract This document is the last deliverable for SESAR P16.04.02. It provides a brief summary of the outcomes achieved during the project s execution phase. The rationale for this project is described and the tasks performed to establish an electronic Human Performance repository are presented, together with the resulting deliverables. Conclusions and recommendations complete this report.
Authoring & Approval Prepared By - Authors of the document. Stefan Tenoort / DFS Project Manager 25/06/2014 Reviewed By - Reviewers internal to the project. Plinio Frasca / ENAV Project Coordination ENAV 09/07/2014 Renée Pelchen-Medwed / Eurocontrol Task Leader 11/07/2014 Erik Nilsson / NATMIG Project Member 11/07/2014 Sonja Biede / Airbus Project Coordination Airbus 10/07/2014 Reviewed By - Other SESAR projects, Airspace Users, staff association, military, Industrial Support, other organisations. <Name / Company> <Position / Title> <DD/MM/YYYY> Approved for submission to the SJU By - Representatives of the company involved in the project. Plinio Frasca / ENAV Project Coordination ENAV 09/07/2014 Sonja Biede / Airbus Project Coordination Airbus 10/07/2014 Renée Pelchen-Medwed / Eurocontrol Task Leader 11/07/2014 Erik Nilsson / NATMIG Project Member 11/07/2014 Rejected By - Representatives of the company involved in the project. <Name / Company> <Position / Title> <DD/MM/YYYY> Rational for rejection None. Document History Edition Date Status Author Justification 00.00.01 25/06/2014 Final draft Stefan Tenoort 00.01.00 11/07/2014 Final Stefan Tenoort Intellectual Property Rights (foreground) This deliverable consists of SJU foreground. New Document due to changed template for Final Closure Report. Content of former final report (submitted to SJU on 15/05/2014) was integrated and adapted where required. Approved for submission to SJU 2 of 7
1 Final Project Report 1.1 Introduction Air traffic management (ATM) is made by humans and this becomes particularly evident whenever new systems or procedures are introduced. While in the design and development of an ATM system a wide range of engineering issues related to hardware, software and operational environment have to be addressed, the human aspects of jobs, tasks, and procedures must also be dealt with. Although assisted by new systems, procedures and automation, the human role will continue to be central to the evolution of ATM. As future ATM aims to be flexible to accommodate the expected traffic increase and enhanced capacity while ensuring safety it demands even more of people. As Human Performance issues are a key driver of ATM performance, they need to receive considerable attention and should be treated as seriously as other business-critical functions, because the realisation of such goals will depend on how well Human Performance is considered in the planning, design, operations and maintenance of ATM systems. The full implementation of the existing Human Performance best practices, methods and tools would significantly increase the Human Performance related benefits throughout European ATM. The availability and accessibility of such methods, tools etc. in the form of a repository assures that WP4-15 projects use validated, useful, and available methods for their HP assessment. Hence this project understands itself as an important contributor in the context of Human Performance and its integration in system engineering through pro-actively providing SESAR projects with HP-related reference material. 1.2 Aim of Project The objective of this project was to create a repository of Human Performance (HP) related methods, tools, guidelines, techniques and models together with best HP practices which are essential to respond to the challenges of SESAR and to the evolving needs of the Human Performance Management system and thus assist the pro-active management of HP issues in SESAR. The purpose was to provide an internet based tool to the SESAR community, specifically technical and operational projects, which comprises detailed descriptions of relevant HP related methods, tools, guidelines and techniques. As such P16.04.02 did not provide a direct contribution to the ATM Master Plan. The scope of the project was to develop and establish an electronic repository of generic Human Performance (HP) methods, techniques, and guidelines and thus to contribute to the HP reference material provided by P16.06.05 to support primary projects during development and validation. Also, this project was defined as a transversal project, hence it did not have a direct link to deployment activities. The e-hp repository can only indirectly influence and support the deployment in a way that the material provided in the repository is taken into account during the design, development and validation future systems. 1.3 Deliverables The HP repository was developed within three tasks as follows. Each task has an associated deliverable. 1.3.1 D02 - Description of selection process and initial list of methods, tools, techniques, guidelines and models The selection of methods, tools, etc. was the first step in the creation of the HP repository which was divided into two sub tasks. The first was the definition of selection criteria for inclusion of guidelines, techniques, methods, models and tools. To be included into the HP Repository guidelines, techniques, methods, models and tools had to meet certain criteria, e.g. availability, applicability, usability, validity, etc. To collate and populate the HP Repository from the vast list of potential candidates only those that met the selection criteria were included. Thus minimal quality standards are met and the needs of SESAR primary projects to conduct their HP activities are considered. The second sub task was the compilation of appropriate HP material for inclusion in the repository. 3 of 7
Besides SESAR internal deliverables, literature review, analysis of other sources like internet database, experiences from project partners and other stakeholders yielded important contributions to the repository. This task was concluded with deliverable D02: Description of selection process and initial list of methods - tools - techniques - guidelines and models. This deliverable describes the selection criteria for inclusion of guidelines, techniques, methods, models and tools into the HP Repository, e.g. availability, applicability, usability, validity, etc. Based on these criteria the compilation of appropriate HP tools for inclusion in the repository was performed. From the vast list of potential candidates only those that meet the selection criteria will be included. Thus minimal quality standards are met and searching the database will be facilitated. As such this deliverable comprises a list of methods, tools, guidelines, techniques, and models. These needed to be structured, categorised and described which was performed in the following task. 1.3.2 D03 - Text version of HP repository After appropriate guidelines, techniques, methods, models and tools to be included in the HP Repository were identified, they had to be described. This task consisted of two subtasks. The first was the definition of a taxonomy for the initial structure of the repository. A taxonomy can be understood as a classification or categorisation scheme to order and organise the repository. The defined structure and taxonomy should enable the user of the repository to select and use an adequate method or tool without searching for the necessary information himself or only with limited effort. The second subtask was the description of a method, tool or guideline, etc. which contains the definition, its aims, the procedures to perform it, the data it obtains and the output it delivers. Furthermore such description contained an indication of the required resources and expertise, possible advantages and disadvantages, connections to other method and tools, references, examples etc. This task resulted in D03: Text version of HP repository. This deliverable constituted the text version of the HP repository. It contains the methods, tools, guidelines, techniques, etc., identified in D02 which are described in detail according to a defined taxonomy. The deliverable D03 forms the basis for the transformation into the electronic version of the HP Repository. 1.3.3 D04 - e-hp repository incl. Guidance The electronic version of the repository (e-hp repository) was the final outcome of this project. The aim was to deliver the repository in a form that can be easily used at project level by providing a simple navigation structure that matches the taxonomy defined in the previous task T-003. Two subtasks were allocated. First was the definition of requirements and specifications for the e-hp repository. Because of the limited resources and expertise P16.04.02 did not intend to develop a completely new software tool. Instead the e-repository should be based on existing software and existing document and data formats. Therefore requirements and specifications had to be defined to select the appropriate existing software solution. The second subtask was to establish a prototype e-hp repository. The electronic Human Performance Repository (e-hp Repository) was developed by EUROCONTROL in-house IT consultants (PRISME ATM Business Solutions) with the D03 - Text version of HP repository [5] as the basis. The solution developed was based on the free open-source content management framework Drupal. The development process followed an interactive approach. After initial requirements were defined, the development team created a prototype, which was tested internally by the project members. Identified issues and change request were subsequently implemented into another prototype and tested again until a mature prototype was developed. This final prototype was handed over to P16.06.05 HP coordination function Task22 for final testing and validation [8]. The feedback concerned the structure and general usability of the repository. Most of the suggested changes were implemented in another prototype. Another final iteration with thorough project internal testing and fine tuning resulted in the version released to SJU. The URL for direct access of the e-hp repository is http://www.eurocontrol.int/ehp/. The e-hp repository is a collection of standard human performance methods, tools, guidelines and techniques. The selected material in e-hp Repository can be used by SESAR Primary Projects either 4 of 7
in human performance (HP) related development or validation of systems or procedures. It provides the information that is necessary to make an informed choice of methods or tools etc. that best fit the specific needs or purposes of a SESAR project, e.g. in delivering a more comprehensive HP assessment or in assisting projects to answer HP related questions. The reference material is intended to be used by SESAR WP4-15 projects during design, development and validation. The purpose is to provide information relating to design enhancements, safety features, automation impacts, human-system performance trade-offs, ease of use, interaction with the system, communication processes, situational awareness and workload, etc. The repository shall help designers, project managers, Human Factors specialists and others to consider Human Performance issues throughout the life cycle of the air traffic management system and shall be equally useful for airborne and ground based SESAR projects. The content of the e-hp Repository is categorised along the HP argument structure used in P16.04.01 HP assessment process and thus will help to conduct the human performance activities that are required within the framework of the HP assessment and outlined in the HP reference material. Each resource in the repository provides first a general description of the method, tool, technique or guideline, followed by a more detailed technical description which shall provide the reader with deeper understanding of the contents of the method, how it is applied and the results that are obtained. Finally, the practical attributes of the selected material is assessed; their advantages and disadvantages, its usability and required expertise and the cost information provided. Further information on access and use of the e-hp Repository can be found in [9]. 1.4 Conclusions and Recommendations The e-hp repository is a useful mean for those involved in design, development and validation of systems within technical and operational projects. It provides an overview of relevant Human Performance related methods, tools, guidelines and techniques and is a help to select the appropriate ones. The content of the repository is ordered alongside the HP assessment process developed by 16.04.01 and the HF argument structure and HP activities contained therein. As such the e-hp repository strongly supports the HP assessment process. As it is an internet-based solution, a widespread user community can have access, though a direct link is not yet established on the SJU Extranet. In the future it is expected that the users provide feedback and amend the repository. Provisions are made to exchange opinions through a forum functionality and a contact form. The maintenance and update of the content currently lies in the responsibility of P16.06.05. However long-term maintenance regarding contents but even more technical aspects, like hosting and servers, are unclear and not solved at the moment. The necessary steps need to be taken to preserve the efforts which were expended to create the e-hp repository. A small project team with similar background and mutual understanding enabled close coordination and cooperation. The expertise of team members complemented each other very well. Thus, an efficient work share with clear roles & responsibilities was achieved and careful and well planned WebEx conferences saved travel expenses. Finally, the chosen sub-contractor to develop and establish the electronic HP Repository proved its expertise and implemented all requirements and change requests to full satisfaction. As criticism remains the formal management procedures and processes, which resulted difficult to deal with, complex and time consuming. Although progress and steps forward were made during the project, room for improvement is certainly possible in this area. As a consequence the project management effort exceeded the allowed effort from the PIR phase given by the SJU (5% rule). Small projects like this are at a disadvantage to fulfil formal management requirements to the outmost. A minimum effort as baseline should be allowed for formal project management, before the 5% rule should be applied. 5 of 7
2 References Reference to main documentation, delete if not required [1] SESAR Programme Management Plan, Edition 03.00.01 [2] European ATM Master Plan, Edition 2 [3] Multilateral Framework Agreement ( MFA ) signed between the SJU, EUROCONTROL and its 15 selected members on August 11, 2009, amended on 14 June 2010, 19 October 2010 and 2 July 2012 [4] Latest Project baseline (to be completed by project) [5] SESAR 16.04.02, Text version of HP repository, D03, 00.01.00, Oct. 2012 [6] SESAR 16.04.01, HP assessment process for projects in V2 (Feasibility), D04-001, 00.01.00, Oct. 2011 [7] SESAR 16.04.01, HP assessment process for V1, V2 and V3, D10-001, Oct. 2013 [8] SESAR 16.06.05, Report of the Test Application of the HP Repository, D06, 00.00.02, Aug. 2013 [9] SESAR 16.04.02, e-hp Repository - Release note, D04, 00 01 00, Dec. 2013 6 of 7
-END OF DOCUMENT- 7 of 7