BREAKOUT 2: GAW QUALITY ASSURANCE

Size: px

Start display at page:

Download "BREAKOUT 2: GAW QUALITY ASSURANCE"

Ginger Booth
6 years ago
Views:

1 BREAKOUT 2: GAW QUALITY ASSURANCE Moderators: Emilio Cuevas and Herman Smit Rapporteurs: Dagmar Kubistin and Elke Ludewig Tuesday Afternoon 11 April 14:00-17:00 Salle C1 GAW Symposium at WMO-Geneva April 2017

2 QA/QC Concept of GAW Depending on component/parameter or instrument: PS, CCL, WCC/WRC, and QA/SAC may play different roles.

3 Objective: To assess the state and the future of QA activities in GAW From measurements to easily accessible calibrated data with known and documented quality traceable to reference standards Expected Outcomes: Improved understanding of the role of Central Facilities depending on the parameter / technique Better planning of GAW QA implementation

4 Agenda B-2: 14:00-17:00 (Coffee Break 15:15-15:45) Introduction (60 ): Invited Speakers (15 +5 ) 1. Paolo Laj Concept of the GAW Quality Assurance 2. Joële Viallon Difference in traceability concept in GAW and metrology community 3. Christoph Zellweger Low cost sensors and their role in the future observing systems Part 1 : Present situation in GAW-QA (60 ): Short Contributions Part 2 : Synergy of GAW-QA with other QA-programs? (15 ) Part 3 : The future of GAW-QA: New challenges (15 )

5 Short Contributions (2 each) B2-Aas (3Slides each on Part 1, 2 & 3.pdf B2-Assonov-WMO pdf B2-Cuevas-QA System in EUBREWNET.pdf B2-Khanh-GAW Quality Assurance-Duong Van Khanh (Slides on all 3 parts).pdf B2-Smit-QAQC of IAGOS Measurements-V1 (GAW-April 2017).pdf B2-Steinbacher-The Role of Quality Assurance.pdf B2-Steinbrecher-QA & Traceability VOC.pdf B2-Tsvetkov-Quality Control at WRDC.pdf B2-ZAKARIA.N-Data QA-GuideLines For Tropics.pdf B2-Zellweger-WCC-O3-CO-CH4-EMPA.pdf

6 Questions to be addressed Part 1: Present situation in GAW QA Objectives and principles of GAW QA how do they reflect applications? What are the gaps? How to ensure continuity of Central Facilities? Calibration facilities: Role of metrology community? Data centres: Role in data QC? QA SAC: Data QA as a scientific issue: potential for development of new QAmethods, automated QA-tools, etc. for QC screening of data submitted to the data centres this requires R&D) Do we strategically plan comparison campaigns in collaboration with WCC/RCC?

7 Questions to be addressed (cont d) Part 2: Synergy of GAW QA with other QA programs? Does the current QA approach support integrated observations? Intercomparability (traceability) of networks: Common standards or independent and intercomparable standards traceable to primary standard (BIPM/NMI/PTB)? Collaborations with other network QA s (intercomparisons, joint calibration efforts) Are there other potential organisations/partners who can be involved in GAW QA?

8 Questions to be addressed (cont d) Part 3: The future of GAW QA: new challenges How will GAW QA deal with: New components in the GAW program (e.g. (i) water vapour and collaboration with GRUAN; (ii) integration IAGOS QA/QC) Complementary non-gaw networks (e.g. ACTRIS, AERONET for AOD and AE, EMEP for PM10 and PM2.5) New measurement techniques (i.e. column GHG from FTS/FTIR, SO2, AOD from Brewer ): New CCL s? New calibration techniques: QA-SAC and WCC/RCC Involvement of CIMO in the future

9 Source: GAW IP (GAW Report # 228) Pages Actions in GAW IP: Quality Assurance (1) Actions in the GAW Implementation Plan Specific activities, contributors, timelines? A-QA-1. Standardize as much as possible Data Quality Objectives (DQOs) and measurement methods and procedures for the primary GAW variables (see Box 7.1 (A)). A-QA-2. Improve the quality of measurements through adjustments of methodologies, taking into consideration advancements in instrument development and calibration, and improvement of retrieval algorithms and better sharing of the metadata related to instruments calibration. A-AQ-3. Encourage the continuous operation of the existing GAW central facilities and establishment of the new ones. A-AQ-4. Develop homogenized guidelines for the operation and calibration of instruments. Increase the value and integrity of data through thorough analysis and documentation of uncertainties of all individual measurements and provision of detailed metadata. Role of QA/SAC in collaboration with CCL and WCC/RCC? Centralized raw data processing in WDC (RDC) using calibration coefficients provided WCC/RCC: NRT data processing NRT data QC New roles of some WDCs or RDCs? Establishment of redundant CCLs when possible Establishment of regional data Centers for centralized data processing Flexible organization of "Central facilities" flexible chart adapted for each component / instrument SOP s from WCC/WRC and QA/SAC Metadata submission from stations Uncertainty assessments from SAGs

10 Source: GAW IP (GAW Report # 228) Pages 62 Actions in GAW IP: Quality Assurance (2) Actions in the GAW Implementation Plan Specific activities, contributors, timelines? A-QA-5. Adopt and use internationally accepted methods and vocabulary to quantify the uncertainty in measurements [ISO, 1995; 2003; 2004]. To promote the use of common terminology, a webbased glossary was developed and is updated regularly. Establishment of cooperation programs with BIPM/NMI (financing / mechanisms?) A-QA-6. Continue supporting the operation, maintenance and calibration of instruments, particularly in developing countries. The continuity of instrument calibrations is an important aspect of QA/QC and the GAW Programme has made important contributions through the establishment of WCCs, RCCs and by encouraging intercomparisons following standardized procedures. These helped to improve data quality, homogenizing data from different stations and networks. The cost of calibrations is a significant challenge, mainly in developing countries, that needs attention and creative solutions. Strengthen international cooperation through WMO Trust-Funds Establish crowdfunding mechanisms involving participation of private companies? Organization of regional intercomparisons campaigns financed at regional level Creation of new RCCs even with no references (inviting WCC or other RCCs)

11 Source: GAW IP (GAW Report # 228) Pages 62 Actions in GAW IP: Quality Assurance (cont d) Actions in the GAW Implementation Plan Specific activities, contributors, timelines? A-QA-7. Exploit synergies originating from the use of different instruments to fill data gaps, but always ensure full consistency of the data series. Completeness of data series is important for many applications, mainly for the determination of trends. Ensure intercomparability of different reference materials and methodologies Common data centres or ensuring data flow between different data centres A-QA-8. Develop and implement methods for ensuring the traceability of remote sensing equipment, both ground- and satellite-based, to the WMO primary standard. Strengthening of CCL s and development of cooperation programs with metrology Institutes (BIPM/NMI) Financial contribution of satellite communities to CCLs?

12 An example: QA system in EUBREWNET (Emilio Cuevas) Intercomparison Capacity building SOP; Audit MetrologicaI Institute (PTB) Maintenance of the triad reference ETC with Langley Primary Standard Central Calibration Laboratory (CCL) Regional Calibration Center (RCC) Scientific Advisory Group Data Quality Objectives Standard Operating Procedures Algorithms, protocols and processes for QC& QA EUBREWNET Management group Acts as QA/SAC Pre & Post Calibration NRT Raw data acquisition and storing NRT data processing with Pre-Cal (1.0) NRT QC feed-back QA-data with pre and post (2.0) Data integrity Data flagging & classification DataCenter Level 2.0 data submission EUBREWNET Station WOUDC World Data Center

Internal Experts Evaluation And Harmonisation External Experts QA/QC Documents As Metadata Assessment Reports As Meta Data Every Five

13 IAGOS & Other Airborne Data IAGOS-Flight Data IAGOS-Instrument Example IAGOS-QA/SAC Concept QA/QC Evaluation & Harmonisation Every Two Year: QA-Protocols Regular Calibrations Check On Internal Consistency Check On External Consistency Collecting QA/QC- Protocols Internal Experts Evaluation And Harmonisation External Experts QA/QC Documents As Metadata Assessment Reports As Meta Data Every Five Year: QAQC of IAGOS Measurements: WMO, Geneva, April 2017 Uncertainties & IAGOS-Data Base & NRT-Data

Commission for Atmospheric Sciences: Quality Management Framework in the Global Atmosphere Watch (GAW) Programme

WMO World Meteorological Organization Working together in weather, climate and water Commission for Atmospheric Sciences: Quality Management Framework in the Global Atmosphere Watch (GAW) Programme Commission