GLI Standard Higher Algorithm Implementation Status

Transcription

1 GLI Standard Higher Algorithm Implementation Status Junichi Inoue Fujitsu Limited Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

2 Outline Topics: (1) GAIT organization (2) Progress of this year (since Kanazawa GLI workshop) (3) Future Plan Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

3 GAIT Organization Science Group (PIs) - Development of algorithms - Describing ATBD, etc. GAIT (GLI Algorithm Integration Team) Contractor (SED/Fujitsu Ltd.) - GSS development GAIT Leader - Supplying simulation data Sub-group Leaders - Setting up of conversion procedure - Supplying toolkit Invited Researchers - Providing technical - Conversion to operational software support - Optimizing software - Describing File - Describing Product Description, etc. Specification, etc. Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

4 Our Position in NASDA GLI Oversea Station Data Flow Software Flow ADEOS-II Media EOC Online EORC ADEOS-II Data Processing System (research purpose) Basic Proc. Other Higher Proc. Level-1 Product ADEOS-II Data Processing System GLI Level-1 Processing GLI Higher Processing GLI Higher Proc. Archiving and Ordering Mission Management All Product JMA JAFIC Revised Higher Level Algorithm Programs GAIT Algorithm Implementation General User EOC: Earth Observation Center EORC: Earth Observation Research Center JMA: Japan Meteorological Agency JAFIC: Japan Fisheries Information Service Center Higher Product Delivery of Higher Level Algorithms Science Team (PI, CI, etc.)

5 GLI Standard Products Flow (~Level 2) Ver.1.9a May. 29, 2000 Level-0 L1A L1A Generation Generation NASDA Level-1A L1B L1B Generation Generation NASDA Legend process(program) planning production process(program) ordering production product(file) Level-0 Level-1 Level-1B pre_atsk3_p pre_atsk3_p T.Nakajima ice/water flag (workfile) ATSK3_p ATSK3_p T.Nakajima Rmin Rmin generation(4days) generation(4days) NASDA NASDA ATSKD ATSKD NASDA (workfile) segment data Rmin Rmin generation generation Rmin(4days) (workfile) OATSKD OATSKD NASDA Level-2A_OA OTSK1a_LR OTSK1a_LR H.Fukushima ATSK1,2/CTSK1 ATSK1,2/CTSK1 S.Ackerman/K.Stamnes CLFLG_p OTSK13_LR OTSK13_LR H.Kawamura OTSK1a_FR OTSK1a_FR H.Fukushima OTSK13_FR OTSK13_FR H.Kawamura LTSK1 LTSK1 A.Huete LTSKG LTSKG T.Hashimoto PGCI (workfile) LTSK10 LTSK10 A.Huete/NASDA Level-2A_LC PGCP CTSK2b1_g CTSK2b1_g K.Stamnes CTSK2b1_s CTSK2b1_s K.Stamnes Level-2A (CLFLG_p, PGCP:Level-2) CLOP_p (workfile) ATSK3_r ATSK3_r T.Nakajima work_r_w work_r_i Detailed Classification *1 Rmin (28days, workfile) ATSK16 ATSK16 T.Takamura ATSK3_e ATSK3_e T.Nakajima work_e (workfile) ATSK5 ATSK5 T.Nakajima work_ar Rough Classification post_atsk5 post_atsk5 T.Nakajima NL_LR ST_LR OTSK2/5/7_LR OTSK2/5/7_LR B.G.Mitchell OTSK6_LR OTSK6_LR M.Kishino NL_FR ST_FR OTSK2/5/7_FR OTSK2/5/7_FR B.G.Mitchell OTSK6_FR OTSK6_FR M.Kishino ACLC LTSK9 LTSK9 A.Huete *2 Level-2 CLFR CLTT_w_r CLER_w_r CLOP_w_r CLHT_w_r CLOP_i_r CLWP_w_r Daytime CLTT_i_e CLER_i_e CLOP_i_e Nighttime AROP ARAE 1 program (OTSK2567_LR) CS_LR 1 program (OTSK2567_FR) Atmosphere Ocean Land Cryosphere *1) ATSK3_r should be executed 2 times. One is to calculate *_w_r products and another is for *_i_r products. *2) The input data of LTSK9 is L2A_LC at the launch time. But ACLC will be used instead of L2A_LC after ACLC validated. No change since last year CS_FR VGI SNGI SNGI_p

6 Progress of this year (1) Schedule of last year (2) Update of standard algorithms (3) Update of MODIS reformat tool (4) Near real time algorithms (5) Update of System Software (6) Release of Ver.0.3 algorithms Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

7 GLI Algorithm Implementation Schedule Event Release Test Standard Algorithm NRT Algorithm System Software GLI Workshop(Kanazawa) ver.0.1 IT ver.0.2 MODIS reformat tool update Design Making GLI Workshop (Tokyo) Enhancement of operationality ver.0.3 IT:Integration Test, OT: Operational Test, EORC-wtc : Level-1 algorithm and operational system development section Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社 OT Data conversion IT Optimization through MODIS data analysis Design (by EORC-wtc, in EOC) Update

8 Update of standard algorithms (1/2) History: ver. release date remarks 0.1 Nov., A lot of problems were found during an acceptance test by EORC-wtc in EOC. - Early delivery of improved version was required. 0.2 Jan., Acceptance test in EOC was passed. - Then OT (operational test) was performed in EOC. - Problems found in OT were almost solved. - Additional improvement related to operational use was requested. 0.3 Nov., Remained problems were fixed. - Enhancement of operationality, such as error processing, result code and processing speed was performed. - New GLI L1B file format was supported. Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

9 Update of standard algorithms (2/2) Update contents 1. Error processing (1) Enhancement of parameter inconsistency check. (2) Set appropriate processing result code, product quality code. (3) Output processing result file even if error happens. 2. Support for new L1B file format (attribute Parameter Ver. is added.) 3. Support for new higher products file format (SD scan_angle was eliminated from L2A_OA/L2 product) Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

10 Update of MODIS reformat tool(1/3) MOD02CSS (coarse by subsumple) are newly supported in addition to MOD021km. MODIS L1B paramet er file GLI L1B MOD02 CSS MODIS reformat tool VNIR SWIR MTIR This tool enables us to analyze real earth observation data with GLI product format both of 1km scene and 0.5deg. global data. Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

11 Update of MODIS reformat tool(2/3) Analysis flow actual resolution MOD02CSS (5km resolution, scene) GLI Level-1B (CSS) (5km resolution, scene) (1km resolution, scene) GLI L2A_OA (5km resolution, path) (4km resolution, scene) Atmospheric Segment Data (0.25deg. resolution, global) (0.25deg. resolution, global) GLI higher algorithms (The results of analysis will be reported in another session) Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

12 Update of MODIS reformat tool(3/3) Data reference GLI L1B [GLI Level-1B Data] l1b_ch1_data *1... l1b_ch19_data [Calibration] DN - radiance conversion factor (gcal, gsys, c1) [Scan Geometry] Solar, Satellite zenith / azimuth angle (solar_zenith, solar_azimuth, sc_zenith, sc_azimuth) [Scan Line Attribute] Latitude, Longitude (l1b blk lat, l1b blk lon) [Land/Water Flag] Land/Water Flag (lang_water_flag) [Earth View Data] Ev_250_Sub5km_RefSB_Band1 Ev_250_Sub5km_RefSB_Band2 Ev_500_Sub5km_RefSB_Band3 Ev_500_Sub5km_RefSB_Band7 EV_1KM_Sub5km_RefSB_Band8 EV_1KM_Sub5km_RefSB_Band19 EV_1KM_Sub5km_Emissive_Band20 EV_1KM_Sub5km_Emissive_Band25 EV_1KM_Sub5km_RefSB_Band26 EV_1KM_Sub5km_Emissive_Band27 EV_1KM_Sub5km_Emissive_Band36 EV_1KM_Sub5km_RefSB_Band13hi EV_1KM_Sub5km_RefSB_Band14hi [Scan Geometry Data] SensorZenith SensorAzimuth SolarZenith SolarAzimuth MOD02 CSS *1 : VNIR = ch.1-19, SWIR = ch.24-29, MTIR = ch [Geolocation Data] Latitude Longitude Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

13 Near real time (NRT) algorithms development (1/3) What is a Near real time product? a. The products that are generated within several hours after Level-0 data receiving b. Supplied only to specific agency c. NRT L1B file structure is slightly different from standard L1B d. NRT higher algorithms are newly prepared based on standard higher algorithms Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

14 Near real time (NRT) algorithms development (2/3) [Characteristics of NRT L1B] - Regional (vicinity of ground station only) - Not divided to scene (1 image is visible path from ground station) - Not divided to VNIR/SWIR/MTIR - Some attributes are added [Characteristics of NRT Higher Products] - Restricted geophysical parameters (Level-2 SST, Level-2 Map NWLR, CHLA, SST) Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

15 Near real time (NRT) algorithms development (3/3) Level Discipline Number Algorithm code Level-2A OASKD, ATSKD, LTSK10 (LTSK10d, LTSK10f) Level-2 atmosphere 10 ATSK1/2/CTSK1, RMIN4, RMIN, ATSK3_r, ATSK3_e, ATSK5, post_atsk5, ATSK16, pre_atsk3_p, ATSK3_p ocean 6 OTSK1a_LR, OTSK2567_LR, OTSK13_LR, OTSK1a_FR, OTSK2567_FR, OTSK13_FR land 3 LTSKG, LTSK1, LTSK9 cryosphere 2 CTSK2b1_g, CTSK2b1_g (CTSK1) Level-2Map L2Map_CLFLG, L2Map_CLOP, L2Map_NL, L2Map_CS/ST, L2Map_SNGI Level-3 Binned L3ASBin, L3ATBin, L3OSBin, L3OTBin, L3CSBin, L3CTBin Level-3 STA Map L3ASMap, L3OSMap, L3LSMap, L3CSMap Level-2 NRT ATSK1/2/CTSK1(NRT), OTSK1a_FR (NRT), New OTSK2567_FR (NRT), OTSK13_FR (NRT) Level-2 Map --- New 2 NRT L2Map_NL (NRT), L2Map_CS/ST (NRT) Total 46 Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

16 Update of System Software(1/4) System Software is a data processing platform constructed in EORC. Though EOC system is designed to manufacture GLI products based on predefined procedure, System Software is designed to test or research new higher algorithms. Other facilities Huge Data Archiver, Open WWW Server, Network Communication Subsystems, etc. 1. Execution, Termination 2. GLI Product 3. Ancillary Data Input Data GLI System Software 4. Control Information File GLI Higher Algorithms 8. Completion Code 5. GLI Product 6.Work Result File 7. Log message Output Data Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

17 Update of System Software (2/4) [Update contents] 1. New communication interfaces to other facilities were added DTF2 : Mass data storage facility in EORC HADES : Common data server in EORC ADEOS-II open data server : Data server for ADEOS-II products 2. Operation management function was improved Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

18 Update of System Software (3/4) ADEOS-II Orbit data TKSC Meteorological Agency User EORC GLI L1B data (Off Line) (DLT) EOC NCS :Added Interfaces Meteorological data Meteorological data -Meteorological data - Other satellite data INPUT GLI NRT L1B (regional area) DTF2 GLI Product OUTPUT GLI Product Service contents are TBD HADES GLI L1B (global area) GLI NRT Product ADEOS-II Open Data Server GLI System Software (GLI Higher Processing Facility for Research) Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

19 Update of System Software (4/4) [Operation management function was improved] GUI-base operation was developed to avoid error operation. Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

20 Ver.0.3 release (Oct., 2001) (1) Outline of integration test (IT) (2) Test environment (3) Test data (4) Results Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

21 Outline of Integration Test Purpose Interface check between GLI System Software and updated GLI higher algorithms Place Date Subject EORC(harumi) Oct. 2 Oct. 24, 2001 All GLI higher algorithms including NRT algorithms Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

22 Test Environment Machine: SGI Origin2000 CPU: MIPS R10000 Processor Chip Revision: MHz 16 Main memory size: 512 Mbytes for each CPU Disk size: 2048 Gbytes (RAID3) OS: IRIX6.5 Compilers: C MIPSpro Compilers: Version 7.3 Fortran MIPSpro Compilers: Version 7.3 MIPS Application Binary -64 (*1) Interface(ABI): Used software: NCSA HDF library 4.1r1 SDP Toolkit ver5.2.1 EOC Toolkit ver1.3 EORC Common Library ver1.6 LSF ver3.2 *1) -64 means generating 64bit mode application software. Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

23 Test Data Two types of GLI Level-1B simulation data are prepared for our project. L1 simulator data was used in this test. MODIS reformat GLI data - Actual Earth observation data - GLI products format - No tilt image - Orbit, attitude, other observation parameter is different from them of GLI Level-1 Simulator Data (GSD (GLI Synthetic Data) ) ( GLI Level-1 Simulator Session) - Simulated data, not real but true value is known - GLI products format - Tilt image included - Orbit, attitude, other observation parameter is GLI s one. Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

24 Test Results Integration Test Finally following items were confirmed: - Interfaces between system software and algorithms - Error processing, log message function All of algorithms were passed to IT except LTSKG. (The test of LTSKG is postponed under the agreement with EORC-wtc) Ver.0.3 was released. Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

25 Future Plan a. Brush up of GLI algorithms will be performed continuously. b. Ver.1.0 (launch version) of GLI algorithms will be prepared. c. Training of operation system will be planned. Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

26 Conclusion a. Standard algorithms were updated and optimized. b. Near Real Time algorithms were newly developed. c. MODIS reformat tool and system software were updated. d. Integration test was successfully completed and ver.0.3 was released. Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社

27 Contact Point GAIT Leader : Takashi Y. Nakajima, nakajima@eorc.nasda.go.jp Algorithm Implementation Support : Junichi Inoue (Fujitsu Ltd.), inoue.junichi@jp.fujitsu.com Nov 14, 2001 All Rights Reserved, Copyright (C) 富士通株式会社