USING PROC GMAP AND DRILL-DOWN GRAPHICS FOR DATA QUALITY ASSURANCE Meghan Arbogast, Computer Sciences Corporation, Corvallis, OR

Transcription

1 USING PROC GMAP AND DRILL-DOWN GRAPHICS FOR DATA QUALITY ASSURANCE Meghan Arbogast, Computer Sciences Corporation, Corvallis, OR ABSTRACT Maps are particularly useful to review the distribution of biological indicators. In this study, the values for an indicator were too numerous to see clearly on one map, so multiple maps were produced using PROC GMAP, ODS, and the SAS macro facility. Each map displays the origin of fish species collected at each site. A drilldown on each location within the map links to a table that includes all the fish that were detected at the site. These simple summaries allowed the analyst to quickly review the validity of many large datasets. INTRODUCTION This paper introduces a program for producing maps that are linked to information about designated geographical locations. The program creates individual maps for unique fish species with points where the species was reported. The points link to a table for all the fish reported from that location. This information allows scientists to visually assess whether a species of fish is native, introduced, or misidentified for a specific geographic location. The data required are latitude, longitude, and a fish species list for each location, and SAS maps. The SAS components used are Base SAS, the SAS macro facility, and the SAS Output Delivery System (ODS). Due to the large number of geographical locations (greater than 100) and number of fish species reported (greater than 150), macros are used throughout the program. BUILDING THE DATA SETS Information collected for an environmental study is the data source. This example uses the dataset fishplace.sds which includes the list and abundances of fish species identified for every geographic location, as well as latitude and longitude. The locations are plotted on the SAS map maps.states, and linked to the data with a drill-down variable. Creation of the drill-down variable The macro, create_drill_down, creates drilldown variables for each site. These will link to the tables containing the data from fishplace.sds for each geographic location that are created in a subsequent macro. The drilldown values are located in the new dataset fishplace2.sds. %MACRO create_drill_down; PROC SORT DATA=fishplace; newsite=left(trim(compress (SUBSTR(site_id,1,6) '_' SUBSTR(site_id,8)))); IF FIRST.site_id THEN DO; CALL SYMPUT ('file_name' ii,trim (LEFT(newsite))); CALL SYMPUT('site' ii,trim(left (site_id))); DATA fishplace2; LENGTH htmlvar $270. altvar $110. drillvar $150.; /*Create the drilldown information */ IF site_id NE '' THEN DO; %DO j=1 %TO &i; IF site_id="&&site&j" THEN DO; altvar='alt="site code:' trim(left (site_id)) "0D"x 'Site name: ' trim(left(st_name)) '"'; drillvar='href="' TRIM(LEFT(SUBSTR (&tablpath,1,21)) "\fish_table_&&file_name&j...html#site&j") ' "'; htmlvar=trim(drillvar) ' ' altvar; % %M %create_drill_down; Example htmlvar: href="c:\fishmaps_wemap2001\fish_table_wwyp99_05 86.html#site256 " ALT="site code: WWYP Site name: Sage Creek" Creation of the fish tables The next step is to create the tables that the drilldown variable values refer to, with the macro create_fish_tables.sas. In this example, each table represents one geographic location, and includes the species and abundance data, and river drainage information the scientists require to make an informed decision as the likelihood of a particular species being present. The tables are then saved as html output using the Output Delivery System (ODS). 1

2 *Create the tables that will be used for the drill down map that have the site_id and fishnames for each site. Replace 'studyyear' with study and year. %MACRO create_fish_tables; PROC SORT DATA=fishplace2 NODUPKEY; BY site_id visit_no name_com; BY site_id visit_no; newsite=left(trim(compress(substr (site_id,1,6) '_' SUBSTR(site_id,8)))); IF FIRST.site_id THEN DO; CALL SYMPUT ('file_name' ii,trim(left (newsite))); CALL SYMPUT ('site' ii,trim(left (site_id))); CALL SYMPUT ('rivername' ii,trim(left (st_name))); CALL SYMPUT ('rf3name' ii,trim(left (rf3name))); CALL SYMPUT ('ecoreg' ii,trim(left (eco_agg_no))); CALL SYMPUT ('econame' ii,trim(left (eco_ag_name))); %DO j=1 %TO &i; DATA fishtabl.fish_table_&&file_name&j; SET fishplace2; WHERE site_id="&&site&j"; TITLE "Fish Identified at &&rivername&j"; TITLE2 "Site Identification=&&site&j"; FOOTNOTE1 "RF3-Alpha Primary Name=&&rf3name&j"; FOOTNOTE2 "Aggregate level III Omernick ecoregion designation=&&ecoreg&j (&&econame&j)"; ODS HTML BODY="c:\fishmaps\studyyear\fish_table_ &&file_name&j...html" ANCHOR="site&j" STYLE=THEME; PROC PRINT DATA=fishtabl.fish_table_&&file_name&j NOOBS LABEL; VAR visit_no name_com latin_name abund vouchers leng_min leng_max origin sampled; LABEL latin_name="genus species"; % ODS HTML CLOSE; %M %create_fish_tables; Now the tables are complete, and the drilldown variables are in fishplace2.sds. The data set fishplace2.sds is sorted by the variable values that will appear on the contents.html page. In this case, the variable fam_or_cls, whose values are the family or class the species belongs to, is used at the request of the scientists viewing the maps. PROC SORT DATA=fishplace2 OUT=fishplace_name NODUPKEY; BY fam_or_cls name_com state site_id; Creation of the annotation dataset The output file fishplace_name from the above sort statement is used in the next step to create an annotation dataset for the maps. The latitude and longitude values will make individual points on the map. Note the html=htmlvar statement, which assigns each map point with the appropriate link from fishplace2.sds. DATA fishanno (drop=state rename=(newst=state)); SET fishplace_name (KEEP=lat long site_id state htmlvar name_com fam_or_cls latin_name vertcode origin); LENGTH function style color $ 8 position $ 1 text $ 20 html $ 200; ATTRIB newst LENGTH=5 FORMAT=Z3.; RETAIN function 'label' xsys ysys '2' hsys '1' when 'b' newst 100; newst+1; color='dagb'; size=1; text='t'; position='5'; style='marker'; x=long*arcos(-1)/180; *NECESSARY CONVERSION OF LONGITUTE TO RADIANS ; y=lat*arcos(-1)/180 html=htmlvar; OUTPUT; newst+1; IF origin='e' THEN color='r'; IF origin='n' THEN color='stp'; size=2; text=' ' origin; position='6'; style='swissb'; html=htmlvar; OUTPUT; SAS Map selection SAS provides several maps, and this program uses the dataset maps.states. This study was conducted in 12 states, so only those states are included. DATA wemaps;*change this according to the states 2

3 in the study; SET maps.states (WHERE=(state IN (49,32,41, 53,16,30,56,38,46,06,04,08))); *The datasets fishanno.sds and wemaps.sds need to be projected with PROC GPROJECT because latitude and longitude are used in the data.; DATA all;*put the files all together to project the data all at once; SET fishanno wemaps; PROC GPROJECT DATA=all OUT=allp; ID state; Creation of the species list The next macro makefishlist - creates a list of all the fish species that were that were identified in the study, from the file allp.sds created above. From this list, the unique code for each species will be pre-pended to a filename that contains data for that fish species only. Each of these files will consist of the location(s) the species was reported, so that each map will display location points for only that species. %MACRO makefishlist; PROC SORT DATA=allp OUT=fishlist NODUPKEY; *create macro variables that are needed to create the files with unique fishnames; SET fishlist; IF FIRST.vertcode THEN DO; CALL SYMPUT ('fish' ii,trim(left (vertcode))); CALL SYMPUT ('fishname' ii,trim(left (name_com))); CALL SYMPUT ('latin' ii,trim(left (latin_name))); *make the vars global so they can be used in the macro mapit created later; %GLOBAL fish; %GLOBAL i; %GLOBAL fishname; %GLOBAL latin; *Determine the number of species in the file, then define a macro variable 'n' equal to that number.; PROC SQL; SELECT COUNT(*) INTO :n FROM fishlist; QUIT; %GLOBAL n; *create each fishname file for response datasets, annotate datasets, and map datasets.; %DO f=1 %TO &n; DATA &&fish&f.._fishplace_namep (DROP=state) &&fish&f.._wemapsp (KEEP=state site_id segment density x y vertcode ); SET allp; IF vertcode="&&fish&f" THEN DO; IF state>100 THEN OUTPUT &&fish&f.._fishplace_namep; ELSE IF state LT 100 THEN OUTPUT &&fish&f.._wemapsp; DATA &&fish&f.._fishplace_namep2 ; LENGTH statename $20.; ATTRIB state LENGTH=5 FORMAT=Z3.; SET &&fish&f.._fishplace_namep; state=stfips(substr(site_id,2,2)); statename=fipname(state); DATA &&fish&f.._wemapsp2 (drop=lat long function style color position text xsys ysys when hsys size htmlvar); SET &&fish&f.._wemapsp &&fish&f.._fishplace_namep2; DATA &&fish&f.._fishannop; SET &&fish&f.._fishplace_namep2; KEEP x y site_id name_com latin_name vertcode function style color position text xsys ysys state hsys when size density segment html statename; %end; %M %makefishlist; Creation of the maps The final macro mapit - create the maps one map for each species collected. PROC GMAP is used to create the maps, the 3

4 annotated datasets with the locality data for each fish (e.g. CATOCOMM_fishplace_namep2) are used to annotate the maps, and ODS is used to create each map as an html file. %MACRO mapit; SET fishlist; IF FIRST.vertcode THEN DO; CALL SYMPUT ('familyname' ii,trim(left(upcase(fam_or_cls)))); GOPTIONS RESET=ALL DEVICE=GIF FTEXT=SWISS CBACK=VPAPB CPATTERN=VLIB ; PATTERN1 VALUE=M1N30 ; ODS HTML BODY="c:\fishmaps\studyfishyear.htm" NEWFILE=PROC NOGTITLE STYLE=theme GPATH="c:\fishmaps" (URL=NONE) CONTENTS="c:\fishmaps\contentsyear.htm" FRAME="c:\fishmaps\frameyear.htm"; %DO f=1 %TO &n; TITLE1 "Sites where &&fishname&f were collected - study year"; TITLE2 "&&latin&f"; ODS PROCLABEL="&&familyname&f &&latin&f (&&fishname&f)"; PROC GMAP DATA=&&fish&f.._fishplace_namep2 map=&&fish&f.._wemapsp ALL; CHORO site_id/discrete NOLEGEND ANNOTATE=&&fish&f.._fishannop COUTLINE=dagb; ID state; QUIT; %end; ODS HTML CLOSE; %M %mapit; USING THE OUTPUT Upon completion of running the program, open up the contents.html file in a web browser. The list of fish species appears, sorted by family or class, and a link to their map is below each name. Next, click a point on the map, such as this point in Oregon, and the table with all the fish collected at that sight comes up. Note: This is a partial list. Click on the link and the map comes up with a point for each location Rainbow Trout were reported. Note: Table has been cropped for this paper. 4

5 The scientist now has a visual aid to assist in the final decision as to whether the species is native or introduced, or even misidentified. Work Phone: Address: arbogast.meghan@epa.gov CONCLUSION The following SAS tools are useful for creating multiple maps with linking capabilities to tables: PROC GMAP to create each map ODS to create HTML output of each map and table SAS macro facility to repetitively create maps, tables, and drill-down variables. The program used for this poster was developed to allow scientists to visually assess whether a species of fish belongs to the geographic location it was reported to be in. A data set with drilldown variables was created for linking maps to tables. A series of tables with lists of species was generated for each geographical location. An annotation data set for the maps was created, and the maps were provided in Base SAS. Finally, the SAS Output Delivery System was enlisted to produce HTML output. Due to the large number of locations and species, all of these stages were conducted with the SAS macro facility. Upon completion of this program, the scientists opened the contents.htm file in a browser, clicked on a species from the species list, and brought up the map for that species. If the species appeared in an unlikely geographic location, the scientist could click on it and study the site s entire species assemblage. This program could easily be modified for any project in which a user would like to link data related to a geographical location, and is especially useful for large or multiple datasets. ACKNOWLEDGEMENTS I would like to thank the U. S. Environmental Protection Agency s National Health and Environmental Effects Research Laboratory in Corvallis, Oregon, for contributions to this poster. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. indicates USA registration. REFERENCES Haworth, Lauren E., Output Delivery System: The Basics Cary, NC: SAS Institute Inc., SAS Institute Inc., SAS OnlineDoc, Version 8, Cary, NC: SAS Institute Inc., CONTACT INFORMATION Your comments and questions are valued and encouraged. Contact the author at: Meghan Arbogast Computer Sciences Corporation 200 SW 35 th St. Corvallis, OR