Midstream GIS in Barnett Managing Data, Delivering Quality. Jan Van Sickle, PLS, PhD Downtown Design Services Inc

Transcription

1 Midstream GIS in Barnett Managing Data, Delivering Quality Jan Van Sickle, PLS, PhD Downtown Design Services Inc

2 GIS, Geomatic Engineering and Remote Sensing are terms that have been in use for decades now. Each of them has several definitions. The variety may be explained by the rate of incredible growth and change in this period.

3 Geoeye 1 Launched September 2008 Over the same decades modes of data collection on land, in the air and on orbit that were once intriguing possibilities are now practical and efficient tools. At the same time the capacity to manage and analyze the massive amounts of data these systems are capable of producing has not only kept pace but even outrun them in some respects.

4 Orange County CA via 3D Arc2Earth Presentation and display have evolved from computerized maps to a recognizable virtual reality. The scope has become worldwide and the applications ubiquitous.

5 As the technologies shift, change and ultimately merge into one geospatial industry clients turn more and more to trusted consultants such for advice and solutions. Professionals must become well-versed and capable of not only choosing but also applying the most efficient and cost-effective methods.

6 Further, since information inevitably originates from all of these different sources and the client must, in the end be presented with a unified view of these data. Data integration capability is essential. In fact, integration is the largest part of the GIS market. In 2005, the GIS market generated $1.9 billion in software sales. But IDC reports that systems integrators and other service providers multiply that revenue by factors of 3 to 5, depending on market segment.

7 It must be said that being such a purveyor of solutions has never been more of a challenge. The proper application of tools for data collections, data management processing and display such as Global Navigation Satellite Systems (GNSS), Remote Sensing and Geographic Information Systems (GIS) require knowledge in geodesy, photogrammetry, numerical analysis and IT as well as skill in measurement and communication.

8 In fact the growth in the required geospatial knowledge base has become so enormous and the pace of GIS business so fast that it often seems as the Red Queen told Alice that, It takes all the running you can do, to keep in the same place.

9 Here is a presentation on the integration of geomatics and GIS. The success of this projects depended on an efficient data path from the field all the way to information served to users on the web. The process involved a wide variety of platforms, technologies and applications but the flow from one to another needed to be transparent to the client. It is my opinion that a well managed data path is the key to a successful GIS implementation.

10 All legal, topographic and as-built work for assigned gas gathering pipeline routes in the Barnett Shale formation which contains ~30 trillion cubic feet of natural gas.

11 Research / Document management Preliminary CAD and GIS development Boundary survey Web based GIS Central Database Topography As-built surveys Construction staking Final CAD and GIS development

12 Initial Line List to Tract Manager Xtreme (TMX) DB Tract Owner Name Legal Description Survey Permission Date Construction Provisions/Stip ulations Acquisition Comments TX-DALL-CALL William F Callejo J E Holland Survey, Abst 614, Tr 17 12/12/08 NEGOTIATING TX-DALL-CALL UT Brazos Electric CITY TX-DALL-CALL UT City of Coppell CITY TX-DALL-CALL UT Brazos Electric CITY TX-DALL-CALL UT City of Coppell CITY TX-DALL-CALL UT City of Coppell CITY TX-DALL-CALL UT Atmos CITY TX-DALL-CALL UT Atmos CITY Our process begins with our reception of the Initial Line List. This list defines the route of the distribution pipelines that carry the gas from the wells to the collection centers. At least it is a first definition of the route. It frequently evolves.

13 This information is immediately used as a basis of a query of our in-house assessor parcel layers for Tarrant, Parker, Denton, Dallas and Johnson Counties. It is important to note that from a surveying point of view this parcel data is approximate.

14 We extract the parcels on the Initial Line List from the pertinent parcel base map and load it into AutoCad Civil 3D and AutoCAD Map 3D.

15 This constitutes our Preliminary Mosaic which is posted to our database. All of the information in this preliminary mosaic will be refined as the process continues.

16 A few words about the database we use throughout the process. It is our single living repository for all project data. This is paramount both because of the constant state of change in the project and the fact that active members of our team located in Denver, Fort Worth and Tulsa need to work together on the same data at the same time. This is one of the foremost reasons for GIS implementation.

17 Alignments, workspaces, drawings and all attendant information undergo many changes (sometimes hourly) and our team recognizes that we absolutely must have a single place to edit, share and store these files to guarantee there will be no duplication and no versioning confusion. For our team, all important project documents live on the database, not just drawings. Survey point files, exhibits, alignment sheets, schedules, survey permissions and other important documents also exist there.

18 There is no upload procedure to follow because the process is automatic. There is always a single, current file that is used by all components of the team. When changes are made to files, users on the other end of the workflow are notified automatically. This real-time aspect of data management is another critical aspect of this type of GIS implementation.

19 Into All And All the plats field record database..... goes. of all. kinds...

20 Compiled As-Built Every Out Results Plots All AutoCad comes of point drawings of existing record GIS. collected. drawings. queries data utilities... in... the..... field...

21 There is always a single, current file that is used by all components of the team. When changes are made to files, or to elements in the database users on the other end of the workflow are notified automatically. This real-time aspect of data management is another critical aspect of this type of GIS implementation.

22 Now regarding our abstracting effort, our team performs its own abstracting for deed and easement research. The Initial Line List also guides our in-house abstracting. The title research is done by our dedicated abstractors working in the regional title research plant under a subscription. As part of this effort we obtain and all easement and leasing documents along with all necessary vesting deeds. It is a huge amount of data to keep track of- to do that it is all organized in a custom database whose UI we call the Tract Manager Xtreme (TMX)

23 TMX is DDSI s system for storing tract data and all documents relating to real property right and interests. It has two essential parts - User interface (desktop and web) Centralized Database

24 Each parcel of land over which the client s route passes, as well as adjoiners to those parcels, is researched. In this way each deed, easement of record, lease, subdivision plat, utility map, right-of-way and/or any other encumbering documents that might affect the primary parcel is stored and referenced. Those references include: type of document, recording date, book and page and/or document number.

25 Tract Manager when first opened. Each parcel of land over which the client s route passes, as well as adjoiners to those parcels, is researched. In this way each deed, easement of record, lease, subdivision plat, utility map, right-of-way and/or any other encumbering documents that might affect the primary parcel is stored and referenced. Those references include: type of document, recording date, book and page and/or document number.

26

27 A drop down menu is used to select the route (task) that a technician will be working in. This task number is used instead of the route name to avoid having to make changes to the entire database when a route name changes.

28 TMX with route selected and tract data displayed. Tract data includes a concatenated string that incorporates the clients tract number.

29 Also included in the database is owner information, legal information, the date the permission to survey, any note that would pertain to the field survey crews.

30 With the Deed tab active, the deed is displayed, whether or not the parcel has been drawn into the mosaic, notes from the abstractor, and any other documents that might affect the parcel. Each record has a hyperlink to the document itself.

31 Such as adjoiner deeds, permission to survey, etc.

32 Here is TMX with a tract selected and the Plat and Easement tab active. Under this tab we can view plats associated with the parcel, the subdivision in which it is situated, lot and block etc.

33 All easements on record that are associated with this parcel are also listed under this tab and viewable with a click of the mouse.

34 TMX with a tract selected and the Exhibit tab active.

35 Under the exhibit with another click we can view the exhibit that is associated with the parcel. The exhibits are used by the client to acquire ROW from the landowners.

36 In other words every record has its own specific set of attribute and is linked directly to the document itself.

37 It s not just the documents and the basic tract information that is stored. It s also the attributes associated with the parcel and the attributes associated with the documents.

38 Plats, easements, utility plans, right of entry, etc, can all be managed in the system. Items that are internal and not of public record are also in the system.

39 All title work is stored digitally and all related information is databased. Through TMX each and every document, i.e. Research Drawings, Deeds, Easements, Plats, etc., obtained through research for the client s pipeline are available and can be queried using its unique identifier by all members of the team no matter where they are located. It should be noted that these documents are also available directly through the webbased GIS UI- more about that later.

40 The resulting Exhibits and Plats are always linked to the particular parcels they address so that retrieval is spatially related. They are also available through the web-based GIS UI.

41 All of this information is absolutely essential to the production of the true boundaries of the parcels involved in the project. And the subsequent refinement of the original approximate parcel data into the actual boundaries. This is a vital step.

42 As one works on that resolution process there is also a place to record new information that is discovered in the database under comments and notes. This allows for true user feedback. Another essential element of a successful GIS implementation.

43 Initial Field Survey to Resolved Parcel Mosaic Now regarding data collection in the field. There is no question that RTK dominates the GPS surveying applications. It is applicable to much of engineering and surveying as well as a myriad of other areas that require centimeter-level accuracy in real-time.

44 However, the requirements of setting up a GPS reference station on a known position, the establishment of an RF transmitter and all attendant components before a single measurement can be made are both awkward and expensive. This, along with the baseline limitation of short baselines, 10 to 20 kilometers for centimeter level work, and lack of redundant measurement has made RTK both more cumbersome and less flexible than most surveyors prefer.

45 In an effort to alleviate these difficulties services have arisen around the world to provide RTCM real-time corrections to surveyors by a different means. Real- Time Networks, RTN, have been developed. We subscribe to such a service for this project.

46 The central idea underlying RTN differential corrections is the combination of observations from several CORS at known positions used to derive a model of an entire region- like the network shown here in the Fort Worth area. Rather than being considered as isolated beacons with each covering its own segregated area- these CORS are united into a network.

47 The data from the network is used to produce a virtual model of the area of interest. Once the roving receivers place within that network is established it is possible to predict the errors at that position with a high degree of certainty. Solving several baselines that converge on a project point simultaneously rather than the relying on just one from a typical RTK set up adds more certainty to the resulting coordinate. It is that RTCM correction signal that we receive over the internet on a cell phone attached to our GPS receivers.

48 There are definite advantages including the elimination of individual base station preparation and the measurement of longer baselines without rapid degradation of the results. These benefits are accomplished by the service gleaning corrections from a whole network of continuously operating reference stations, CORS, rather than just a single base. In this way, quality control is facilitated by the ability to check corrections from one CORS with those generated from another.

49 It also removes the necessity of establishing our own primary control network of control points on the ground.

50 Our surveyors can go into the field with a single GPS receiver and a Total Station and go to work immediately.

51 Our surveyors can go into the field with a single GPS receiver and a Total Station and go to work immediately.

52 That said our team members understand the importance of working with landowners, being considerate of local issues, mindful of the status of survey permissions, treading lightly on private and public property. One of the most important pieces of information in our database is survey permission. We also base the colors of the parcels on this property in our web-based GIS. If the parcel is green the property can be accessed. If the parcel is red- do not survey! And this information can change quickly. This is a good example of a very day-to-day practical application of GIS - Safety.

53 However, there is more to it than that. To ensure that the ground distances between every position collected matches point-to-point measurement on the ground we have created five (5) coordinate zones based on Texas State Plane Coordinates (Zone 4202).

54 And we use a project specific custom data dictionary based on the client s standards. At the client s request we have just written two data dictionaries for Pre- Construction (topography) and for As-Built for not only ourselves but all their other contractors on the Barnett Shale project. The As-Built data dictionary is designed to allow collected data to roll seamlessly in the Pipeline Open Data Standard (PODS) model.

55 BEND Bend TYPE FACTORY BEND FIELD BEND TRIMMED WELD ELL WELD ELL OTHER DESCRIPTION 1 PI LEFT PI RIGHT OVER BEND SAG BEND OTHER DEGREE OF BEND DESCRIPTION 2(COMBO) DEGREE OF BEND 2 OVER BEND PI LEFT PI RIGHT SAG BEND OTHER OTHER DIAMETER OTHER WALL THICKNESS OTHER OTHER To automate the processes all the input data must be the same every time. We begin with a Data Dictionary in which codes are assigned to particular features and their attributes. For example, the code BEND is used in as-built collections. The attribute Wall Thickness is a menu item that contains every wall thickness the crew might encounter on a pipe. This creates a field that will be consistently and accurately filled in every time is exactly the same way.

56 The data dictionaries are also designed to allow collected data to roll seamlessly in the Pipeline Open Data Standard (PODS) model which increases the efficiency of the GIS implementation.

57 PODS is a data model created by a non-profit trade association. It enables the creation of a standards-based GIS database that encompasses the requirements of both the pipeline companies and the regulatory agencies. It also has an open data structure. This means, among other things, that with this model a company can select technologies from multiple vendors or change vendors without the need to rebuild all their existing GIS data. And since it is the most widely implemented and working pipeline data model in the industry that GIS data can be shared between entities efficiently without conversion. Finally it can be implemented as a relational database in both Oracle and Microsoft SQL Server.

58 TEE0 Tee BRANCH DIAMETER menu TYPE menu 10 STRAIGHT 12 REDUCING 16 OTHER 18 INLET DIAMETER menu OTHER 18 PRESSURE RATING menu 20 ANSI ANSI ANSI 600 OTHER ANSI 900 OUTLET DIAMETER menu OTHER 10 WALL THICKNESS menu OTHER 30 COMMENTS text OTHER To illustrate the relationship between the PODS model and our as-built data dictionary the arrows show the correlation between the fields in the database ( in the chart in the middle) with the fields in the data dictionary (on each side).

59 PPLN Existing Pipeline Line SIZE text 30 OWNER text 30 TYPE menu required CHEMICAL GAS LPG OIL WATER DRAIN OTHER (COMMENTS) MATERIAL menu required CAST IRON CONCRETE PE PVC STEEL OTHER (COMMENTS) CLEARANCE (FEET) numeric 2 COVER (FEET) numeric 2 COMMENTS text 30 To illustrate the relationship between the PODS model and our pre-construction data dictionary the arrows show the correlation between the fields in the database ( in the chart in the middle) with the fields in the data dictionary (on each side).

60 Our data collection involves the acquisition of existing topographic aspects of the route. We then stakeout the pipe for construction and as-built the constructed pipe. All work done through our data dictionary on the data logger to cm accuracy in real-time

61 Our data collection involves the acquisition of existing topographic aspects of the route. We then stakeout the pipe for construction and as-built the constructed pipe. All work done through our data dictionary on the data logger to cm accuracy in real-time

62 Initially there is a particular emphasis is on the acquisition of property corners. This required to correlate the property lines on the ground to the work of our Texas abstractors and the initial parcel data.

63 Detailed property surveys are an integral part of the right-of-way acquisition process and we work with the client s staff to delineate all the properties which the proposed facilities will cross. Toward that end our Fort Worth survey staff conducts field surveys to locate all pertinent property corners, county road monuments, highway monuments, and/or railroad right-of-way monuments in the vicinity of the proposed pipeline.

64 This information, record monuments and calculations are necessary for our preparation of legal descriptions included in our exhibit (aka Plat) documents and to accurately plot the proposed rights-of-way in relationship to existing property lines and other easement boundaries in the vicinity.

65 Pnt Numbe r Northing (SPC) Easting (SPC) Elev Pnt Code Key Code (Concatenated String) Date/Time Attribute CHECK_PT F U10LL CHEC 12/30/ : FENCE_PT F U10LL FEPT 12/30/ :55 WOOD POST CONC F U10LL CONC 12/30/ :57 EDGE CONC F U10LL CONC 12/30/ :57 EDGE ROAD_LN F U10LL RDLN 12/30/ :58 STREET ROAD_LN F U10LL RDLN 12/30/ :59 STREET WATER_UT F U10LL WTUT 12/30/ :00 VALVE WATER_UT F U10LL WTUT 12/30/ :00 METER WATER_UT F U10LL WTUT 12/30/ :01 METER WATER_UT F U10LL WTUT 12/30/ :02 FIRE HYDRANT FENCE_LN F U10LL FELN 12/30/ :03 OTHER (COMMENTS) CONC F U10LL CONC 12/30/ :05 EDGE CONC F U10LL CONC 12/30/ :06 EDGE ROAD_LN F U10LL RDLN 12/30/ :06 STREET ROAD_LN F U10LL RDLN 12/30/ :07 STREET FENCE_LN F U10LL FELN 12/30/ :09 OTHER (COMMENTS) All field data is loaded directly into a *.CSV file - no post-processing is required. This *.CSV is then loaded into a central database for use in any program the team uses.

66 WATER_UT F U10LL WTUT 12/30/ :00 METER WATER_UT F U10LL WTUT 12/30/ :01 METER WATER_UT F U10LL WTUT 12/30/ :02 FIRE HYDRANT Users are able to run queries (canned and custom) on this data in any platform as well. The queries can include a particular feature, attribute, position or even time. Stored with every point is the exact time of collection. But even more importantly our points are stored with a unique identifier called the keycode.

67 When all of these field data files arrive at our office they are archived immediately. Then we use Blue Sky to bring all of the field collected points and codes into AutoCad where the building of the geospatial base map is created. Blue Sky is the transitional GIS software used between CAD and GIS by the majority of pipeline companies in North America. First we open Blue Sky through an icon in AutoCAD.

68 Select the project or route by task number

69 Then the file utilities are accessed through this menu

70 The ASCII file button is selected and this dialog is used to import the *.CSV file

71 The field *.csv file is selected

72 The options to import the file correctly are selected. After the points are imported into the database, the points are then inserted into an AutoCad drawing.

73 The points are automatically inserted on the correct drawing layers. This is regardless of whether the points were collected by GPS or by conventional means. All the data goes through exactly the same consistent process. And the detailed attributes of the points as seen in the point block - include the raw data file name, the surveyor, the time of collection, a point code, etc

74 This string is a truly unique identifier. No point can ever be duplicated. This is another key aspect of this sort of GIS implementation. These points are then related to the final alignment for the route that lives in another table in the database. One of the strengths of GIS is this relational component.

75 Another strength is the ability of the user to query the databases. For example, here any part- or all- of the field database can be accessed at any time. And not just points, all of the attributes as well.

76 Pnt Number Northing (SPC) Easting (SPC) Elev Pnt Code Key Code (Concatenated String) FENCE_PT F U10LL FEPT Date/Time Description Size Comment 12/30/ :55 WOOD POST 4" NONE F U10 LL FEPT F = fieldbook file id 282 = task number for a particular pipeline route = date from the user U10 = receiver number LL = party chief initials = date from the GPS receiver = hours minutes seconds from the GPS receiver 0002 = autonumber FEPT = Feature Code- always four digits Here is how that is done.

77 F U10 LL FEPT F = fieldbook file id 282 = task number for a particular pipeline route = date from the user U10 = receiver number LL = party chief initials = date from the GPS receiver = hours minutes seconds from the GPS receiver 0002 = autonumber FEPT = Feature Code- always four digits The keycode string is built automatically when the points are collected. This creates a system where no point can ever be duplicated. No more point numbers to keep organized. Not only is the keycode stored with the point, the position of the point is stored in WGS84 latitude, longitude and ECEF XYZ in the database. The concatenated Key Code is used to extract information from the database through specific custom queries.

78 For example, one query allows the user to see all the points in the route expressed as stations with offsets. Or a user can use a query to find just about any detail of interest, such as, Find all utilities collected on June 24, 2008 on route 254.

79 This information, record monuments and calculations are necessary for our preparation of legal descriptions included in our exhibit (aka Plat) documents and to accurately plot the proposed rights-of-way in relationship to existing property lines and other easement boundaries in the vicinity.

80 Now all this data must be combined with the thousands of recorded deeds, easements, leases- all types of existing property rights documentation we saw in the TMX DB. This is necessary to produce the base map the final mosaic of properties on which the client s right-of-way can be plotted with confidence.

81 It is also important to note that another key to efficiency is the automation of the stationing and sheet producing process at this point. The resolved parcel mosaic with preliminary route design is then posted to the database.

82 It is at this point that the the client s initial route, alignment, right-of-way etc. can be plotted with confidence. It is also important to note that another key to efficiency is the automation of the stationing and sheet producing process at this point. The resolved parcel mosaic with preliminary route design is then posted to the database.

83 Resolved Parcel Mosaic with Preliminary Route Design to Deliverables The final steps toward actual deliverable drawings require topographic information be collected along the route. Another key to efficiency is the fact that the route is well defined when we perform this part of the field surveying and we can concentrate on the actual pipeline corridor. There is no unnecessary data collection and no wasted motion.

84 The workflow now pays the most dividends. While it is quite likely that the initial route will go through several iterations, adjustments and re-routes - in fact, only ½ of all the exhibits we have produced on this project have been based on the originally defined routes. And nearly ¾ have been revised due to those reroutes. Nevertheless, thanks to our process it is always certain that the final mosaic as posted to the database at any given moment can always be depended upon to be current and correct. This is vital.

85 The next steps in the workflow Central Database As-built surveys Construction staking Final CAD and GIS development The speed with which the team can produce field survey final construction staking is also due to the fact that all the necessary information is extracted from a database. Given the final alignment and position of the facilities to be constructed our software routines automatically generate the coordinates and stations of all the necessary stakes.

86 It is important to note that after each stake is placed its position is recorded again and coded in the data collector as an established point in the field. In other words, the system contains not only each and every position before it is staked, but also each and every position after it has been staked.

87 It is important to note that after each stake is placed its position is recorded again and coded in the data collector as an established point in the field. In other words, our system contains not only each and every position before it is staked, but also each and every position after it has been staked.

88 As actual construction proceeds there is a survey crew dedicated to each construction crew ready to as-built the facilities by performing the field survey as-built data collection. It is vital that the crews be present when the trench is open to take the necessary shots and it is equally important that they be prepared to move quickly to collect the necessary information so as to not delay the construction process.

89 When the data from the as-built field work arrives it is immediately archived in the database and an as-built drawing is generated from the information in the database. Please note the background of ortho-rectified photography.

90 This as-built drawing is posted as a client deliverable, along with all of the attendant as-built data.

91 The last steps in the workflow Web based utility Central Database From the beginning of the project it was apparent that while it is a great advantage to have an automated method to gather field data and have recorded data at our fingertips- and a dedicated abstractor to find what we need on short notice- it is not enough. We needed a web-based utility to pull all of this information together and serve it up as needed. The following slides show that utility.

92 Here we are zoomed out to see the entire DFW area.

93 Zoomed in a bit more we see the colored parcels are those which adjoin the routetheir boundaries have been surveyed in the field and their corners established. Easements, leases, and other rights-of-way of record, streets are shown hereanything that affects the route. But this is not just a static map.

94 For example, if you click on a particular parcel you can view data from TMX. This is the same parcel information we just looked at - tract number, owner and the parcel color which indicates survey permission status green means that permission is available- red means it is not. There are also found property corners, utilities and etc. Whenever the data in the databases change this map reflects that change immediately. For example notice the link in the information bubble.

95 It is an embedded link. It will take you to the deed for the particular property with the click of a mouse.

96 Through a link in the proposed easements we can see the current and correct exhibit for that particular route and parcel. This allows anyone on the project to get the current and correct information at any time. No versioning issues.

97 The symbols for the points collected can also be viewed. This particular point is a water vault that has been collected. But again, this is not a dumb map - all of the point attributes are visible as a tool tip when the user hovers the mouse over the symbol. Click on the link to shown in the bubble-

98 You the user is able to download the data in any format. In fact, all of the points collected in the field and their attributes are databased and available.

99 There are even photographs linked to the base map, indicated by the camera icon. The tool tip for these icons contains attributes describing the picture.

100 Click on the icon and the photo will be displayed rotated to the direction in which it was taken. In this way you can see the actual field location in detail.

101 There is also underground utility information in the map. By turning on the layer we can see the line that connects all the valves and other water utility items that were collected click on it and -

102 You will see that this feature also contains a link to the utility plan itself.

103 And there are other documents in this case, construction documents.

104 This link will bring up the actual completed alignment sheet for this portion of the route.

105 By accessing a distributed network of servers which are populated through our data path (field, abstractor research, utility maps, AutoCad drawings, right-of-way acquisition, etc.) the web-based GIS utility provides a living display of the current status of the project at all times on the web. And as as-builts are created the GIS is linked to that data as well. This can produce a very valuable accessible digital record of the built utility which opens the door for the GIS to become a management tool for this distribution network in the future. This GIS is a great application with wonderful potential not only for construction but also for facility management after construction is complete. It is very hard to see a pipe once it is underground.