maps.live.com PHOTOGRAMMETRY EVOLUTION PHOTOGRAMMETRY EVOLUTION 3D Geospatial Data for the Internet

Transcription

1 PHOTOGRAMMETRY EVOLUTION ISPRS 1992 Film Scanning ISPRS 1996 Softcopy Stereo ISPRS 2000 Digital Cameras Shown ISPRS 2004 Using Digital Cameras THE INTERNET IS NOW SERVING GEODATA PHOTOGRAMMETRY EVOLUTION ISPRS 1992 Film Scanning ISPRS 1996 Softcopy Stereo ISPRS 2000 Digital Cameras Shown ISPRS 2004 Using Digital Cameras ISPRS 2008 Internet Serving Geodata maps.live.com Consumer Electronics Show, January D Geospatial Data for the Internet 1) Franz Leberl Graz University of Technology School of Computer Science Austria 1) Supported by Microsoft Virtual Earth

2 Semi-Manually Fully Automatically Visual Computing in Graz (Austria) MICROSOFT & AERIAL IMAGERY COMPANY VEXCEL May 2006 Vector MAY Dimensional plus Oblique Imagery

3 Aerial Bird s Eye maps.live.com Virtual Earth At Work In Our Everyday Life maps.live.com Virtual Earth At Work In Our Everyday Life Search and locate points of interest by category, business name, or address using VE search maps.live.com Virtual Earth At Work In Our Everyday Life maps.live.com Virtual Earth At Work In Our Everyday Life Get directions from one location to another. Traffic reporting to plan your commutin g

4 Maps.live.com Virtual Earth At Work In Our Everyday Life Maps.live.com Live Traffic Cams maps.live.com Create and Share Collections of Our Favorite Points of Interest

5 PERSPECTIVES Search Navigation Games e-commerce Smart Phones Mixed Reality Internet of Things Chips on Body LOCATIONAL AWARENESS SATELLITES GEODATA SOURCES?

6 Kiev New Zealand Aerial Mapping Rockwell 690 Turbo Commander 100 m SATELLITES 18 m Golden Gate New Zealand Aerial Mapping Rockwell 690 Turbo Commander THE INTERNET SERVES GEOSPATIAL DATA YES Every Place, Anywhere, Anytime

7 THE EARTH S LAND MASS THE EARTH S LAND MASS The World in 15 cm per Pixel Sq km 148 million THE EARTH S LAND MASS The World in 15 cm per Pixel ~ 20 Peta Bytes, 2-D THE EARTH S LAND MASS The World in 15 cm per Pixel ~ 20 Peta Bytes, 2-D Kilo Mega Giga Tera Peta Exa Zetta Yotta Kilo Mega Giga Tera Peta Exa Zetta Yotta Denver WE WANT 3D NOVEMBER D Introduced

8 Atlanta Virtual Earth 3D displays realistic images of buildings instead of gray boxes. Microsoft s maps can also be accessed through a web browser and do not require a separate application. Michael Liedtke, AP OCTOBER 2007 Oblique Matches 3D APRIL 2008 All Buildings Refined Textures Vegetation Tree Detection

9 HOW 3D? FIRST EXCELLENT AERIAL IMAGERY UltraCamX/UltraCam Xp 3 Gigabits per Second 565 MB per Trigger One Image per ~ 1 Second ± 2 µm Geometric Accuracy 7,000 Gray Values 565 MB 6 cm resolution UCX Sample Image 11,310 Pxl. ~ 4 Tera-Bytes per Data Unit Unlimited # of Images in One Aerial Sortie Extreme Environmental Challenge 17,310 Pxl.

10 UltraCamX Prime Image Format 17,330 x 11,3100 Pixel 196 Mega Pixel 6,600 Images per Removable Storage Unit UltraCam -- Cone Design 1.8 cm at 300m Flying Height above Ground Digital Sensors Create Range of Image Types Pan + Red + Green + Blue + I-red Slow Film, Fast Film, B&W, Color, Color Infrared CCD Sensors 9 µm pitch UC-D 7,2 µm pitch UC-X 6 µm pitch UC-Xp Microsoft/Vexcel Aerial Camera Evolution UltraCamD UltraCamX UltraCamXp Lens System 100 mm panchromatic 33 mm color 6 0

11 Color Graz GSD 5 cm July 2008 Color Infrared Gleisdorf GSD at 5 cm August

12 cm cm

13 Large Scale Capability Gleisdorf GSD 5 cm August 2008 Radiometric Performance of UltraCam Xp

14 72 db CCD Sensor (> 6000 DN) 14 bit ADC (16384 DN) 16 bit postprocessing (65536 DN) Area (Pan): Min 60 Max Grey Levels bit Market Shares Leica ADS40..55, May 08 Intergraph DMC.71, May 08 MSFT/Vexcel UC.101, Jul 08 Microsoft Vexcel UltraCAM Dynamic Range bits

15 THE MOST SUCCESSFUL AERIAL CAMERA GERMANY Weser Luftbild CHINA Maiden Flight Fall 2006 HOW 3D? SECOND IMAGERY PRODUCTION WITH REDUNDANCY

16 80% Forward Overlap 60% Sideward Overlap

17 Stereo Geometry Two Ray Intersection Frame 175 Frame 176 Frame 177 Frame 178 Frame 179 No redundancy 10 cm Pixel Frame 218 Frame 219 Frame 220 Frame 221 Frame Links σ z ~ ±16.0 to ±33.0 [cm] Multi-Image Geometry Redundancy accuracy Multi-Intersections Improve Statistical Optimum 10 cm Pixel 8 Links σ z ~ ± 4.3 to ± 4.6 [cm] Redundancy automation Redundancy occlusion avoidance

18 Redundancy outlier detection THE EARTH S LAND MASS The World in 15 cm per Pixel towards ~ 200 Peta Bytes, 2-D Kilo Mega Giga Tera Peta Exa Zetta Yotta Dragonfly (Child of Seadragon) HOW 3D? THIRD AUTOMATED 3D PROCESS IMAGE ORIENTATION Extract area and feature based points of interest Link images pairwise: relative orientation

19 Coarse Match Bundle adjustment - Several thousand images -Few GCPs INITIAL CLASSIFICATION DENSE DIGITAL SURFACE MODEL FROM ULTRACAM Graz, Austria TRUE NADIR ORTHOIMAGE MOSAIC Classification Image Mosaic

20 DTM GENERATION DSM DTM Use classification info to remove buildings and trees Smoothing (filtering) Winston-Salem DSM to DEM AUTOMATED BUILDING EXTRACTION Image classification in combination with dense surface model IDs building to be extracted Recent Results Apartment complex in Atlanta Coca-cola building

21 AUTOMATED BUILDING EXTRACTION Extrude / intersect roof polygons to each other Extrude completed roof geometry to the DTM (ie 2.5D) Hyatt hotel Phototexture from UltraCam images AUTOMATED BUILDING EXTRACTION Combined with DEM and Ortho in Virtual Earth 2.5 Dimensional Building, Denver 2.5D has its limitations! MID 2009 ~ 600 CITIES HOW 3D? FOURTH UNCOMPROMISING GEOMETRIC ACCURACY

22 LABORATORY CALIBRATION Target UltraCam X Lab ±0.5 µm level ± 0.5 µm Target Contour Field Calibration by AT Test Area Gleisdorf Flight 2 Altitudes GSD 10 cm 1400m AGL GRAZ GSD 25 cm 3500m AGL Cross Strips Ground Truth / GCPs GPS/IMU UltraCam X GCP results #of GCP positions 516 > 85% GCPS < ±1.5 µm UltraCam X TP-Results #of TP-positions >91% TPs < ±1.5 µm >50% TPs < ± 0.5 µm µm µm

23 UltraCam X TPT results Reg UltraCam X TPT results Reg Zoom in 3 1% of image (~1400 by 940 Pixel) Reg Reg Zoom in 3 1% of image (~1400 by 940 Pixel) Reg Reg UltraCam X TPT results 1% of Image (pos 0-0, center) UltraCam X TP-Results 1% of Image (pos 12-18) #of TPT positions 1858 mean shift x 0.10 µm mean shift y µm min/max x -3.0 µm / 2.8 µm min/max y -2.6 µm / 2.7 µm >90% TPTS < 1.5 µm #of TP-positions mean shift x 0.06 µm mean shift y 0.33 µm min/max x -2.6 µm / 2.8 µm min/max y -3.0 µm / 2.7 µm >90% TPs < ±1.5 µm UltraCam X TP-Results 1% of Image (pos 30-47) #of TP-positions 1057 mean shift x 0.14 µm mean shift y µm min/max x -2.6 µm / 2.8 µm min/max y -3.1 µm / 2.6 µm UltraCam X BA-Result GSD = 10 cm Sig_o = 0.77 µm CheckPts RMSE mm GCPts RMSE mm >88% TPs <±1.5 µm with Add l Parameters

24 UltraCam X 1.0 µm level Stitching of Separate Image Files µm Sensors and 12 Overlaps of the PAN Tie Point Matching RMSE: << ±0.1 pixel Recorded User accessible Two Flights North/South East/West Dense Surface 10 cm Pixel Digital Surface Model From North/South Images

25 Digityal Surface Model From East/West Images Difference DSM North/South minus East/West Images R.M.S. Differences ± 7 cm Vegetation moving in the wind GEOMETRIC ACCURACY Input Multiple Raw Aerial Photos Laboratory Calibration ± 0.5 µm Stitching.. ± 0.6 µm Field Calibration by AT σ o...± 1.0 µm Output Single Ortho Photo TRADITIONAL ORTHOPHOTO Bald Earth Serves as Projection Surface REFLECTIVE SURFACE ORTHOPHOTO Digital Surface Model (DSM) Serves as Projection Surface TRUE ORTHOPHOTO Bald Earth Bald Earth Bald Earth Ortho Projection Reflective Surface Ortho Projection

26 True Ortho-Photo Factory Building Frame 176 GSD 8 cm Frame 219 GSD 8 cm RSO GSD 8 cm HIGHEST QUALITY DENSE MATCHING Previous Current 1 Patch with 988 x 1016 Postings

27 DSM-QUALITY VS ORTHOPHOTO Previous Current GSD 12 cm Previous Dense Matching GSD 12 cm Improved Dense Matching HOW 3D? Multi-Image Trees: Multi- vs. Two-Image Stereo, 2-Image Stereo THIRD & FOURTH REDUNDANCY IMPROVES AUTOMATION Individual Trees No Trees, just Forest Multi-Image Trees: Multi- vs. Two-Image Stereo 2-Image Stereo UltraCam Vegetation Modeling, M. Schardt Individual Trees No Trees, just Forest

28 RECALL Where are the cars? GRAZ ON ~ 46,000 x 23,000 PIXELS 4,500 4, Test Cars

29 90% Correct Substantial redundancy-inspired progress yet to be expected

30 The Virtual Earth Vision "You'll be walking around in downtown London and be able to see the shops, the stores, see what the Walk traffic is like. in Walk a shop in a? and navigate the merchandise. Not in the flat, 2D interface that we have on the web today, but in a virtual reality walkthrough. Sq km 148 Bill Gates million 50th Birthday, London, March 2005 HOW 3D? FIFTH LIMITLESS DETAIL Streetside 2 Centimeters 2 Centimeters

31 Stitched Street-Side Indoors 0.5 Centimeters THE THE EARTH S HUMAN LAND HABITAT MASS The World in 15 cm per Pixel towards ~ 200 Street Peta Side Bytes, in 2 cm 2-D Interior in 0.5 cm USER GENERATED and with 10 x redundancy Towards 1 Exabyte MICROSOFT PHOTOSYNTH Available since 20 August 08 DRIVERS FOR INNOVATIONS?

32 Price-Performance Performance of Computing Moore s Rule: Doubling each 1.5 Years Price-Performance Performance of Computing Moore s Rule: Doubling each 1.5 Years 1 Million MILLION? HONEY, PICK UP A 6-PACK OF COMPUTERS ON THE WAY HOME Mark Weiser, 1996 mind expanding VIRTUAL EARTH S EXABYTE FANTASTIC, UNMATCHED GEO DATA SET WITH GLOBAL USEFULNESS