Computer Graphics. - Introduction - Philipp Slusallek. Philipp Slusallek. Computer Graphics WS 2014/15

Transcription

1 Computer Graphics - Introduction -

2 Overview Today Administrative stuff History of Computer Graphics (CG) Next lecture Overview of Ray Tracing

3 General Information Core Lecture (Stammvorlesung) Applied Computer Science (Praktische Informatik) Lectures in English Time and Location Wed 16-18h, HS 03, E1.3 Fri 8:30-10h, HS 02, E1.3 ECTS: 9 credit points Web-Page Schedule, slides as PDF, etc. Literature, assignments, other information Sign up for course on LSF During general signup period [Do not forget to sign-out in time before the exams, if you need to]

4 People Lecturers E1.1, Room E18, Tel. 3830, Assistants Piotr Danilevski E1.1, Room E12, Tel. 3792, Arsene Perard-Gayot E1.1, Room E11, Tel. 3837, Beata Turonova E1.1, Room E15, Tel. 3836, Secretary: Hanna Loger E1.1, Room E18, Tel. 3831,

5 Exercise Groups TBD Please register on the course web page

6 Weekly Assignments Weekly assignment sheets Theoretical & programming assignments You will incrementally build your own ray tracing system System will be the basis for the Rendering Competition Grading (changed) Results will contribute to the final grade Bonus points (towards exam) are possible Handing in assignments Theoretical: In paper form Code: to assistant (see exercise Web page) Exercise meetings Discuss lectures and problems with TAs Groups of max. 2 students allowed Each one must be able to present and explain all results!

7 Grading Weekly Assignments Counts 30% towards final grade (with +20% bonus points) Rendering Competition Counts 10% towards final grade Grading: Artistic quality only (jury) Groups of max. 2 students (but higher requirements then) Exams Mid-term exam counts 20% towards final grade Final exam counts 40% towards final grade Minimum: 50% to pass in each Cheating 0% of assignment grade on first attempt Possibility to fail the entire course Chance for Repeated Exam Oral exam (if possible) at the end of the semester break

8 Rendering Competition

9 Rendering Competition Task Create a realistic image of a virtual environment Incorporate additional technical features into your ray tracer Bonus points count towards exam Creative design of a realistic and aesthetic 3D scene Modeling and shading Hand-out in early in course You can work on it during the entire course Deadline will be announced (Web) Results: One rendered image Web page with technical detail info

10 Text Books Suggested Readings: Matt Pharr, Greg Humphreys, Physically Based Rendering : From Theory to Implementation, Morgan Kaufmann Series, 2005 Peter Shirley, Fundamentals in CG, 2. Ed, AK Peters, 2005 Alan Watt, 3D Computer Graphics, Addison-Wesley, 1999 Older Foley, Van Dam, et al., Computer Graphics: Principles and Practice, Addison-Wesley, 2. Ed, 1996 Andrew Glassner, An Introduction to Ray-Tracing, Academic Press, 1989 More specific Thomas Akenine-Möller, Eric Haines, Real-Time Rendering, 2nd Ed., AK Peters, 2002 Andrew Woo, et al., OpenGL Programming Guide, 3. Ed., Addison- Wesley, 1999

11 Course Syllabus (Tentative) Overview of Ray Tracing Vector Algebra Review Camera Models Geometry Intersections Acceleration Structures Affine Transformations Lighting Material Models Texturing Volume Rendering Distribution Ray Tracing Anti-Aliasing Shading Human Vision Color HDR Imaging

12 What is Computer Graphics? Photography Rendering Engineering CAD/CAM/CAE Psychology Perception Graphics Physics Simulation Geometric Modeling Mathematics Inverse Rendering Vision

13 What is Computer Graphics? Computer Games Color Management VR/AR Languages Modeling Animation Systems GUI Rendering Imaging Visualization Plotting Digital Media Compression Computer Vision Printer Computer Architecture Mathematical Modeling And, and, and,...

14 Computer Science on Campus Multimodal Computing and Interaction

15 Computer Science on Campus Multimodal Computing and Interaction

16 Research & Innovation in SB Industry Research Valley of Death TM Business Units Researchers DFKI ASR Engineers Intel-VCI Max-Planck Institutes Start-Ups (new IT-Incubator Saar) University 1 Research 10 Engineering 100 Blue-Sky Research Basic Research Applied Research Demonstrator Prototype Produkt

17 DFKI: German AI Research Center Motto Providing Computers with Eyes, Ears and Common Sense Key Facts One of the largest application-oriented CS research institute in Europe PPP: Industry network/shareholders EADS, BMW, Daimler, Intel, Microsoft, 5 Locations in Germany Saarbrücken, Bremen, Kaiserslautern Berlin & Osnabrück > 400 researchers (>800 with students) ~ 40 M revenue per year > 60 spin-offs

18 DFKI: Agents & Simulated Reality Bringing together AI and Graphics (since 2008) Simulated Reality (graphics, interaction, simulation) Multi-agent Systems (reasoning, planning, intelligent behavior) Secure Software (safety & security, reasoning over space and time) Visualization Center (presentation, teaching/training, consulting) Application-Oriented Research About 30 PhDs and researchers (plus many HiWis) Many publicly funded projects Benefits EU: VERVE, SocialSensor, FutureInternet PPP, Osmose, National: Softwarecluster, Arvida, Collaborate3D, ECOUSS, CISPA, Industry: Audi, VW, EADS, Barco, Pilz, Siemens, Researcher/engineer plus many HiWi, Bachelor, Master, PhDs Extremely broad industry network (Jobs, etc.)

19 Intel Visual Computing Institute Institute of Saarland University in collaboration with Intel Labs, DFKI, MPI for Informatics, and MPI for Software-Systems Plus MMCI Excellence Cluster & CISPA Center for IT Security Project-oriented: ~55 researchers across 18 research projects) Funded by Intel (12 Mio for 7 years) 4 Intel employees co-located, nicely growing Focused on basic research within application context Open and Collaborative research Open for other industry and research institutes EU network (Paris, Lund, Karlsruhe, others), growing quickly US sister institute (ISTC-VC: Stanford, Cornell, MIT, Washington, ) Benefits Offers many new HiWi, Bachelor, Master, PhD opportunities Good contacts to Intel and other industry (Jobs, etc.)

20 Intel-VCI Research Network ISTC-VC SCI Institute, Utah, USA Stanford University, California, USA

21 Agents and Simulated Reality Agents and Simulated Reality Visualization Center Georg Demme (DFKI) Simulated Reality Hilko Hoffmann (DFKI) Verification and Evaluation Werner Stephan (DFKI) Multiagent Systems Klaus Fischer (DFKI) Computational 3D Imaging Tim Dahmen (DFKI) Intel Visual Computing Richard Membarth (IVCI) Computer Graphics Lab (UdS) Cluster of Excellence (MMCI)

22 Flexible Production Control Using Multiagent Systems Verification and Secure Systems (BSI-certified Evaluation Center) Physically-Based Image Synthese ASR Research Topics Scientific Visualisation GIS and Geo Visualization Reconstruction of Cultural Heritage Future City Planning and Management Large 3D Models and Environments Large Visualization Systems Intelligent Human Simulation in Production Web-based 3D Application (XML3D) Distributed Visualization on the Internet

23 Multi-Agenten-Systeme: Flexible Production Control Using Multiagent Systems Saarstahl, Völklingen

24 Verification and Secure Systems (BSI-certified Evaluation Center)

25 Physically-Based Image Synthese

26 Efficient Simulation of Illumination DFKI Computer Agenten Graphics und WS 2014/15 Simulierte Realität 26

27 Scientific Simulation and Visualization

28 Large CAD Models

29 Large Visualization Systems

30 GIS and Geo Visualization

31 Reconstruction of Cultural Heritage

32 Future City Planning and Management

33 Intelligent Human Simulation in Production 33 DFKI Agenten und Simulierte Realität

34 Web-Based 3D Application (XML3D) 34 DFKI Agenten und Simulierte Realität

35 Verteilte Visualisierung im Internet Distributed Visualization on the Internet Mobile Visualization Jens Krüger

36 Display as a Service

37 XML3D:Interactive 3D for the Web <html <body> <xml3d id = world1 style = "width: 1000px; height: 500px; >... <group id = "shape_d1" shader = "#s_d1 ondblclick = "triggermenu(event); capture_record(event)"> <mesh type = "triangles" id = "m_mesh > <data> <float3 name= position > </float3> </mesh> </group> </xml3d>. </body> </html>

38 Service-Oriented Platform External Services Rendering Services Virtual Technology Apps PLM/PDM Systems CAE/CAX Systems Simulation Systems (Matlab Simulink u.a.) AI Engines I/O Devices & Sensors (Tracking, MT, 6 DOF) High-Performance Web Services Geo Services Service Interfaces, Web Services, KIARA + RESTful, SOAP, etc. Local Rendering Server-based Rendering Hybrid Rendering XML3D Web-Browser Display and Interaction Display Walls VR-Systems JavaScript, XML3D, CSS Application Logic Event Handling User Interfaces Real-Time Synchronization Object Properties, Kinematics, Collision Semantics Virtual Characters Mobile Devices Multimedia

39 ASR Toolbox: The Big Picture Applications Future Internet Industrie-4.0 Customerspecific Development Intelligent Building Management Life Sciences, etc. Requirements Technology Toolbox Motionsynthesis Virtual Reality Asset Server Middleware ss (Formal) SW- Validation Security Displaysystems 3D-Web etc. Concepts & Methods Research Secure Systems Multiagent Systems Simulated Reality Visual Computing High Performance Computing

40 AnyDSL: The Vision Single high-level representation of our algorithms Simple transformations to wide range of target hardware architectures First step: RTfact for real-time Ray Tracing [HPG 08] Use of C++ Template Metaprogramming Great performance (-10%) But essentially unusable because of weird syntax Now: AnyDSL Pure high-level algorithmic code and simple HW mapping code +10% on Nvidia GPU (via CUDA/OpenCL) +20% on AMD GPU (via OpenCL) +100% on Intel x86 (via vectorization & SIMD)

41 Developer AnyDSL: New Programming Model Easily creating domain-specific abstractions Computer Vision DSL Physics DSL Ray Tracing DSL Parallel Runtime DSL Layered DSLs AnyDSL Unified Program Representation AnyDSL Compiler Framework (Thorin) Various Backends (via LLVM)

42 KIARA Middleware Client Server App IDL IDL App Application Data Mapping Transport Transport Mapping Application Data Negotiation

43 Seminar: Tomography as an Inverse Rendering Problem Tomography Technique for reconstruction of volumetric 3D model from series of 2D images taken from different perspectives Applications in medicine, biology, materials science, physics, archeology First meeting: next Wednesday at 18:00 (CG Chair, E09) Time and place: to be scheduled during the first meeting More information on the CG website under Courses

44 Master in Visual Computing Research-oriented international course of studies Three major areas Image acquisition and geometric foundations Image analysis (image processing, computer vision,...) Image synthesis (computer graphics, visualization,...) Related fields Telecommunications, machine learning, artificial intelligence, signal processing, computational linguistics, medical engineering, cognitive sciences,... Foundations in mathematics, computer science, physics, and mechatronics More information:

45 Wrap-Up Computer Graphics Rendering, Modeling, Visualization, Animation, Imaging, Young, dynamic area Everything is possible mentality Progress driven by research & technology Flexible transfer between research and industry Big industry! Intel, Nvidia, AMD, Imagination, ARM, Automotive, aerospace, engineering, Entertainment: games, film, TV, animations,... Innovation areas Visualization, Industrie-4.0, Big Data, Smart Cities, Interdisciplinary field Relations to mathematics, physics, engineering, psychology, art, entertainment,