Display and Kernel Review and Future

Transcription

1 Display and Kernel Review and Future Kernel Recipes 2013 Paris Laurent Pinchart

2

3 Problem Definition

4 display /

5 / graphics /

6 / video

7 display / graphics / video Problem - Purpose

8 format

9 memory / deep pipeline

10 device / CPU

11 format memory / deep pipeline device / CPU Problem - Source

12 rotation /

13 / scaling /

14 / composing

15 rotation scaling composing Problem - Processing

16 X11 /

17 / Wayland /

18 / MIR /

19 / SDL /

20 / DirectFB /

21 / Raw API

22 X11 Wayland SDL DirectFB Raw API Problem - Stack

23 DRM /

24 / FBDEV /

25 / V4L2

26 DRM FBDEV V4L2 Problem - API

27 Frame Buffer Display Scanout

28 CRTC Composition Plane(s) Display Composition

29

30

31

32

33

34 Origins

35 Origins FBDEV 2012 ng at s Li nu x Fo rm ki 4C C Bl an FB D EV,

36 Origins V4L pr e te d M vi ed de ia ob co uf nt D 2 rol M le r AB U F ev ca su bd de V4 L2 V4 L x x nu in u Li,L V4 L2, V4 L

37 Origins DRM/KMS EM F Bu ffe es r s,d M AB U b Pl an D um x TT M M,L in u KM S, G D R

38 Features

39 DRM FB V4L2 Dynamic Allocation Yes No Yes Multiple Buffers Yes panning Yes Import dmabuf No userptr dmabuf Export mmap mmap mmap Memory Management

40 Formats DRM FB V4L2 4CC RGB 4CC 4CC No Yes Enumeration Planes Negotiation No No Yes Atomicity Yes No No Mode Setting

41 DRM FB V4L2 Overlays Yes No Yes Rotation Yes No Yes Scaling Yes No Yes Cropping/Panning Yes Yes Yes Transformations

42 drm fb v4l2 api core Documentation drivers

43 The DRM core exports several interfaces to applications, generally intended to be used through corresponding libdrm wrapper functions. In addition, drivers export device-specific interfaces for use by userspace drivers & device-aware applications through ioctls and sysfs files. External interfaces include: memory mapping, context management, DMA operations, AGP management, vblank control, fence management, memory management, and output management. Cover generic ioctls and sysfs layout here. We only need highlevel info, since man pages should cover the rest. DRM API Documentation

44 drm fb v4l2 api core Documentation drivers

45 drm fb v4l2 api core Code Size drivers

46 drm fb v4l v4l2 fb 0 drm Cumulative Changes - API

47 drm fb v4l v4l fb drm Cumulative Changes - Core

48 drm fb v4l v4l fb drm Cumulative Changes - Drivers

49 drm fb v4l2 drm+bug Mailing List Traffic

50 Frame Buffer (memory) Display Device Device Model FBDEV

51 Frame Buffer (memory) CRTC Encoder Connector Connector Planes (memory) Encoder Connector Device Model DRM/KMS

52 Buffers (memory) Display Device Device Model V4L2 Connector

53 V4L2 queue V4L2 2 subdev 0 V4L2 1 subdev Device Model V4L2/MC

54 Device Model V4L2/MC

55 Use Cases

56 Use Cases - FBDEV

57 (that's it...) Use Cases - FBDEV

58 Video Use Cases - V4L2

59 Everything else Use Cases DRM/KMS

60 fbdev FB vs. DRM - sloccount

61 fbdev drm FB vs. DRM - sloccount

62 drm kms exynos i810 i915 mga nouveau r128 radeon savage sis via DRM/KMS API

63 Frame Buffer (memory) CRTC Plane (memory) Memory Encoder Connector Encoder Connector SoC KMS - Device Model Off-Chip

64 Frame Buffer GEM Object(s) Memory width height format pitches offsets Properties KMS Frame Buffer CRTC

65 Frame Buffer GEM Object width height bpp pitch size CRTC Memory Properties DRM/KMS GEM Object

66 Process A Process B 3 Send FD SCM_RIGHTS 1 Local Handle Global FD Global FD 2 GEM Object DRM Handles 4 Local Handle

67 sync back porch Active Area active area front porch KMS Modes (1/2)

68 hdisplay hsync_start hsync_end htotal sync back porch Active Area active area front porch KMS Modes (2/2)

69 fb Active Area mode mode.vdisplay y x crtc mode.hdisplay struct drm_mode_set { struct drm_framebuffer *fb; struct drm_crtc *crtc; struct drm_display_mode *mode; uint32_t x; uint32_t y; struct drm_connector **connectors; size_t num_connectors; }; KMS Mode Setting *connectors num_connectors

70 Source:

71 Common Display Framework WIP Display Framework

72 Entity Entity Link Port CDF - Entity Model

73 hdmi_encoder { ports { #address-cells = <1>; #size-cells = <0>; port@0 { hdmi_input: endpoint@0 { remote = <&display_output>; }; }; port@1 { endpoint@0 {... }; endpoint@1 {... }; }; }; }; CDF - Device Tree

74 Display Controller Video control Entity Entity Entity control Pipeline Controller CDF - Configuration Model

75 streaming control Display Controller Video Entity Entity streaming control CDF - Streaming Control Entity

76 FBDEV DRM DT Display Controller Driver Panel Driver pdata Control Bus API DSI SPI/I2C CDF - Integration Mem Map

77 Contact

78 ?!

79 merci.