Display Virtualization with KVM for Automotive Systems

Transcription

1 Display Virtualization with KVM for Automotive Systems Automotive Linux Summit 2018 Tokyo, Japan Laurent Pinchart

2

3 In computing, virtualization refers to the act of creating a virtual [...] version of something. Virtualization

4 Virtualization

5 Virtualization Simulation Emulation Virtualization

6 Virtualization

7 Virtualization Memory

8 Virtualization CPU

9 Virtualization I/O Passthrough

10 Virtualization I/O Emulation

11 Virtualization Disk - Emulation

12 Virtualization I/O Para-virtualization

13 Virtualization Disk - Para-virtualization

14 Virtio

15 Virtio + Entropy, balloon, sockets, SCSI,...

16 Display Virtualization

17 Guest Userspace [DRM/KMS] Guest Kernel Display Driver [QEMU Protocol] Guest QEMU Display Device SDL{1,2} SDL Display Backend [Display Server Protocol] Host Display Server Host [DRM/KMS] Host Kernel Display Driver [MMIO] HW Display Controller Display Virtualization QEMU

18 cirrus pl110 qxl xlnx.v-dp... vga virtio-gpu xenfb vmware-vga omap-dss omap-lcdc... Guest Userspace [DRM/KMS] Guest Kernel Display Driver [QEMU Protocol] QEMU Display Device SDL{1,2} SDL Display Backend [Display Server Protocol] Host Display Server [DRM/KMS] Host Kernel Display Driver [MMIO] HW Display Controller Guest Host Display Virtualization QEMU

19 X11 Wayland DirectFB KMS/DRM (fbcon)... Guest Userspace [DRM/KMS] Guest Kernel Display Driver [QEMU Protocol] QEMU Display Device SDL{1,2} SDL Display Backend [Display Server Protocol] Host Display Server [DRM/KMS] Host Kernel Display Driver [MMIO] HW Display Controller Guest Host Display Virtualization QEMU

20 Guest Userspace [DRM/KMS] Guest Kernel virtio-gpu Driver [virtio-gpu protocol] Guest QEMU virtio-gpu Device SDL2 SDL2 X11 Backend [X11 Protocol] X.org X.org fbdev Driver Host [DRM/KMS] Host Kernel rcar-du Driver [MMIO & DMA] R-Car DU Display Virtualization QEMU

21 Guest Userspace [DRM/KMS] Guest Kernel virtio-gpu Driver [virtio-gpu protocol] Guest QEMU virtio-gpu Device SDL2 SDL2 X11 Backend [X11 Protocol] X.org X.org fbdev Driver Host [DRM/KMS] Host Kernel rcar-du Driver [MMIO & DMA] R-Car DU H3 DU Virtualization virtio-gpu

22 ~5 fps H3 DU Virtualization virtio-gpu

23 > hw > display > virtio-gpu.c static void virtio_gpu_simple_process_cmd(virtiogpu *g, struct virtio_gpu_ctrl_command *cmd) {... switch (cmd->cmd_hdr.type) { case VIRTIO_GPU_CMD_RESOURCE_CREATE_2D: virtio_gpu_resource_create_2d(g, cmd); break; case VIRTIO_GPU_CMD_RESOURCE_ATTACH_BACKING: virtio_gpu_resource_attach_backing(g, cmd); break; case VIRTIO_GPU_CMD_TRANSFER_TO_HOST_2D: virtio_gpu_transfer_to_host_2d(g, cmd); break;... }... } H3 DU Virtualization virtio-gpu

24 > hw > display > virtio-gpu.c static void virtio_gpu_resource_attach_backing(virtiogpu *g, struct virtio_gpu_ctrl_command *cmd) { struct virtio_gpu_simple_resource *res; }... res = virtio_gpu_find_resource(g, ab.resource_id);... ret = virtio_gpu_create_mapping_iov(&ab, cmd, &res->addrs, &res->iov);... H3 DU Virtualization virtio-gpu

25 > hw > display > virtio-gpu.c static void virtio_gpu_transfer_to_host_2d(virtiogpu *g, struct virtio_gpu_ctrl_command *cmd) {... void *img_data = pixman_image_get_data(res->image); for (h = 0; h < t2d.r.height; h++) { src_offset = t2d.offset + stride * h; dst_offset = (t2d.r.y + h) * stride + (t2d.r.x * bpp); } }... iov_to_buf(res->iov, res->iov_cnt, src_offset, (uint8_t *)img_data + dst_offset, t2d.r.width * bpp); H3 DU Virtualization virtio-gpu

26 > include > qemu > iov.h static inline size_t iov_to_buf(const struct iovec *iov, const unsigned int iov_cnt, size_t offset, void *buf, size_t bytes) { if ( builtin_constant_p(bytes) && iov_cnt && offset <= iov[0].iov_len && bytes <= iov[0].iov_len - offset) { memcpy(buf, iov[0].iov_base + offset, bytes); return bytes; } else { return iov_to_buf_full(iov, iov_cnt, offset, buf, bytes); } } H3 DU Virtualization virtio-gpu

27 memcpy() H3 DU Virtualization virtio-gpu

28 4.35 KVM_SET_USER_MEMORY_REGION Capability: KVM_CAP_USER_MEM Architectures: all Type: vm ioctl Parameters: struct kvm_userspace_memory_region (in) Returns: 0 on success, -1 on error... This ioctl allows the user to create or modify a guest physical memory slot. When changing an existing slot, it may be moved in the guest physical memory space, or its flags may be modified. It may not be resized. Slots may not overlap in guest physical address space. H3 DU Virtualization virtio-gpu

29 Guest Userspace [DRM/KMS] Guest Kernel R-Car DU Driver [MMIO] Guest QEMU Host R-Car DU [DMA] IOMMU H3 DU Virtualization Pass-through

30 Planes VSPD0 DU0 VGA Planes VSPD1 DU1 HDMI0 Planes VSPD2 DU2 HDMI1 Planes VSPD3 DU3 LVDS R-Car H3 DU

31 Planes VSPD0 DU0 VGA Planes VSPD1 DU1 HDMI0 Planes VSPD2 DU2 HDMI1 Planes VSPD3 DU3 LVDS R-Car H3 DU

32 Planes VSPD0 DU0 VGA Planes VSPD1 DU1 HDMI0 Planes VSPD2 DU2 HDMI1 DU3 LVDS R-Car H3 DU

33 Guest Userspace [DRM/KMS] Guest Kernel virtio-gpu Driver [virtio-kms protocol] Guest QEMU virtio-kms Device Host [DRM/KMS] Host Kernel rcar-du Driver [MMIO & DMA] R-Car DU Display Virtualization virtio-kms

34 Guest Application [Wayland Protocol] Wayland Proxy [/dev/wl] Guest Kernel virtio-wl Driver [virtio-wl protocol] crosvm virtio-wl Device crosvm [Wayland Protocol] Wayland Compositor [DRM/KMS] Host Kernel rcar-du Driver [MMIO & DMA] R-Car DU Guest Host Display Virtualization virtio-wl

35 %20Introduction%20to%20PCI%20Device%20Assignment %20with%20VFIO%20-%20Williamson%20-% _0.pdf Neo_Jia_and_Kirti_Wankhede-vGPU_on_KVM- A_VFIO_based_Framework.pdf Resources

36 Contact

37 ?!

38 ご清聴ありがとうございました!