Technology Highlights

Transcription

1 Technology Highlights Take a Closer Look

2 Content All-in-One Smart Connectivity 4 Platform SoC 18 Socionext Europe ViGO 6 SEERIS Graphics Engine IP Wrap-Around View System 10 CGI Studio 12 CMOS 24GHz Radio Wave Sensor 14 Integrated Medical IoT Solution 20 4K@60p HEVC Real-time Encoder IC 22 Imaging Technology 24 Public Display Solution 26 Company Profile 28 is the result of the fabless joint venture between Fujitsu and Panasonic. We design, develop and deliver System-on-Chip products with a specific focus on imaging, computing, networking and other dynamic technologies that drive today s leading-edge applications. Today s advanced applications continuously demand the integration of increasing functionality, with complex SoC products at the heart of the system. With our cutting-edge technology and design capabilities we are able to deliver some of the most advanced video/image, networking and security applications. Don t take our word for it, take a look at our demonstrations in the following pages and experience our revolutionary new solutions. 3D Audio 16 Locations

3 IoT & Graphics Solution Business Unit All-in-One Application Areas Smart Solutions Combiner HuD Windshield HuD and AR-HuD Hybrid/Virtual Clusters Center Display Solutions Rear Seat Entertainment Systems Smart Connectivity 60 Warping-on-the-fly Goal 60fps Touch screen Unlike traditional in-vehicle display systems, the Socionext solution does not use a controller for each display. Instead it combines its high-performance graphics SoCs and ancillary chipsets to create an integrated HMI solution that enables low-cost, simple configurations. The system frees the designer from previous development cycles, which make it difficult to apply increasingly complex content and image input/output. The designer can develop systems using a common process, irrespective of the target platform. Head-up Display 480 x 272, 18 bit 2D SEERIS warping-on-the-fly Cluster Display 1024 x 600, 24 bit 2D SEERIS, 3D graphics Open GL ES 2.0 Center Display 800 x 400, 14 bit 2D SEERIS Touch control; Apps MirrorLink smartphone connectivity Scalable graphics IP Connected displays Independent software 2D/3D development tool Video capture Camera MB86R91 APIX DRGB OpenLDI MB86R24 ARM Cortex A9 2D, 3D OGL Tuner, Speaker Center Box 04 05

4 IoT & Graphics Solution Business Unit ViGO Remote Display Demonstrator Showing Functional Safety Enhanced functional safety concept supporting future system architectures such as domain computing, driver instrumentation and information systems. High speed display link with full duplex communications supporting touch displays is the key function of the MB88F33x product family. Extended features for functional safety such as diagnosis of cable and link stability are shown in the portable demonstrator. Cost reduction through higher integration Extended features for functional safety Scalabilty for next generation requirements Reuse of existing cable and connector system Applications Remote Display Architectures Domain Computing Hybrid/Virtual Clusters and HuD Center Display Solutions Rear Seat Entertainment System 06 07

5 IoT & Graphics Solution Business Unit SEERIS Graphics Engine IP Scalable Building Block Concept Unified Engines for Graphics, Display and Capture SEERIS Graphics Engine IP Video Capture Engine Multi Layer Display Engine 2D Pixel Processing Engine Capture Fetch Fetch Fetch Fetch Fetch Fetch Fetch Warp Warp Analyze Process Process Process Blend Blend Process Our SEERIS Graphics Engine is a building block concept combining a collection of 2D graphics processing units with focus on blit operations, display control and video capture. Store Control Display Control Store Control 2D/2.5D Rendering Video Capture Engine Display Engine Safety Feature Automotive Consumer Embedded Instrument Clusters Smart Devices Connected Home Multimedia and Infotainment Driver Assistance Systems Digital Cameras Internet of Things Healthcare Home Electronics SEERIS -Demo Setup 08 09

6 IoT & Graphics Solution Business Unit Advantages Technical Features Application Areas 360 Wrap-Around View System All-in-One integrated solution Customized projection surface Combine 6 camera images OpenGL ES 2.0 Around view monitor Parking assistance Supporting Driver s Safety through Enhanced Visual Awareness with Free View Point Transparent levels of 3D polygon vehicle LVDS/Ethernet camera support Area security system Drones surround view systems 360 Wrap-Around View System provides increased driver situational awareness by combining images from multi camera inputs to create a 3D augmented reality. With previous systems, which combined images into a 2D scene, only birds-eye views were available making it difficult to recognize vehicles and pedestrians. The 360 Wrap-Around View System creates a real-time 3D scene allowing the driver to view images at any position from any angle making vehicle and pedestrian recognition substantially easier. High-resolution images from mega-pixel cameras are combined to provide a scene free of brightness gaps and can be used to confirm the area surrounding the vehicle is free of obstructions. Camera ECU Hardware HD Camera Camera cable (15m) Software Composite view development Composite view development Development support 360 seamlessly composed video Real-time 3D mapping and combining Free view point technology Camera brightness control Real-time view point conversion function View change button (5m) Consult camera position Camera calibration 10 11

7 IoT & Graphics Solution Business Unit Application Areas Scene Composer Tooling Instrument Cluster IVI Systems Rear Seat Entertainment Systems Advanced 3D Real Time Rendering using OpenGL ES 3.0 Features ISO Applications CGI Studio is Socionext s software development environment for the development of hybrid 2D and 3D graphical user interfaces (GUIs) for automotive systems ( 3D Cluster Demonstrator Geometry Instancing: Automatic draw call batching for same geometry Occlusion Culling: Hidden objects are determined by GPU and discarded before rendering Sampler Objects: Automatic texture sampler parameter batching High Dynamic Range (HDR) Rendering ETC 2 and EAC Texture Compression: Reduced memory and bandwidth consumption Seamless Cube Mapping: Realistic environment reflections 12 13

8 IoT & Graphics Solution Business Unit Applications Technologies Benchmark CMOS 24GHz Radio Wave Sensor Human detection Vital sensing CMOS RF circuits Noise cancellation Small footprint Volume ratio 1/100 The World s Smallest and Thinnest Sensor Module (12 x 7 x 1mm) Digital Signage, Home Appliance, Professional Tablet Detecting velocity, distance, vital sign, congestion degree Status Mass production Contributes to design properties by radio wave transparency and size This single-chip 24GHz Radar sensor is a CMOS module with a variable-frequency transmitter and an ultra-high sensitivity radio wave receiver. This module has 3 sensing modes: Doppler mode, FSKCW mode and FMCW mode, detecting stationary or moving objects and measuring the distance. Advanced Drone Assistance System It is a double conversion system to achieve the minimum input receiving sensitivity of -120 dbm or less. The module offers a high-performance clutter cancellation function to prevent the direct leakage of transmitted radio waves and cancel out unnecessary reflected radio waves to enable highly accurate sensing. Digital I/Q signal outputs facilitate connection between the radar and microcomputer. The 24GHz Radar module size is small-packaged: 12.0mm x 7.0mm x 1.0mm (including antenna). The world s smallest module Sensor can be fully enclosed CMOS single-chip 24GHz sensor 3 sensing modes (Doppler, FSKCW, FMCW) 14 15

9 IoT & Graphics Solution Business Unit Applications Advantages Technological Features 3D Audio ADAS Driver Monitoring System Close-to-Ear effect No hardware modification HRTF technology Provide Surprising Perceptual Sensation with Spatial Audio Technology Notebook PC, Tablet, Smartphone, Game machines etc. Gambling machines Customization for any product Home game software Socionext s 3D acoustic surround technology, which has seen significant success in commercial applications for the gaming market, delivers a state-of-the-art UI with sound localization control for in-vehicle applications such as driver assistance and infotainment systems, helping the driver perceive intuitive directions and warning signs. The software-generated Close-to-Ear effect encourages the driver to feel as if the speakers are located immediately next to the ear. The possibility of off-line processing via a 3D Authoring Tool removes the need for dedicated speakers or DSP, enabling use in a wide range of vehicle models at lower cost. Robust sound localization technology enables its use in challenging in-vehicle conditions such as unsymmetrical speaker layouts and acoustic reflections Realize surprising 3D effect with only 2 front speakers Close-to-Ear sound effect 16 17

10 Custom SoC Business Unit Platform SoC High-speed and Highly-extensible General Purpose ARM SoCs Socionext provides solutions centered around platform SoCs (general-purpose processors) which are designed, implemented and qualified by them. The target customers for these solutions are companies which have diverse requirements for office, industrial, medical, consumer and other equipment that cannot be met by current application processors. Socionext s solutions enable high performance products get to market fast without system development risks. High performance CPU and GPU supporting GPGPU computing Prototyping & Software Development readyto-use High-quality Software (Board Support Package) available Advantages Complete package SoCs, Board and Software available Reuse of Platform SoC for Custom Design, addition/reduction of features as required Technologies High performance Low power High speed I/O Wake on LAN Reusable in Custom SoC Design Business Activities Office equipment Factory Automation Medical Digital Signage Navigation Display Product Overview MB86S71 MB86S71 is the platform SoC product. It is a high performance SoC that can be applied to a wide range of targeted applications in the embedded market. The MB86S71 has two ARM Cortex-A15 CPU cores which operate at a maximum of 1.6GHz and two ARM Cortex-A7 CPU cores which are compatible with the Cortex-A15 in software. ARM Mali-T624 GPU is embedded Linux BSP (Board Support Package) ready-to-ship Product Line-up CPU core Block Diagram Item MB86S71 MB86S72 MB86S73 dual core dual core Cortex -A15 L1 32KB/L2 1MB L1 32KB/L2 1MB up to 1.6GHz NEON up to 1.6GHz NEON GPU DDR High Speed IO Block PCle Gen2 4L (2) USB3.0 Host (1) USB2.0 HDC (1) Cortex -A7 Media Processing Block I2S(2) SDIO Compute subsytem and Memory IF Block ARM Neon ARM Cortex -A15 1.6GHz Cache 32k/32k L2 Cache 1MB L2 Cache 256kB L2 Cache 32kB MIPI DSI System Control Block JTAG/TRACE System Management Controller dual core L1 32KB/L2 512KB up to 1.2GHz NEON 32bit LPDDR3 up to 1.3Gbps ARM Neon ARM Cortex -A15 1.6GHz Cache 32k/32k emmc NAND NOR JPEG Codec ARM Neon ARM Cortex -A7 1.2GHz Cache 32k/32k SPI WoL GbE dual core L1 32KB/L2 512KB up to 1.2GHz NEON Mali -T624 single 64bit DDR3(L) up to 1.6Gbps HSSPI/NOR/NAND 32bit RISC 2D Graphics Multi Codec ARM Neon ARM Cortex -A7 1.2GHz Cache 32k/32k UART GPIO I2C SDIO TSENS MIPI DSI RGB888 dual core L1 32KB/L2 512KB up to 1.2GHz NEON 64bit DDR3(L) up to 1.3Gbps NVM SCB LAN Gbe/WoL/TCP Acceleration, network answering proxy Serial IF UART/GPIO/I2C Codec 1080p multi-stram video, JPEG JPEG Display HDMI/DSI/RGB888 FPD Link (4 lane)/rgb888 Audio 2ch I2S PCIe Gen2 4lane x1 Gen2 4lane x2 USB 3.0 Host x1 3.0 Host x2 2.0 device x1 2.0host x1, device x1 SD/eMMC SDIO x2, emmc x1 SDIO x2, emmc x1 SDIO x1, emmc x1 Package FCBGA1183 FCBGA1369 FCBGA mm x 0.4mm 31mm x 0.8mm 27mm x 0.8mm ARM Mali -T624 Single core LPDDR3 1333MHz (64bit) HDMI 1.4a 18 19

11 Custom SoC Business Unit Integrated Medical IoT Solution Total Medical IoT Solution All Sensor Data can be Monitored in a Tablet and Stored in the Cloud Tablet Cloud By combining the latest sensing and cloud technologies, we deliver a healthcare solution that measures the unmeasurable, and shows the undisplayable. Specifically, we provide viewphii, which allows customers to view realistic images of muscle and fat using ultrasound technology. Status Socionext offers medical and healthcare related core technologies, reference devices and reference solutions to business partners Socionext is also interested in new business development, technologies, seed and service collaborations with companies and academic groups Applications Check body fat and confirm the effects of training using realistic images in real-time Measure body composition and check muscle and fat on a tablet Save measurement history to the cloud to check it from anywhere, anytime Mobile Ultrasound Imaging Solution Mobile Continuous Blood Pressure Solution Mobile Electrocardiogram Solution US: Ultrasound CBP: Continuous Blood Pressure ECG: Electrocardiogram Socionext s products are not certified as medical devices 20 21

12 Connected Imaging Business Unit Applications HEVC Real-time Encoder IC Contribution encoder Broadcasting equipment Cloud/Video server News gathering IP video distribution system Medical/Industrial imaging World s First HEVC/H.265 Single Chip Solution MB86M31 End-to-end video delivery Demonstration HEVC Real-time encoding of 4K video used to require parallel processing using multiple CPUs. The M31 device can perform real-time encoding with a single chip, enabling dramatic reduction in size and power consumption of equipment, with only 1/20 the volume and 1/50 the power of multiprocessor systems, for a total of 1,000x performance enhancement. Mainly targeted at high-end equipment for professional use. Encoding Decoding Socionext proprietary HEVC encoder core Excellent picture quality with low bit rate (e.g. 1080@60p at 2Mbps) Multiple channel encoding supported (e.g. 1080@60p x4 channels) Firmware upgradable RAW video data 4K@60p via PCIe MB86M31 EVB LAN video ES PXS2 EVB HDMI2.0 4K TV Various 4K formats supported at 60 fps 4:2:0 Main/Main10 and 4:2:2 10-bit Significant power reduction over CPU/GPU solutions (8W at 4K@60p encoding) Full size PCIe card with Linux environment 4K HEVC decoder system 22 23

13 Milbeaut Business Unit Imaging Technology Milbeaut ISPs for Camera Applications Applications Digital SLRs, compact DSCs Mobile phone cameras Surveillance Cameras Action Cam, Drive Recorder Industrial Applications Drone Cameras Technologies Hardware ISP pipeline 3A s (AWB, AE and AF), Pixel Correction HDR/WDR De-Fogging, Image Stabilization Object recognition (Face/Event/Anomaly detection) and tracking With our Milbeaut image-signal processors we support customers who need the highest image quality under all conditions, even when utilizing low-power-consumption systems for extended operations. Our camera solutions centered on Milbeaut are in the forefront of market trends, producing products such as high-quality digital cameras, 4K security cameras for 24-hour surveillance and action video cameras including drone systems. Delivers image quality for leading prosumer cameras Fast processing speed High sensor resolution Image/video compression (H.264/HEVC 4k) Low power consumption 24 25

14 Visual System Business Unit Public Display Solution Low Cost and Space-saving, for Interactive Signage Integrating various interfaces, graphics and video processing Attractive video effects Applications & Advantages Digital signage, Public display Produces video effects without PC assistance Low cost, space-saving and with easy maintenance MN81010H is a system LSI for public displays that features a variety of interfaces and delivers multi-purpose digital signage solutions. It supports multi-screen configurations, is network compatible, and can be used to efficiently develop public display products in varying configurations. The built-in high-performance CPU (ARM CA9) and high-performance GPU (OpenGL ES2.0) deliver a wide range of effects and quick response with a high-speed graphics rendering. Augmented Reality example using video camera MN81010H A vast range of content playback is supported. For example, content playback over the network and various media playback (USB etc.) are supported. Multi-screen compatibility allows expansion to arrays of up to 10 x 10 panels. In order that the multiple panels look seamlessly as a single screen, it is possible to adjust individually the size/ position and chromaticity/ brightness of the displayed image in each panel. Since many peripherals are incorporated, systems can be built with the minimum amount of external components. Video Camera PC Video Camera Without PC, reducing setting space and maintenance Conventional This Product 26 27

15 Company Profile Introducing Socionext Socionext is a leading supplier of next generation System-on-Chip (SoC) solutions Founded 2015 Employees 2700 Target Markets Imaging Computing Networking Formed through the fusion of the system LSI semiconductor divisions of Fujitsu and Panasonic, Socionext began operations on 1st March Socionext is a new innovative enterprise that designs, develops and delivers SoC semiconductor products around the globe. Headquartered in Yokohama, Socionext s worldwide presence covers 25 locations in Japan, Europe, USA and Asia. Socionext focuses on imaging, networking and computing technologies that drive today s leading-edge applications. In the imaging area, Socionext s products cover the full spectrum of image capture, encoding/ decoding and display. In networking, Socionext has established a dominant position in optical networking infrastructure, through its world-leading data converter IP and continues to expand this technology into new markets. In addition, Socionext can offer customer-specific solutions covering the full spectrum of applications from consumer electronics to industrial systems. With the long-term heritage of its two founding companies in providing leading edge semiconductor devices and solutions to the worldwide markets, Socionext combines world-class expertise, experience and technology to provide exceptional solutions and ensure a better quality of experience for customers. Socionext s European subsidiary, SNEU, plays an important role in its global activities. Headquartered in Langen, near Frankfurt, SNEU employs around 250 staff across 4 locations in Germany and the UK. The worldwide Network BU is headquartered in Maidenhead, UK. Through this design center, along with Langen, Braunschweig and Swindon, it delivers unique solutions to the worldwide market. Within its design center in Munich, SNEU makes a major contribution to the global business with Graphics solutions, developing Graphics Controllers for the Automotive and Industrial markets. Software plays an increasingly important role in enabling semiconductor companies to provide the complete solutions customers need. Through its software subsidiary, SESA, based in Linz, Austria, SNEU is well positioned to address these needs. SESA is focused on the development of embedded software, primarily targeting complex HMI applications in the Graphics area

16 Locations Socionext Inc. Global Headquarters Socionext Europe GmbH European Headquarters Socionext Embedded Software Austria GmbH Nomura Shin-Yokohama Bldg Shin-Yokohama, Kohoku-ku, Yokohama, Kanagawa, Japan Tel: Pittlerstrasse Langen Germany Tel: Forstenriederstrasse Neuried Germany Tel: Theodor-Heuss-Strasse Braunschweig Germany Tel: info@eu.socionext.com 3 Concorde Park, Concorde Road Maidenhead, Berkshire SL6 4FJ United Kingdom Tel: info@eu.socionext.com Richmond House Edison Park, Hindle Way Swindon SN3 3RB United Kingdom Liaison Office Levazim Mah. Koru Sk. No:2 Zorlu Center R2 Blok T502 Levent Besiktas Istanbul, Turkey Tel: SESA Semmelweisstraße Linz, Austria Tel: cgistudio@socionext.com socionext.com eu.socionext.com cgistudio.at 30 31

17 eu.socionext.com Copyright 2016 Socionext Europe GmbH All company names, brand names and trademarks herein are property of their respective owners