Gbps-range High-definition Visual Sharing

Transcription

1 Gbps-range High-definition Visual Sharing Update on GLORIAD-KR Uncompressed HD System Jinyong Jo HPcN Dev. Team, HPcN Project Div. Korea Institute of Science and Technology Information

2 Overview System and Network R&D activities Cost-downing implementation Increased sense of presence Int./Domestic collaboration Future works Outline 2

3 Overview Applications networked collaboration Narrowband, low quality, User oriented Broadband, high quality, Supplier oriented Apps. Tech. Access Grid (~ 100 Mbps) ConferenceXP (~ 1 Gbps) Multicast (Unicast), IPv4/IPv6, M-U Bridging, group comms. firewall, multimedia Uncompressed HDTV (~ 10 Gbps) Resource Resv., Unicast, IPv4/IPv6, Jumbo, multimedia Apps. for networked collaboration on KREONET/GLORIAD Uncompressed HD over IP SMPTE292M < Gbps Gbps Network SMPTE292M 3

4 Picture format & its transport SMPTE - Society of Motion Picture & Television Engineers SMPTE-274M : 1920x1080 pixel, interlaced scan at 30 fps (typically) SMPTE-296M : 1280x720 pixel, progressive scan at 60 fps SMPTE-292M : container, Gbps and 1.485/1.001 Gbps Local transport (SMPTE 292M) Coaxial or optical fiber : HD-SDI (serial digital interface) Wide area transport IP network (Gbps) 4

5 RTP payload for transmission Circuit emulation (RFC 3497) RTP payload format for SMPTE 292M video Native packetization (RFC 4175) RTP payload format for uncompressed video Circuit emulation Native packetization 5

6 Applications Commercial broadcasting HD-SDI Virtual HD-SDI -remote edition RT MPEG2 encoder Home RT HD collaboration HD-SDI 6

7 Works in the World UltraGrid ( USC/ISI 720p Standardization, DRAGON support. Open source, Linux ihdtv ( Research Channel/Univ. of Washington 1080i Open source, Windows i-visto ( NTT Commercial product 7

8 Challenging Content delivery Protocols RTP/UDP/IP, RFC 3497, RFC 4175 Network Capacity Performance End-system Capacity & performance Content presentation Image resolution Frame rate and quality Implementation cost 8

9 Network provisioning UCLP := User Controlled LightPaths bandwidth-on-demand solution, a way to get instant bandwidth over great geographical distances. Objectives: To create their own application-specific network In UCLPv2: from LightPaths to APNs (Articulated Private Networks) 9

10 Network provisioning DRAGON := Dynamic Resource Allocation via GMPLS Optical Networks Objectives: Dynamic provisioning of deterministic guaranteed resource end-to-end paths Rapid provisioning of Application Specific Network topologies Jerry Sobieski et al. (GNEW 2004) 10

11 Others Network provisioning Port-based VLAN Tag-based VLAN (IEEE 802.1Q) Jumbo frame (9,000-byte MTU) 11

12 End-host system Process at least 20,000 pkts/s (9,000-byte) CPU Dual-xeon, Core2Duo or newer PCI-X (64-bit) PCI (32bit x 33 Mhz) Network cards 1 Gbps, Dual-port, 10 Gbps 12

13 Implementation Cost $20,000 for sender & receiver set HDV Cam, signal converters, display, media & network interface cards, server systems Not so expensive but still How to make it down 13

14 R&D Targets Cost-effective HW integration & SW development Increased sense of presence Factors that drive up overall costs HD-SDI interface cards 10 Gbps NIC Factors that make cost down Use low-cost HD-SDI interfaces Exploit multiple 1 Gbps NICs Process multiple streams Support various playout methods 14

15 Developed system Video & audio transport 1080i (25/50, 29.97/59.94, 30/60 fps) 24-bit 48KHz PCM RTP, Dual-port streaming Native packetization Transport system 32-bit Linux XENA HS (HD-SDI interface) from AJA 15

16 Hardware Integration Sony HVR-Z1N HD-SDI converter HD display Audio A/D 6-channel audio Audio embedder HD-SDI signal converter Audio D/A Speakers HD-SDI interface A/V transport over IP networks 16

17 Software Architecture Play Session split (Native packetization) Grabber A/V synchronization Video Playout Buffer Audio Playout Buffer Video Packetization Audio Packetization RTP/RTCP RTP/RTCP RTP/RTCP RTP/RTCP Sequencing Network Intf. Network Intf. Network Intf. Network Intf. Dual-port streaming 17

18 Cost-downing Factors Session split Pros: interface to commodity A/V cards Cons: media synchronization Dual-port streaming Pros: easy access to n*1 Gbps backbone Cons: out-of-ordered packets Various playout methods (SDL,xv,ALSA) Pros: fit to networked collaboration Cons: Low quality but good * See details in Uncompressed High Definition Visual Sharing System towards Interactive Networked Collaboration, IMMERSCOM 2007 (J.Y Jo et al). 18

19 Overall implementation cost (06 ) DVS xena_hs Software A/V playout Dual-port support HDV Cam. $4,500 $4,500 $4,500 $4,500 1 HD-SDI converter $1,600 $1,600 $1,600 $1,600 2 Servers $4,800 $4,800 $4,800 $4, G NIC $2,600 $2,600 $2,600 $0 2 Frame grabber $14,000 $3,400 $1,700 $1,700 1 DVI converter $770 $770 $0 $0 2 Audio A/D Converter $900 $900 $400 $400 Display $2,400 $2,400 $2,400 $2,400 Total $31,570 $20,970 ~ $18,000 ~ $15,400 Sender & Receiver 19

20 Cost-downing Factors : Updated One-machine-handling multi-intf. Up to 4 media interfaces 2 Streams (Probably up to 3) Media Interface Media Interface UV (GLORIAD-KR) Media Interface Network Interface Media Interface Network Interface UV (GLORIAD-KR) Network Interface Network Interface One machine One machine Portable systems. Easy to apply stereoscopic, panoramic, multi view!! 20

21 Consequently, Overall implementation cost (2007) Multiple intf. Price down DVS xena_hs Xena HS Dual-port support HDV Cam. $4,500 $4,500 $4,500 $1,500 1 HD-SDI converter $1,600 $1,600 $1,600 $1,600 2 Servers $4,800 $4,800 $2,400 $1, G NIC $2,600 $2,600 $0 $0 2 Frame grabber $14,000 $3,400 $3,400 $1,700 1 DVI converter $770 $770 $770 $770 2 Audio A/D Converter $900 $900 $900 $900 Display $2,400 $2,400 $2,400 $1,000 Total $31,570 $20,970 ~ $15,970 ~ $8,970 Sender & Receiver 21

22 Sense of presence Stereoscopic view Panoramic view Stereoscopic camera in GIST Stereoscopic projector in KISTI Stereoscopic Image 22

23 Sense of presence : Updated J.C Park@GIST 23

24 Sense of presence : Updated Open GL (SDL) & multiple streams Receiver view Receiver view Sender view Sender view 24

25 Sense of presence : Updated Networked tiled display SVC 25

26 ETC : Updated Graphical user interface Kernel buffer tuning Net-interf. option setting Media interface setting Test & load Invoke UV process 26

27 Domestic test-bed KREONET/SuperSIReN KISTI 1 Gbps 2x1 Gbps 4x1 Gbps 10 Gbps 10 Gbps 1 Gbps 2x1 G 10 Gbps 1 Gbps KREONET/SuperSIReN Multicast IPv4/IPv6 Jumbo frame 10 Gbps GIST 27

28 GLORIAD International test-bed The first round-the-world high-performance networks jointly established by Korea, China, Unite States, Russia, Canada and Netherlands D.K Grand Opening for Big GLORIAD( ) 28

29 Demo. igrid 2005, Stereoscopic & uncompressed HD video conferencing DancingQ 2006, Real-time commercial culture event ELSA 2006, Laparoscopic liver surgery SC 2006, Software-based A/V playout SC 2007, One-machine-handling multiple intfs. & streams Others (2006~) Experience sharing & real-time experiments with CNIC, TsingHua Univ., EVL, and so forth. 29

30 Collaborators 30

31 31

32 Thank you! Contact 32