Reveal The Secrets of Your Videos. Zoltan Nemeth, Watson Media / Budapest Lab

Transcription

1 Reveal The Secrets of Your Videos Zoltan Nemeth, Watson Media / Budapest Lab

2 IBM Budapest Lab Formerly known as Ustream - acquired by IBM in 2016 Full scale product development Engineering Devops Product Management UX / Design Studio Data Science Sales Customer Relations

3 Streaming Manager Our end-to-end video platform

4 Reach Every Device with Video End to end video platform Watson Cognitive capabilities on top Fully homebrew, no black boxes Main components: cloud transcoding, storage, CDN, player

5 Why Do You Need An Enterprise Video Platform? Executive Communication Media and Entertainment High Profile Events Marketing Outreach How can your CEO address the entire company at the same time? Supplement a media strategy with live video, showcasing content or events How can you reach massive, remote audiences with high quality content? How can you make the biggest impact with your customers and prospects?

6 Solving Customer Challenges in Video Manage Complexity Delivery Quality At Scale Maximize ROI Analytics Insights Cloud platform to Multiple content Complete end-to-end Real-time analytics create video from delivery network solution that meets and individual multiple sources with connection for high the needs of internal viewer tracking with live transcoding quality video at scale or external audiences lead gen techniques

7 CHALLENGE Enable any IBM employee across the world to easily communicate more effectively, both internally and externally, using streaming video to audiences of any size SOLUTION Consolidating vendor presence to utilize IBM Cloud Video on a global scale by using a hybrid approach of cloud based infrastructure with virtual servers installed through on premise hardware Providing massive scale to reach over 380,000 employees with live and on-demand video RESULTS Reduced number of video vendors from 6 to 1 Transitioned 390 Qumu VNE (VideoNet Edge) installations to IBM Cloud Video s ECDN (Enterprise Content Delivery Network) for local asset scale Initial 50% annual cost savings Projected 60% annual cost savings by year two and three

8 CHALLENGE Wants to showcase their new car to build excitement while learning more about the product s potential prospects. SOLUTION Live streamed content to a worldwide audience, opening to markets they previously didn t sell in Gathered lead details through in-player registration Served content in high definition with adaptive bitrate support for those on slower connection speeds to leverage both quality and reach Turning a product launch into real time revenue with available pre-orders RESULTS Audience of close to 1 million total with 350k peak concurrent viewers Unprecedented results with $7.5 billion worth pre-orders within 24 hours of the live event Average viewing time of 25 minutes

9 CHALLENGE To reach, energize and inform consultants globally anytime, anywhere SOLUTION Streaming mobile compatible live and on-demand video to consultants Done with SD-CDN technology for global scale with built-in QoS for an optimal viewing experience across devices Utilize IBM Watson s speech to text to generate captions for content This premier skincare company is creating innovative virtual experiences that engage and inform consultants world-wide RESULTS Content viewed over 500,000 times across the United States, Canada and Australia Broadcasted over 72 hours of live content and published 137 videos Reached over 100,000 devices, with 70% of their audience on mobile 60 minute average viewing time

10 CHALLENGE Use video streaming to share information and connect teammates across multiple offices, continents and devices SOLUTION Created 30 channels that included built-in player Q&A from functional areas such as Engineering and UX Utilizes live transcoding to make content compatible across devices Auto archives live streams as on demand assets for later use to avoid time zone conflicts Connect employees across regions and across devices RESULTS Produced 395 broadcasts with 3,900 views by staff Reached employees in 30 countries

11 Video or Black Box?

12 IBM Watson Media is using cognitive-infused video products to help our media clients products to help out media clients leverage, monetize, and understand video to drive their core business.

13 Watson Video Enrichment Analyze textual, audio, and visual data within multimedia content, and to build easily searchable metadata packages for every asset. API first offering Leveraging core Watson APIs Haifa Research & Budapest Lab algorithms Built on IBM Cloud Kubernetes Service

14 Idea to Launch in 3 months Newly formed team Practices to enable highest velocity Simple and unified software stack: Go, Docker, Kubernetes Use what can be used from the Streaming codebase ADRs Successful launch at IBC

15 Video Enrichment Workflow

16 Customer Challenges Solved

17 Content Search & Discovery Adding automatically-generated concepts, entities, scenes, and additional keywords ensures the video shows up in more relevant searches

18 Live and VOD Captioning Create highly-accurate captions, quickly Decrease cost and manual intervention Accuracy improves with every use

19 Trainable Client Specific Custom Models IBM doesn t use clients training material to train core knowledge models so our clients can safely build their custom visual recognition and language models

20 Highlight Clipping Watson listens, watches, and learns a live sports feed to automatically identify and curate the most exciting moments into segments that can be used in online highlight packages to satisfy social demand

21 Up next Logo identification Understanding the contents of the video and helping users to track and predict the performance of a logo inside of a set of video content Compliance Detecting adult content recognition, violence detection, recognizing, detecting racial insensitivity, incorrect or fake material, missing captions, logos that don t belong, section 508 compliance, ADA compliance, detecting trademark or licensing violations Recommendation uplift Integrating enhanced metadata with leading recommendation engines, like IRIS.tv provide a solution that helps publishers better engage audiences, increase video views, and optimize yield on owned and operated sites

22 Watson Media Case Studies

23 CHALLENGE Optimize and automate the complex, error-prone process of closed captioning using the artificial intelligence capabilities of IBM Watson. SOLUTION Watson Captioning powers live and file-based closed captioning for Sinclair Broadcast Group s 75+ stations. BUSINESS BENEFITS Automated process reduces labor costs and speeds up delivery time Provide automatically-generated high accuracy live captions Training model and custom corpora produces accuracy rate of 92-96% - will continue to increase with time Hyper-localized data sets to generate more precise captions for local broadcast Major cost savings compared to legacy methods

24 CHALLENGE Creating the FIFA World Cup Highlight Machine which is is Fox Sports first public use of AI and machine learning to more deeply engage fans with a sporting event SOLUTION For the Highlight Machine application, IBM Watson Video Enrichment, a programmatic metadata tool, analyzes the massive amount of historical and 2018 match footage, interviews, press conferences and other related video to create metadata that identifies what is happening in a scene at any given moment along with an associated timestamp Create the ultimate fan experience BUSINESS BENEFITS Fans could create highlight reels drawing from more than 300 archived matches played between 1958 and After the tournament began, they were able to create highlight reels from just-completed games about 10 minutes after their completion

25 CHALLENGE Integrating the Watson Video Enrichment cognitive video capabilities in Workday Video Intelligence feature. SOLUTION Workday 31 introduced a new feature, Video Intelligence, as a part of Workday Media Cloud. Video Intelligence is able to analyze the speech and visuals of each video the users load into Workday Media Cloud and surface rich metadata and deeper insights for users. AI-powered video intelligence BUSINESS BENEFITS Deeply enriching the value of every video asset uploaded by users by creating automated data sets that are thousands of times more detailed and searchable than is currently possible for large libraries of video.

26 CHALLENGE Enterprise-grade AI takes a turn on the red carpet SOLUTION During the five-hour celebrity procession, Watson analyzed and categorized hours of video and close to 125,000 photographs, tagging them using facial recognition, facial emotion, position and color dominance. And for the music itself, it analyzed the emotional tone of GRAMMY-nominated song lyrics over the decades, creating a unique data visualization for fans on grammy.com AI that enhances the fan experiences at Grammy Awards BUSINESS BENEFITS Enhancing the fan experiences at these events can help client s business outperform the competition and connect with their customers

27 Thank you! Questions?

28 Backup Slides that we can use at the booth but not on the stage

29 IBM Budapest Lab Formerly known as Ustream - acquired by IBM in 2016 Founded in 2007 Startup before there was a startup scene in Hungary Onboarded IBM as a lab

30 Expertise in Video... and More Full scale product development capabilities in Budapest, connected with global peers Engineering Devops Product Management UX Data Science Sales Customer Relations