Media Analysis Tools. How we check media files. Jérôme Martinez MediaArea.net SARL

Size: px

Start display at page:

Download "Media Analysis Tools. How we check media files. Jérôme Martinez MediaArea.net SARL"

Chad Bruce
5 years ago
Views:

1 Media Analysis Tools How we check media files Jérôme Martinez MediaArea.net SARL

2 Different needs Metadata extraction and review File format (containers, coding) validation File format investigation Local policy conformance Metadata editing/fixing Audiovisual quality control

3 MediaInfo Metadata extraction and review Convenient unified display Of most relevant technical and tag data For video / audio / text / ancillary data files 6k downloads/day, 40k GUI launches/day BSD 2 Clause license

4 MediaInfo Supported formats Most formats used by either individuals or professionals Detects weird transport layers e.g. Dolby E spanned on 2 audio tracks, subtitles in the ancillary data, sidecar files...

5 MediaInfo Export Classic flat text, XML... Also in professional output formats e.g. PBCore, EBUCore, FIMS...

6 MediaConch A conformance checker Implementation checker Policy checker Reporter GPLv3+/MPLv2+ license

7 MediaConch Supported formats Implementation checker for Matroska, FFV1, PCM natively Implementation checker for PDF and TIFF via plugins (verapdf and DPFManager projects) Policy checker for all formats Optional server mode (watch folder) Optionaly an ordonancer e.g. FFmpeg transmux / transcode before checks

8 MediaTrace Deep check of bytes Provides meaning of each bit in a file Work in progress (sometimes stalls due to too much information, only first frames displayed) Available in MediaInfo GUI (text mode), MediaConch GUI (Tree mode), MediaInfo and MediaConch CLI (Text, XML) BSD 2 Clause license (in MediaInfoLib)

9 MediaTrace Example with a Matroska file

10 MediaTrace Example with a TIFF file

11 BWF MetaEdit WAV/BWF Metadata checker and editor Focused on WAV format, used a lot by archives Difference between requirements and recommandations Can delete/modify/add metadata Can export metadata Public domain

12 BWF MetaEdit Enforce the guidelines developed by FADGI (US Federal Agencies Audio Visual Working Group) European Broadcasting Union (EBU) BWF (EBU tech 3285) CodingHistory (EBU tech R ) OriginatorReferencce (EBU tech R ) Microsoft (INFO chunk)

focused on video artefacts, now checking also audio

13 QCTools Audiovisual quality control On the decoded frame Focused on digitalized content Initially focused on video artefacts, now checking also audio BSD 3 Clause license for UI/new filters, GPLv2+ for FFmpeg libs

14 QCTools Tied to FFmpeg Depends on FFmpeg for demux, decode, and check Some tests were already present in FFmpeg (especially libavfilter), we added an UI We also added some tests to libavfilter upstream

15 QCTools List Video YUV: MIN, AVG, MAX, LOW, HIGH, Difference Saturation, Hue, Temporal Outliers, Vertical Line Repetitions Broadcast Range, Crop Width/Height Peak Signal to Noise Ratio (PSNRf), Structural SImilarity Metric (SSIMf), Mean Square Error (MSEf) Interlacement Detection Note: tool is focused on field comparison for the moment

16 QCTools List Audio R.128, Audio Phase Meter, DC Offset, Audio Diffs, RMS

17 Interfaces Not only one interface: different people, different needs, different technical knowledges Command line Graphical interface Server (REST API) Web interface

18 Standardization Issues: Checking is good, but compared to what? Lack of open video/audio standards Lot of people work on lossy formats (e.g. VP9, AV1, Opus) Some people need lossless formats

19 Standardization CELLAR: IETF workgroup Container: Matroska Video: FFV1 Audio: FLAC (not started)

20 Sponsorships Lot of work, we need sponsorship Several compagnies (usually donʹt like to be named :( ) European Union (especially PREFORMA project) US Federal Agencies Digital Guidelines Initiative National Endowment for the Humanities The Knight Foundation

21 Contributions We need you! Patch for new features Patch for bug fixes Participation in CELLAR Design (e.g MediaConch new displays) Participation in documentation wri 埾 ing Testing...

22 Stay in touch MediaInfo: h 埾 ps://mediaarea.net/mediainfo MediaConch: h 埾 ps://mediaarea.net/mediaconch BWF MetaEdit: h 埾 ps://mediaarea.net/bwfmetaedit QCTools: h 埾 ps://mediaarea.net/qctools Follow us on Twi 埾 Jérôme Martinez: jerome@mediaarea.net Slides: h 埾 ps://mediaarea.net/events License: CC BY

Data is never RAW. Data is always cooked in a way or another. Jérôme Martinez No Time To Wait, London, October 2018

RAWcooked Data is never RAW. Data is always cooked in a way or another. Jérôme Martinez No Time To Wait, London, October 2018 Raw files Huge size (4K+ is coming, can be 100 MB/frame, several TB per hour)