perceived audio and video quality

Technologies, products,
services and advantages vs competitors
November 2013
2/14
Perceived video quality metrics
Technologies and know-how
• Différent technologies for different applications
Full-reference perceived video quality metric (any codec)
No-reference perceived video quality metric (MPEG-2)
No-reference perceived video quality metric (H.264)
Parametric perceived video quality metric (MPEG-2)
Parametric perceived video quality metric (H.264)
Hybrid perceived video quality metric (MPEG-2)
Hybrid perceived video quality metric (H.264)
Full-reference perceived audio quality metric (any codec)
No-reference perceived audio quality metric (any codec)
Audio/video synchronization (lipsync) metric (any codec)
Metric for the impact of jerkiness (image freezing) on user experience
• Know-how
Human Visual System (HVS) modeling, perception modeling
Useful to measure the quality of
streaming services like
youtube, dailymotion, etc.
Subjective quality assessment testing (using normalized methodologies)
Signal processing (image, video, audio) and software developpement under Windows/Linux
Codecs, DirectShow (under Windows), Gstreamer (under Linux), SD/HD capture cards, streaming, network
(client/server applications, HTML, javascript, PHP, FTP, SNMP), infra-red codes learning/sending
3/14
Perceived video quality metrics
Main products
• Video Quality Analyzer (VQA)
– Full-reference metric
Benchmarking of encoders / Optimization of encoding parameters
Monitoring of a file-based encoding process (VOD)
Encoding/transcoding with chosen quality of output files
• Video Quality Monitor (VQM) – No-reference, parametric and hybrid metrics
No-reference audio/video quality measurement from files
Monitoring of audio/video quality from IP (UDP, RTP, HTTP), capture card or desktop capture
Measurement /monitoring of loudness (according to international standards)
• MPEG Monitor – Parametric metrics
Monitoring of perceived quality of several IP streams on a single machine
• Audio Video Sync Monitor (AVSM)
Monitor ing of lipsync (synchronization between audio and video) pour des live sources (from IP streams, or
from capture card)
• Video Quality Measurement SDK (VQM SDK) – No-reference metrics
Library (DLL) for measurement/monitoring of perceived audio/video quality in third-party applications
4/14
Perceived video quality metrics
Other products
• YUV Convert
Conversion/processing of videos in uncompressed YUV formats
• ProcessX
Input: from a capture device, from a file or from IP streaming
Output: display (windowed or full screen), saving in a file, rendering (output video card), streaming
Processing: encoding or none
Several processings in parallel, scripting, web interface, TCP connection
• H.264 SVC (Scalable Video Coding) Test Streams
Interoperability tests for decoders
• ACR Test Interface
Tool to perform subjective audio/video quality assessment tests
• QoS Tools (Linux/Windows)
Measurement of packets loss, packets corruption, delay, jitter, re-ordering
Simulation of transmission errors
• and also: DirectShow filters (audio/video delay, save to disk with buffer, virtual camera, audio/video switch),
network simulators, neural networks…
5/14
Perceived video quality metrics
Services
• Studies
Equipment benchmarking (before purchase)
Equipment optimization (for already purchased equipment)
Audit on perceived video quality (example: quality measurement before and after a change in the
broadcasting chain)
• Custom software development
Integration of tools and technologies
Design and developement of customer metrics (audio, telemedicine, …)
Custom development of applications for quality measurement, capture, playing, video processing
White-label development
• Subjective testing
For subjective performance evaluation of equipment or processing
6/14
Perceived video quality metrics
Advantage vs competitors
• Technologies
Human visual perception modeling (resulting in metrics being much more precise than PSNR, SSIM, etc.)
The most complete range of perceived video quality metrics (full reference, no reference, parametric, hybrid),
for all kinds of applications
Permanent optimisation of metrics and updated of deployed solutions
Very detailed measurement reports (patented)
• Products
High flexibility of products (especially for Video Quality Monitor and Video Quality Analyzer)
Possiblity to adapt products (for integration) and to add custom features
Video Quality Analyzer (VQA) can measure video quality ising reference videos having a different resolution
and/or a different frame rate.
Exemple (for mobile TV): measure quality of videos in QVGA at 15 fps using reference videos in SD at 25.0 fps
SDK for audio/video decoding and measurerment of audio/video quality without reference
• Services
Very detailed measurement reports with recommendations for purchase or optimization
7/14
Perceived video quality metrics
Video Quality Monitor
(no reference, parametric and hybrid metrics)
• Audio video quality measurement from files, streaming
or capture cards
• Measurement of blockiness, blur, contrast, jerkiness,
audio and video bitrates
• Audio loudness measurement according to industry
standards ITU BS 1770-2 and EBU R 128
• Camera noise measurement and monitoring (for
video cameras benchmarking)
• “Decodability” metrics (ultra fast checking of the
numbers of decoded audio samples and frames)
• Remote monitoring and remote consultation of
results thanks to the web interface
• Curves and statistics computation between 2 userchosen dates and times
• Infra-red support (for STB testing) and scripts
execution
8/14
Perceived video quality metrics
Example of test/validation platform
for set-top box testing
Live TV channels
Infra red codes
Video Quality Monitor
(VQM)
Quality scores, quality curves,
reports with statistics on
distortions)
Tested set-top box
HDMI or
composite
9/14
Perceived video quality metrics
Video Quality Analyzer (full reference metrics)
• File-based solution
• Can read the most common formats: YUV, MPEG2,
MPEG4/AVC, AVI, TS, MOV, WMV…
• Measurement of perceived audio and video quality
• Measurement of audio and video bitrate
• Measurement of synchronization between audio and
video (lipsync)
• Automatic synchronization (alignment) with a reference
video
• Results: quality scores, curves, characteristic images,
VERY detailed reports (TXT, CSV, HTML)
• Remote consultation of results thanks to the web
interface
• Comparison of videos
horizontal/vertical profiles
with
magnifying
glass
and
• Also computes MSE & PSNR on the 3 YUV components
• Automation possibilities (command line, watch folder, scripts
loading)
10/14
Perceived video quality metrics
Example of test/validation platform
for encoders benchmarking
Automatic playing and recording of
videos using our solution ProcessX
HD-SDI
Reference
videos
Tested video encoder
Network
Distorted
videos
(captured)
VQA
Video Quality Analyzer
HDMI
Video decoder
Quality scores, quality curves,
VERY detailed reports with
statistics on distortions
Broadcasting
chain
11/14
Perceived video quality metrics
MPEG Monitor (parametric metrics)
• Monitoring
of
perceived
audio/video quality for one or
several MPEG-2 or H.264 IP
streams (RTP or UDP), in unicast
and/or multicast
• Monitoring of audio/video signal
loss, black frames and silences
• Monitoring of audio/video bitrate
• Mosaïc with video preview and
audio level indication
• Alerts triggering (SNMP, emails)
• Saving of audio video samples
when problems happen (from
several seconds before the problem,
until several seconds after the
problem)
• Remote
monitoring
and
consultation of results thanks to the
web interface
• Curves and statistics computation
between 2 user-chosen dates and
times
12/14
Perceived video quality metrics
Audio Video Sync Monitor (full reference metrics)
• Two types of agents:
– probes (at least two probes)
– server (at least one)
• A probe receives audio and video from IP streaming (UDP
or RTP), from capture devices, or from files (useful for
evaluation)
• A probe transforms audio samples and video frames in
audio fingerprints and video fingerprints
• A server receives audio and video fingerprints from
different probes and compares them to measure audio
delay, video delay and skew (desynchronisation, or
misalignment between audio and video)
• Remote monitoring and remote consultation of results
thanks to the web interface
• Curves and statistics computation between 2 userchosen dates and times
• Saving of audio video samples when problems happen
(from several seconds before the problem, until several
seconds after the problem)
13/14
Perceived video quality metrics
YUV Convert
• Conversion and processing of
videos in uncompressed YUV
formatsYUV
• Support of many formats:
YUV, MPEG2, MPEG4/AVC,
AVI, TS, MOV, WMV…
• Cropping, reverse frames,
swap fields, upscale,
downscale
• « Magnifying glass » and
« profiles » functions
• Input/output of list of images
• Watch Folder
• Web interface
Academic and development partners:
For more information:
AccepTV
9 rue Alfred Kastler
44307 NANTES Cedex 3
FRANCE
http://www.acceptv.com
[email protected]
Tél. : +33 (0)6 10 71 11 64