ClearSight Video and Audio Quality Evaluation Seminar Triple Play Analysis

1
ClearSight Video and Audio Quality Evaluation
Seminar--Triple Play Analysis--
ClearSight Networks, Inc.
ClearSight Networks, Inc.
2
Sehedule

• 1000 - 1020 ClearSight Analyzer
• ClearSight Networks Overview
• Product Overview
• 1020 1045 Audio and Video quality
  measurement
• Audio quality measurement
• Video quality measurement
• MDI and VQFactor
• 1045 - 1130 Audio/Video in actual environment
  
• ClearSight Analyzer measures audio/video
  quality when connection fault (delay, packet
  loss) occurs.
• 1130 - 1145 IPTV analysis method
• 1145 - 1200 Question and Answer

3
At the Seminar Start (background)

• You have not established the method to evaluate
  video quality
• Video service has begun
• IPTV, VOD and TV meeting, sekiyuriitei
  supervisory camera ......
• It is necessary to analyze audio and video
  simultaneously.
• Video data record needs large storage HDD
• Long time monitor is needed when there is
  intermittent fault.

It is difficult to troubleshooting
4
ClearSight Networks and Analyzer
5
ClearSight Introduction
ClearSight Networks, Inc. Start 2002 Location
Fremont, CA, US
6
Media and Awards
7
Customer (in US)
8

• Top to down Analysis Process of
• ClearSight Analyzer

9
STEP1. Classify Application
Top to down analysis process of ClearSight
Analyzer
10
STEP2. Ladder View
It shows application flow ladder view between
server and client.
It will show fault in red or yellow when
communication error occurs.
11
STEP3. Decode Screen
Only the packet in ladder view will be filtered
to show in Decode screen
Protocol Decode Details
12
STEP4. Application Content Placyback
User activity and content of FTP, Telnet, E-mail,
Database, VoIP application etc. can be played
back.
Audio/Video Playback
HTTP reassemble
13
Step5. Report
Ration of application data, audio and video is
shown in this graph. When troubleshooting, you
can grasp the change of respective application
distribution at a glance.
HTTP Report
Triple-Play Distribution
14
ClearSight Product Line
15
ClearSight Analyzer Product Line with Triple-play

• ClearSight Analyzer Series
• 10/100M Software Analyzer
• 10/100M Full Duplex Laptop Analyzer
• 10/100/Gigabit Portable PC Analyzer
• 10G Portable PC Analyzer
• ClearSight Network Time Machine Series
• Rack-mounted
• Portable

16
ClearSight Analyzer Series 10/100M Software
Version

• Application Drill-down Analysis
• Ladder view
• Real time application flow analysis
• Japanese support!!
• The user interface is intuitive and easy to
  know
• Playback
• Playing back application content from packet
  
• Sniffer, Ethereal trace file compatibility

ClearSight
17
10/100/Gigabit Portable PC version

• The traffic on duplex gigabit ethernet will be
  separated into ChA/ChB to analyze.
• Real time application flow analysis (Ladder view)
  can be used
• 10 nsec time stamp resolution

18
10/100M Full Duplex Laptop Version

• Bidirectional traffic on 10/100M full duplex
  ethernet will be separated when flowing over TAP
  with 2 NIC monitoring simultaneously.
• The bidirectional application traffic which is
  taken from 2 NICs dividing into ChA/ChB can be
  integrated to display and analyze.
• ClearSight individual real time application flow
  analysis (ladder view) can be used

19
ClearSight Analyzer Series10Gb Analyzer
New
Full wire-rate capture 2GB capture capacity is
available at full wire rate by using analyzer
exclusive onboard memory for NIC. Filter
Trigger The onboard filter trigger can be used
in wire-rate environment. The trigger can be
defined as Mac address, IP address or Pattern
match. Statistic Number of frames, number of
bytes, various environment error data, VLAN and
other statistics are offered. The powerful
ClearSight analysis function You can analyze
captured data with ClearSight Analyzer.
ClearSight individual Ladder view, Application
playback and Triple-play analysis functions can
be used.
20
ClearSight Network Time Machine
SeriesRack-mounted Version
21
ClearSight Network Time Machine SeriesPortable
Version
New
22
VoIP Audio Quality Evaluation
23
VoIP Ladder View
Ladder View Screen
24

Audio Quality Measurement
Major cause audio quality decreased Packet
loss Out of sequenceJitter Delay and so
on Audio quality evaluation method R-Value(Max9
3.2)MOS (Max5)
25
Statistics
RTP Statistic Screen
26
Alert
RTP related threshold
Alarm Indication
27
Call Log Browser
Call Information
Report Item Call Status Number of Calls Call
Duration MOS Summary MOS Distribution R-Value
Distribution
28
Report (Quality Report)
Audio Quality Report for each Call
29
Report (History Report)
History Report
MOS Summary History Report
30
Audio Playback
ClearSight support Codecs
31
Video Quality Evaluation
32
Video Data

• TV Meeting
• IPTV
• - IP Broadcast Service
• - VOD Service

Internet TV and so on
33

Video Quality Measurement
Packet loss -RTP -IPv6 fragment packet Out
of sequence Jitter Delay
34
Video Quality Measurement Statistics
Statisitics
35
Video Quality Measurement Methods

• R-value and MOS are for Audio, what is for
  Video?
• MDI(Media Delivery Index)
• - Stipulated by RFC4445
• VQFactor
• - ClearSight specific factor

36
MDI(Media Delivery Index)

• DF(Delay Factor)buffer estimation
• DF(per unit time)(max(X)-min(X))/Media rate
  Xbyte media ratebyte/second
• MLR(Media Loss Rate)
• MLR(per unit time)(packet loss out of
  sequence)/elapse time

37
VQFactor
The VQFactor, whose highest value is 5, considers
the following causes of quality
deterioration. Bandwidth(Depend on
Codec) E.g. H.263 Low 20kbps High 192kb
ps H.264 Low 20kbps High
768kbps MPEG4 Low 28kbps High
1024kbps MPEG2 Low 1Mbps High
12Mbps Packet loss Network delay Jitter
38
Technology Comparison
39
Video Quality MeasurementVQFactor and MDI
Statistics
Statistics
40
MPEG Statistics

• MPEG Statistics
• 3-type frames
• I-frame Image the whole screen is included
• Pframe It is estimated from the last I frame
  or the P frame
• Bframe It is estimated from the last and the
  next I frame or the P frame

41
MPEG Stats
I-Frame Stat
P-Frame Stat
B-Frame Stat
42
Video Codec

• Codecs
• To encode and decode video steam
• Individual stream bandwidth is decided by the
  using codec
• Sensitivity of Jitter and Packet loss is decided
  by the codec

43
Video Codec

• ClearSight playback supports codecs
• H.264 (Baseline, Main, Extend)
• MPEG2-TS
• MPEG2 layer II
• MPEG4
• iLBC (internet Low Bit Rate Codec)
• JPEG (411, 422, 111)
• H.263 (Mode A Mode B)
• ASF (Windows Media Advanced System format)

44
Video Quality Alarm

• Alarm
• Several deterioration causes can be set
• RTP packet loss
• IPv6 fragment loss
• Out of sequence
• Jitter
• VQFactor
• MDI and so on

Alarm threshold setting
Alarm Screen
45
Video Quality Report

• Video Quality Report
• IPTV video steam report can be editted just like
  VoIP quality report.
• The report is useful although faults
  classification is specified

Jitter Report
VQFactor Report
46
Move connecting point
47
Demo Environment
48
Delay Generating Device Summary

• Features
• Even in the emulate environment (64byte
  100), it can ensure full wire rate capture.
• Delay can be set by 1 bit(0.1ns_at_10Gbps)
• Usually we support delay from 250ms to 1s,
  and additional delay can be optional.
• Support various error types (Bit Error,
  Packet Loss, Fluctuation (Jitter), Order
  Replacement, Data Rewriting, LOS, Link Down and
  so on)
• Application
• Network device efficiency and function
  evaluation
• Video transport quality verification (IPTV
  and streaming)
• Quality verification for VoIP delay,
  fluctuation and packet loss.

49
Demo Environment
ANUE circuit fault device (Packet loss, Delay)
HUB
HUB
ClearSight Measurement
SIP Server 192.168.6.1
Client 192.168.7.2 Telephone 111
Client 192.168.7.3 Telephone 222
ClearSight Analyzer
50
Video quality problem solving steps

• The normal standard VQFactor measured such as
  measuring result in lab environment
• Measuring VQFactor at users place
• Jitter, Packet loss, Delay verification
• It can separate network data other than above
• Problem Reason Investigation
• Network
• Video
• Receive device

ClearSight Best Solution
51
Thank You!