Tools for Evaluating HD Fixed-Pixel Display Performance, Jed Deame

HPA Retreat
February 22, 2008
Tools for Evaluating HD Fixed-Pixel
Display Performance
Jed Deame
VP, Video Technology
Silicon Optix Inc
[email protected]
Performance Measurement
Methodologies
 There are many criteria involved in evaluating
Fixed Pixel Displays, both static and dynamic
 Static tests are useful for measuring the base
performance of a display and it’s ability to
reproduce still images
 Dynamic tests are useful for measuring
performance with real-world material in motion
Traditional Criteria used in Evaluating
Fixed Pixel Displays
 Static Tests
•
•
•
•
•
•
•
•
•
•
•
Black Level
Viewing Angle
Uniformity
Color temperature
Peak Brightness
Dynamic Range
Contrast Ratio
Gamma
Color Gamut
Active pixel coverage
Luminance linearity
Why is dynamic performance is so
important
 The latest generation of fixed pixel displays
have solved many of the static image
problems of the past
 Static performance driven primarily by display
technology
 CRT’s can handle interlaced signals, fixed pixel
displays cannot
 Biggest difference in display quality is seen
when observing motion images
 Noticeable display artifacts can occur with
poor video processing
Dynamic Processing Requirements
 The dynamic performance of the display is
driven by the performance of the internal
video processor
 Display processing is a very complex process it’s more than just scaling.
 Must handle all types of material, maintaining
full resolution
 Auto detection of content type is critical
 Most consumer displays do a decent job with
480i, but 1080i is a different ball game
 HD requires 6x the processing power…!
Key Dynamic Tests for Characterizing
1080i Performance
Key Performance Criteria in Evaluating
HD Signal Processing Performance
1. HD Video Resolution with Motion
2. HD Film Resolution with Motion
3. Noise Reduction
1. HD Video Resolution Loss
 Goal: Determine if HD video content is
processed at full resolution
 Requires sophisticated motion detection to
maintain full HD resolution
 Switch between “bob” and “weave” based on
image motion
 Decisions should be at pixel level
 Test Image: SMPTE 133 Test Pattern with
overlaid rotating dial
 Pass Criteria: Clean text and fine detail visible
HD Video Resolution Loss - Source
HD Video Resolution Loss - Result
PASS
HD Video Resolution Loss - Result
FAIL
2. Video Reconstruction
 Goal: Determine if HD video structures at low
angles is reconstructed properly
 Makes up for loss of resolution in moving
objects
 Interpolates along the diagonal edges to
recover lost resolution
 Test Image: Jaggies Test
 Pass Criteria: All 3 lines are smooth
• 1 or 2 smooth lines imply minimal reconstruction
• No smooth lines imply no reconstruction
Video Reconstruction
Test Image
Fail
Pass
3. Film Mode Detection (Inverse 3:2)
 Goal: Determine if HD film content is processed
at full resolution
 HD Video processors need to recognize 3:2
inserted at the telecine
 If film mode is not properly detected, half
resolution images will result
 Test Image: Detailed HD scene (SMPTE 133),
moving with 3:2 motion
 Pass Criteria: Clean text and fine detail visible
Film Mode Detection - Source
Film Mode Detection - Result
PASS
Film Mode Detection - Result
FAIL
Film Mode Detection - Result
FAIL
Film Mode Detection 2
Fail
Pass
5. Noise Reduction
 Goal: Determine if HD video noise can be
reduced without adversely affecting the
image
 Noise is prevalent in most sources
• sensor noise, compression artifacts




Temporal NR more effective than Spatial
Motion Adaptivity imperative
Test Pattern: Noisy HD Video Signal
Pass Criteria: Mostly noise free image with no
smearing artifacts of loss of resolution
Noise Reduction
Fail
Pass
Scoring System
Not just for testing Consumer TV’s






Blu-Ray DVD Players
HD-DVD Players
Video Game Systems
Video Processors
HTPC’s
Pro-Video Monitors, etc
How can I get this Tool?
 www.HQV.com website
 List Price $20 (w/ Shipping)
 Special Discount….
• Half Price for HPA Attendees
• Discount code on right
 Bundles available for $30
• Discount Codes: HPAB1,
HPAB2, HPAB3, HPAB3
NTSC
Code: HPASD
Blu-Ray
Code: HPABR
HD-DVD
Code: HPAHD
PAL
Code: HPAPAL
Publications using the HQV
Benchmark
So, How do the Consumer Displays
Measure Up?
November 2006
Home Theater Magazine
61 TV’s tested from
17 manufacturers
54% failed the Video
Resolution Tests
80% failed the HD Film
Mode (3:2) tests
How about the Latest Models?
November 2007
Home Theater Magazine
74 TV’s tested from
16 manufacturers
35% failed the Video
Resolution Tests
81% failed the HD Film
Mode (3:2) tests
Wouldn’t it be nice if…
 There was an online resource to enable
consumers to see performance test results
 Consumer displays could be compared sideby-side in a common chart
 Why not include DVD players, HD DVD players,
AVR’s, Video Processors, Game consoles…
 Consumers could submit reviews of their own
devices to grow the database quickly
HQV.com Website
Technology Resource
New “Review Central” Feature
Name
(# Reviews) [Level]
• LadiesMan1210 (199) Gold
• Homeboy
(24) Gold
• JoeSixPack
(2) Gold
Product Category
• All
• Top 2 in each category
•DVD
• Blu Ray DVD
• HD DVD
• Combo DVD
• Television
News Archive
e(
Ba
rG
rap
SD
eo
h)
P
N
erf
Pe oi
s
or
rfo e
m
R
r
SD man edu anc
e(
ce cti
Fi
ico
o
HD lm P (ico n
n)
n)
erf
Pe Noi
o
r
ma
rfo se
R
nc
rm
ed
e
a
HD
nc uc
(
e ( tio icon
Vid
ico n
)
eo
n)
Pe
HD
rfo
Fil
r
ma
m
nc
Pe
e(
rfo
ico
rm
n)
an
ce
(ic
on
)
Sc
or
Re
Get the Benchmark
DVD Players
Denon
DVD-5910CI
Panasonic
HQV-Realta
DVD-S97
100%
65%
100%
100%
100%
See Details
Product Info
Discuss
100%
50%
50%
See Details
Product Info
Discuss
95%
100%
86%
See Details
Product Info
Discuss
95%
0%
50%
See Details
Product Info
Discuss
58%
0%
57%
See Details
Product Info
Discuss
75%
100%
36%
See Details
Product Info
Discuss
70%
0%
64%
See Details
Product Info
Discuss
Blu Ray DVD Players
Pioneer
BDP-94HD
4-Aug-11
B. Greenway
Pro
Samsung
BD-P1000
13-Feb-11
Clint DeBoer
Pro
83%
56%
30-Oct-11
Clint DeBoer
Pro
59%
100%
100%
29%
New - Download available
HD DVD Players
Toshiba
HD-A2
0%
100%
86%
Combo DVD Players
Latest HQV Products
Flat Panel Televisions
Pioneer
PDP-5070HD
5-Jun-11
Tom Andry
Pro
LVM-42w2
21-Feb-11
Clint DeBoer
Pro
58%
56%
97%
Westinghouse
CRT and Rear Projection Televisions
Multi-Function Monitors (MFM)
Gateway
XHD3000
8-Oct-11
Clint DeBoer
Pro
810 HQV
HQV-Realta
29-Mar-11
Clint DeBoer
Pro
95%
75%
100%
100%
100%
100% See Details
Product Info
Discuss
100%
75%
100%
0%
100%
100% See Details
Product Info
Discuss
100%
100%
64%
0%
100%
100% See Details
Product Info
Discuss
58%
0%
43%
See Details
Product Info
Discuss
33%
0%
21%
See Details
Product Info
Discuss
90%
100%
100%
See Details
Product Info
Discuss
83%
100%
100%
See Details
Product Info
Discuss
Front Projectors
Epson
Mitsubishi
HC5000
28-Jun-11
Clint DeBoer
Pro
STR-DA7100ES
18-Feb-11
Clint DeBoer
Pro
RX-V2600
14-Feb-11
Clint DeBoer
Pro
Geforce 7900
15-Sep-11
Anton Shilov
Pro
Radeon X1000
15-Sep-11
Anton Shilov
Pro
86%
78%
Onkyo TX-NR905
A/V Receiver
A/V Receivers
Sony
Yamaha
41%
22%
Video Processors
Graphics Cards
nVidia
ATI
97%
57%
100%
50%
0%
Gaming Systems
Sony
Microsoft
Site Map
Forum
Become a Reviewer
Submit User Review
View Test Scores
Vid
Pro
Re
Pro
Chris Tham
ral
l
vie
r
vie
we
Gene DellaSala
13-Feb-11
w
vie
Da
we
te
rS
tat
Ve
rs
mw
10-Feb-11
Re
Vid
Mo
are
r
eo
lN
de
nu
Reviewer Hall of Fame
Ma
• Gateway by
Ladiesman1210
• Onkyo by Homeboy
Pr
oc
es
so
be
r
um
er
fac
tur
Latest Reviews
HQV Products
us
ion
Sign In
Not a Member? Register
Account Management
Sign up for Newsletter
Site Search
Technology
SD
Benchmark DVD
Ov
e
Review Central
Fir
Home/Blog
Playstation 3
BenQ W20000
Front Projector
XBox 360
Contact
Terms of Use
Copyright
30
When…?
 Coming to a web browser near you…
 May 2008
Summary
 Dynamic tests (with motion) are critical for
evaluating display (and other CE) performance
 Dynamic performance is driven by the capability
of the internal video processor.
 If the wrong processing decisions are made, half
of the image detail will be lost
 The HQV Benchmark is available as a tool to
measure video processing performance.
 Use and contribute to the HQV.com review
database. Tell your friends. Lets build a large
online community to leverage this resource.
HPA Retreat
February 22, 2008
Questions???
Thank You!
Jed Deame
VP, Video Technology, Silicon Optix
[email protected]