TeraNex Technical Presentation

TeraNex Technical Presentation
SD and HD Standards Conversion
HD Up, Down and Cross Format Converters
STARFRONT Noise Reduction Pre-Compression Processor
for Broadcast, Post and Internet
Combined Up converter and Noise Reduction Pre-Compression Processor
Highest End-to-End Image Quality
Grant Moore
Managing Director
[email protected]
TeraNex Asia Pacific
A subsiduary of
TeraNex Inc
Orlando Florida USA
www.teranex.com
Rev. 08-02-00
Up & Down-Conversion Application
•
HDTV Down-Conversion, Local Program or Graphic Insertion, and Up-Conversion
HD-SDI
HD-SDI
HDTV Bypass
TeraNex Starfront UP
HD VTR or
Bitstream Server
Graphic/Logo
HDTV
Network
Feed
SDI
SDTV
Network
Feed
HDTV to SDTV
Down-Converter
HDTV
Switch
HD-SDI
HD-SDI
TeraNex Xantus
HD Integrated HD-SDI
[1.485 Gbps]
Receiver /
Decoder
SDI
Other SDTV
Video Sources
[SDI 270 Mbps]
SDTV
Master
Control
Switcher
SDI
SDTV to HDTV
Up-Converter w/
Noise Reduction
HDTV
MPEG-2
Encoder
MPEG2
PES
SDTV
MPEG-2
Encoder
MPEG2
PES
TeraNex Starfront
SDI
SD Integrated
Receiver /
Decoder
SDTV
Pre-Compression
Processor
MPEG-2
Transport
Stream
Multiplexer
DVB-ASI
[19.45Mbps]
SDI
Data
Service
HDTV
Pre-Compression
Processor
HDSDI
RS-232/Ethernet
SD VTR or
Bitstream Server
SDI
DVB-T
Modulator /
Transmitter
Integrated
Program
Decoder
DTV
Transmitter
Video
Audio
Monitor
DTV Format Conversion Process
•
•
•
•
•
•
Accept Input Video Stream (SD-SDI or HD SDI)
De-Interlace Input
Noise Reduce
Sample-Rate Convert
Colourspace Convert
Processing Options
– Proc Amp
– Detail Enhance
• Output Converted Video Stream
Why De-Interlace?
• Odd and even fields spatially shifted due to
camera or scene motion
• De-Interlacing prior to format conversion enables
image resizing to be done on a spatially coherent
frame
• De-Interlacing is required even when
upconverting to 1080i50 or 60
De-Interlacing Techniques
• Non-Motion Compensated De-Interlacing
– Linear Techniques
• Temporal Interpolation (Weave)
• Spatial [Field] Interpolation (Bob)
– Non-Linear Techniques
• Motion Adaptive
• Motion Compensated De-Interlacing
– Block Matching
– Pixel Based (TeraNex PixelComp™)
Linear Techniques
• Method 1: Temporal Interpolation
–
–
–
–
Combine or “Weave” both fields into a single frame
Retains full vertical resolution
Significant motion artifacts
Negligible compute requirements
Linear Techniques
• Method 2: Field Interpolation
–
–
–
–
Discard one field, interpolate from remaining field
Loses half of image vertical resolution
No Motion Artifacts
Minimal compute requirements
Linear Techniques
• Method 3: Vertical-Temporal
– Combines high frequency vertical information from adjacent fields
with current field. Contribution gradually decreases as temporal
frequencies increase.
– Vertical resolution good for slow moving objects, poor for fast
– Motion blur may occur (fields shifted in time)
– Moderate compute requirements
Non-Linear Techniques
• Method 4: Motion Adaptive
– Interpolates adjacent fields, using less and less neighboring field
information as measured motion increases
– Vertical resolution good for slow moving objects, poor for fast
– Motion blur and resolution pumping may occur
– Moderate compute requirements
Motion Compensated Techniques
• Method 5: Block Matching
– Generates motion vectors for nxn blocks, shifts blocks of pixels
from adjacent fields to build motion compensated frame
– Full vertical resolution maintained in motion comp’d blocks
– Motion artifacts around edges of blocks
– High compute requirements
Motion Compensated Techniques
• Method 6: Pixel-based Compensation (PixelComp™)
– Generates motion vectors for every pixel in image, shifts pixels from
adjacent fields to build motion compensated frame
– Full vertical resolution maintained
– No Motion Artifacts
– Extremely high compute requirements
De-Interlace Test Sequence
(Right to Left Pan w/Zoom)
Interlaced Input (Weave)
Field Interpolation
Motion Adaptive
De-Interlace Comparison
Vertical-Temporal
PixelComp™
De-Interlacing Applications
•
•
•
•
•
•
DTV Format Conversion
Standards Conversion
Pre-Compression Processing
Noise Reduction
Image Enhancement
Other digital video processing functions
DTV Format Conversion Process
•
•
•
•
•
•
Accept Input Video Stream (any format)
De-Interlace Input
Noise Reduce
Sample-Rate Convert
Colorspace Convert
Processing Options
– Proc Amp
– Detail Enhance
• Output Converted Video Stream
De-Interlace Failures
• Noise or Compression Artifacts in SDTV source
can cause fallback to Linear Interpolation.
Interlace artifact becomes visible.
De-Interlace Failures
Noise in a different location on sequential frames or fields
confuses the De-Interlace Process
Impulse or Recursive Noise
in a different place every field
Field
Field 22
Field
Field 11
Image
Image Pixels
Pixels in
in the
the same
same
place
place every
every field
field
De-Interlace Failures
• Reverts to Linear De-Interlace Mode causing loss
of vertical resolution
Contingency for De-Interlace Failure
• Need high-end noise reduction before Up-Conversion.
• Traditional Upconverter built-in Noise Reducers only have
simple Chroma Luma noise filters and are not powerful
enough to handle broadcast source material with complex
Recursive or High Frequency noise.
• Need Dedicated Pre-Compression Noise Reducer
Processing function as part of the Up Converter to
eliminate de interlacing more than once, and introducing
more artefacts
• TeraNex Starfront Noise Reduction Algorithms are
optimized for compressed or noisy broadcast material.
Traditional Up-Converter
SDTV
Source
Upconverted
HDTV
Source
De-Interlace
Upconvert &
Simple Noise
Reduce
De-Interlace
Pre-Compress
Processing
(NR+Brick-wall)
Re-Interlace
HDTV to
Pre-Comp.
Processor
Re-Interlace
HDTV
To MPEG
Encoder
Traditional Pre-Compression Noise Reduction Processor
SDTV
Source
De-Interlace
Temporal
Recursive
Noise Reduce
Upconvert
Pre-Compress
Processing
(Brick-wall)
Adaptive
Median
Noise Reduce
Re-Interlace
HDTV
To MPEG
Encoder
TeraNex STARFRONT
Combined Up-Converter and Pre-Compression Noise Reduction Processor
Combined Xantus/Starfront
Xantus
Up Converter
Starfront
Pre-Compression
Noise Reduction
Processor
Starfront
With
Up Converter
Option
Hardware Implementations
• Hard-Wired ASIC/FPGA-based Solutions
– Not adaptable to new algorithms or video standards
– Require shortcuts to implement algorithms in real-time
– Not enough performance to support Pixel-based Motion
Compensation
• Computer-based Solutions
– Conventional processors cannot perform high quality
de-interlacing in real-time due to compute & I/O
limitations
– Requires massively parallel computer subsystem
TeraNex SIMD Processor (Piranha)
•
•
•
•
•
•
•
•
•
Single Instruction Multiple Data Architecture
Fifth Generation Parallel Processing ASIC
1024 Processing Elements (PE’s) per chip
PE’s are mapped directly to image pixels
Each PE has an ALU, Registers, and Memory
All PE’s run same program simultaneously
2D Mesh, 4-way inter-connected Array of Processors
Linearly Scalable 2-D Arrays
4 Patents Issued, 8 Pending (Owned by TeraNex)
Piranha V Specifications
• Fifth Generation ASIC .35u VLSI
• 1024 Processing Elements (PE’s) per chip
• 1024-bit-wide data bus to internal memory
– 24 Giga-Byte per second memory access rate (per chip)
• 8 Gig-Op Performance Typical (per chip)
• Processor aligns to resolution of data
– Up to 64 Gig-Op Performance (1-bit data)
• Six 25-chip boards can provide TeraOp Performance
TeraNex Video Computer Platform
•
•
•
•
New paradigm for video processing
Compact 6RU chassis
SDI and HD-SDI inputs and outputs
Touchscreen GUI - intuitive interface, instant status
feedback, tailored for specific application
• Over 1 TeraOp computational power enables world-class
de-interlacing & video processing
• 3.6 GigaByte/second internal I/O rate
• Formats and functions updateable via internal CD-Rom
Video Computer Configurations
• Xantus™ Format Converter Family:
–
–
–
–
–
Up-Converter (AUS 50 Hz Model)
Down-Converter (AUS 50 Hz Model)
Up-Down Converter (AUS 50 Hz Model)
All-Format Converter (50 Hz and 60 Hz Support)
Standards Converter
• Starfront™ Noise Reduction Family:
–
–
–
–
Broadband Pre-Compression Processor
Broadcast 576i50 Pre-Compression Processor
Broadcast 1080i50 Pre-Compression Processor
Broadcast Pre-Compression Processor w/Integrated Upconverter
One Box Does It All
Standards
Converter
Down-Converter
Up-Converter
Pre-Compression
Noise Reducer
TeraNex
Video Computer
TeraNex Video Computer
Xantus Touchscreen GUI
I/O Formats
De-Interlace Options
Custom Colorspace Conversion
Srarfront Touchscreen GUI
Temporal Recursive NR
Brick-Wall Filter
Zoomed original image
Noise Reduction Applied
Compression Results with NR
Noisy Original Image Source
Noisy Image Source After
Pre-Processing
Results of Compression
No NR Before
Compression
Noise Reduced
Before
Compression
Noise Reduced
Before
Compression
No NR Before
Compression
Remote Control Capabilities
Xantus/Starfront
3RU Remote Control
Ethernet
Hub
Summary
• De-Interlacing is required in most applications where
interlaced video is processed digitally
• De-Interlace quality is driven by processing power, and with
one TeraOp of processing power, the TeraNex Video
Computer sets a new standard in image quality
• The quality of the Format Conversion is directly proportional
to the quality of the input source. Format conversion is not a
substitute for HD Production. You can’t create miracles!
• Pre-Compression processing is vital to achieving high quality
results from compressed or noisy source material
• TeraNex Starfront combined Upconverter & Pre-Compression
Processor puts the processing functions in the proper location
in the chain and eliminates redundant de-interlacing
• Flexibility is vital in this ever-changing world of DTV
Questions
Combined Upconverter and Pre-Compression
Processor for Highest End-to-End Image Quality
Jed Deame
Director of Product Development
TeraNex, Inc.
[email protected]
www.teranex.com