MMT Packet

Transcription

MMT Packet

MMT and DASH 2012/4/19
over All-IP Network
2014. 06. 24
박경모 책임
([email protected])
KRnet 2014 (2014-06-24)
Contents
If you are interested in any of the following:
 Streaming audio and video to Smartphone, Tablet, PC, SMART
TV, or UHDTV over the Internet.
 IP Broadcasting and Hybrid delivery services for multimedia.
 Sending video on demand with QoS (Quality of Service)
 Streaming multimedia with QoS or QoE (Quality of Experience)
You should learn about this.
Ⅰ
MPEG-DASH
Ⅱ
MPEG-MMT
KRnet 2014, H-1. Multimedia Networking
Video will dominate the Internet and Mobile
 Internet  Real-time video is 50% of the traffic at peak periods
 notably 28.18% from Netflix and 16.78% from YouTube*
 Mobile  Video traffic is growing exponentially & is a large portion
* source : sandvine
69.1%
Source:
Cisco White Paper:
Cisco Visual Network:
Index:
Global Mobile Data
Traffic Forecast
Update, 2010-2015
Cloud applications and services also dominate
 Cloud Video  many Internet video applications can be categorized as
cloud applications, mobile cloud traffic follows a curve similar to video.
 Netflix, YouTube, Pandora, and Spotify allow mobile users to overcome the
memory capacity and processing power limitations of mobile devices.
 Mobile Video Will Generate Over 69 Percent of Mobile Data Traffic by 2018
Source:
Cisco White Paper:
Cisco Visual Network:
Index:
Global Mobile Data
Traffic Forecast
Update, 2010-2015
Movement for Smart Multimedia Delivery
The generation of the high quality and combined multimedia consumption
at the various devices with no constraint of user environments”
Full HD
3D
2011
Beginning Mobile media
IPTV, Sat. Cable UHD
2015
1st generation of
mobile media
Terr. UHD broadcasting
All IP,
Clouds
Extension of mobile
media
2020
Completion of mobile
media
UD contents
3D Earth
Trends in Broadcasting
• Immersive Contents (UHD)
Contents
• Smart interactivity
• Multiple contents on the screen
• High Speed Broadcasting Network
• Emerging Broadband Network
Network
• Hybrid Delivery
• Larger Screen Devices.
Devices
• Multimedia Devices everywhere.
• Single service on the multiple Screens
MPEG-DASH
(ISO/IEC 23009-1)
KRnet 2014 (2014-06-24)
2012/4/19
User Frustration with Internet Video
Background
 Can’t access the content





 Low quality of experience
Behind a firewall
Bandwidth not sufficient
Wrong format
Wrong DRMs
Wrong device





Long start-up delay
Frequent re-buffering
Low playback quality
No lip-sync
No DVD quality (language, subtitle)
Microsoft
Apple
“Smooth Streaming”
“HTTP Live Streaming”
IETF
Adobe
“HTTP Streaming”,
“HTTP Progressive Download”
“HTTP Dynamic Streaming”
The need for an interoperable universal standard that can work on
today’s Internet infrastructure and delivery a consistent high quality
experience to the end user.
What is DASH?
Dynamic Adaptive
 Seamless rate adaptation
 Random access & Trick mode support
Streaming
 Not (progressive) download
 Including “Live” streaming
HTTP
 Assuming legacy HTTP 1.1 service & client
 HTTP cache mechanism
HTTP Adaptive Streaming – Common Understanding
Source : DASH Workshop
(T. Stockhammer)
 HTTP (RFC2616)
 Application layer protocol (over TCP), presume a reliable Transport layer protocol for hostto-host data transfer.
 request-response protocol in the client-server computing model.
 Intermediate network elements to improve or enable communications between clients and
servers (proxy and/or web cache).
 HTTP Resources are identified and located on the network by Uniform Resource Identifiers
(URIs) or, more specifically, Uniform Resource Locators (URLs) using the http or https URI
schemes.
MPEG-DASH (ISO/IEC 23009-1)
 A New Standard : ISO/IEC 23009-1
 Efficient solution for HTTP-based streaming of MPEG media
 Objectives
 A specification defining standard delivery format for streaming multimedia
over Internet.
 A standard for building interoperable solutions by various vendors.
 provides formats to enable efficient and high-quality streaming over the
Internet
 IS published (2012)
 ISO/IEC 23009-1, Media Presentation Description and Segment Formats
 extensions to ISO Based Media File Format to support DASH (ISO/IEC 1449612/AMD3)
 Common Encryption 23001-7 with AES-128 CTR
Scope of the MPEG-DASH
 MPD and Index information for DASH access client
 Core specification aspects of DASH
 Initialization and Media Segment for Media engine
 Reuse of existing container formats and easy conversion
Example of DASH
* Period : Time sequence of Media Presentation
* Representation : Encoded version of media component
* Random access & Trick mode support
MPD hierarchical model
Splicing of
arbitrary
content
Selection of
Components
Set of switchable
Representation
Select/ Switch of
Bandwidth
Example Deployment Architecture
Original Content
Content
Preparation
Ingestion
component
 Original content encoded into video streams at different media
bitrates
 Packages video streams into video files
 MPD file generated for the video files
 URL generated for MPD files
 URI indicated for each Media Segments
 All intelligence in the client side
 Accesses MPD file based on URL & makes requests for
appropriate video file
 adjust media rate based on network conditions
Content Cloud Services
(HTTP caching servers)
IP Networks
HTTP Delivery
DASH Client
Intelligence in Client-based control
Source : DASH Workshop
(T. Stockhammer)
 The Client has significant information on its consumption environment (processing
power, display, access bandwidth, etc.) and can directly select and dynamically adjust
to these changing conditions.
 The client can implement many smart measures to optimize quality and throughout
such as buffering, load balancing, multiple connections and so on.
 The client can directly react to user interaction
 It permits to use standard HTTP servers permitting massively scalable and cost-efficient
distribution of high-quality content.
 It permits stateless distribution of content, i.e., the network does not have to maintain
1:1 connection for a session.
16
Summary of DASH
 MPEG-DASH is a client-centric solution.
 The Client can control the QoS for the user in a DASH-based deployment
 MPEG-DASH
17
 Standardization is completed (ISO/IEC 23009-1)
— harmonized industry standard for OTT video
— applicable to TV and mobile world
 Support the client in making smart decisions by providing available
information to client
— specified the MPD describes accessible Segment and corresponding
timing.
— focused on Segment formats based on MPEG container format.
 Use general purpose tools for controlling HTTP/TCP applications (TCP CC,
HTTP codes, etc.)
 Use existing control mechanisms (DRM authentication, HTML5/Web
tools).
MPEG-DASH Status
 Latest status in MPEG DASH
 23009-1 2nd Edition FDIS, Amd1 support for event messages and extended
audio channel configuration (Aug. 2013)
 23009-2 FDIS, Conformance and reference software (Aug. 2013)
 23009-3 DTR, Implementation Guidelines (Aug. 2013)
 Descriptions of Core Experiments on DASH amendment
— Metadata track
— DASH Authentication for Content URL validation
— Server and Network assisted DASH operation
— Controlling DASH client behavior
— Spatial relationship description
 Technologies under Consideration
— Low latency live support
— Improved relations for advanced media (e.g. depth)
18
Forward looking
 Open sources
 The MPEG-DASH conformance and reference software provides the ideal
playground for researchers as it can be used both to generate and to consume
bitstreams compliant to the standard.
(http://www.dashif.org/)
(http://gpac.wp.mines-telecom.fr/)
19
http://www-itec.aau.at/dash/
MPEG-H, MMT
(ISO/IEC 23008-1)
KRnet 2014 (2014-06-24)
2012/4/19
Future Broadcasting
 Enjoy very high quality and combined multimedia consumption at the
various devices with no constraint of user environments
UHD
Mobile
VOD
Broadcast
Live
streaming
File
Hybrid
widget
Broadband
E-book
metadata
UHD : Ultra High Definition
VOD : Video on Demand
Future Multimedia Services
 Evolution
: High Quality Contents and High Speed Network
 Revolution : Data Broadcasting, Multiple Screens, Hybrid Network
UHDTV
Mobile HD
Data
Broadcasting
Hybrid Network
Big Screen
Multiple Screens
(Bi-directional services)
(w/ sync-ed services)
Future Broadcast Requirement
• IP based multimedia delivery for all kinds of devices
– Many service provider and broadcaster believes, all IP based network
environment is for the future delivery.
• QoS/QoE enhanced media delivery over IP
– People wants to enjoy HDTV experience regardless of underlying network
types; No buffering time, constant and high quality.
• Not only AV but also ‘new media’ and ‘non-timed media’
– New media: Augmented Reality can be presented over video.
– Non-timed media: Widget and image can be presented over video.
• Storage and streaming in common format
– More streamlined and simple format for media delivery.
• Operator manages core and fundamental service description
– Complex presentation but simple and light composition format.
Analyzing the improvement factors
 New standard should be substantially better
than MPEG-2 TS and MP4/HTTP, RTP/RTSP
and combinations
Compression Layer
(Audio ES, Video ES)
– It would be nice if it is a companion to
MPEG-2 TS
 MPEG-2 TS is overloaded  new solution
might be required
– Buffering models are getting complicated
(e.g. MVC/SVC over TS)
– Running out of code points
– TS/PES size is not suitable to emerging
services (e.g. UHD)
 New standards are required for
– Converged application (Adaptive and/or
Progressive Download)
– Unmanaged environment
– Fixed and mobile convergence
– Hybrid delivery (Broadcast and Internet,
Push/Pull/Unicast/Multicast/Overlay
Multicast)
Synchronization
Layer
(MPEG-2 PES,
MPEG-4 SL)
Application
Layer
(e.g. HTTP, RTP)
Transport Layer
(TCP, UDP)
Internet Layer
(IP)
Delivery Layer
(MPEG-2 TS, MP4
File)
•
•
•
•
ES/SL/TS over RTP
TS over UDP
File over HTTP
TS over HTTP
MPEG-H
P1
P2
MMT: An Emerging MPEG Standard for Multimedia
Delivery over the Internet
MPEG Media Transport
•
New MPEG transport solution for IP environment
•
More flexibility on content consumption and delivery
•
Suitable for 1 to 1 as well as 1 to M transmission
High Efficiency Video Coding
•
HEVC provides a novel video format with a compression capability twice that of AVC ( to be
done by 2013.1Q)
•
Extensions for support of higher bit-depth, color sampling beyond 4:2:0, stereo/multiview
(MVC-like) expected early 2014
P3
3D Audio
•
“Home Theater” : More Speakers, Immersive 3D Audio
•
“ Enhanced Personal System” : Immersive Audio in Portable Device
MMT – New Global Standard
 New global standard for media
delivery and encapsulation
 MMT allows broadcasters to move to IP
without losing the major advantages of
MPEG-2 TS (e.g. tight synchronization,
clear buffer model) while also reducing
complexity and overhead
 MMT integrates fully with HTML5 and IP
technologies
 MMT provides excellent support for
hybrid delivery of multimedia services
 MMT is well suited to fixed and mobile
reception
MPEG-H Part 1 MMT
MMT Package
01
Media Encapsulation
MMT assets
TV2 and the
Streaming Media Portal
UHD
VOD
•
Support any type of data (Video, Audio, Apps )
•
Single format for transmission and storage
•
Adaptation considering NW condition is possible widget
MMT
Packets
Live
streaming
Hybrid
delivery
File
PC Streaming
Media Portal
MMT
Packet
Delivery over DSL
Symbol
E-book
Description
Windows Media
Encoder
02
Media Presentation
•
Windows Media
Server
TV2 uses a Windows Media
Server farm as its media store.
metadata
HTML 5 + enhancement for Media Consumption
The TV2 Notification Web
Service supports integration
with voice (Caller ID and SMS)
as well as data (Instant
Messaging, Alerts) services.
TV
•
Temporal, Spatial and event based presentation is possible.
Transport
Most suitable IP based scheme for MPEG Media
•
Network based adaptation is possible with CLO.
•
Server controls NW resource.
EPG
Acquisition Server
Live Encode
Supports any kinds of devices with a single presentation
•
Description
Subscriber
Management
DServer Media Router
•
03
TV2IP
Headend
Delivery over DSL
network
Symbol
MMT
Packets
Media delivered to the PC may
also be delivered to the TV,
including Video, Music and
Photos.
`
Adaptation
Multiservice/context
aware
MMT – Functional Areas
• Functional areas
– Encapsulation
• Container Format
• Media Packetization
• Media Fragmentation
• Media Synchronization
Signaling
• Content Protection
Function
– Delivery
• Network flow multiplexing
• Network Packetization
• QoS, AL-FEC, ARQ
– Signaling
• Information for Media Consumption
• Information for Media Delivery
Media Coding Layer
Encapsulation Function
Delivery Function
Transport Protocol (TCP, UDP)
Internet Protocol (IP)
MMT Architecture & protocol stack
MMT – Content Model
Package can be
logically defined for
dynamic creation of
mash-up service
Each Access is
associated with
delivery
characteristics
information
Asset (and MPU) is
uniquely identifiable
for distributed
caching and named
based search
* CI provides information
for associating assets to a specific
screen for multiple screen
presentation environments.
Temporal relationship
information is
provided to optimized
delivery order
MMT Package instantiation, packetization
IP Broadcasting over MMT
technology
media synchronization
channel change time
UTC
MPEG2-TS
STC-based DTS/PTS
up to 2 seconds
not supported
DASH on eMBMS
DTS/PTS (always relative time)
2~4 sec.
not supported
MMT
UTC-based DTS/PTS
up to 1.4 sec.
supported
Hybrid delivery over MMT
technology
Ad insertion
presentation
synchronization
MPEG2-TS
static
not supported
not supported
DASH on eMBMS
flexible at media level
maybe supported with HTML5
possible with MPD
update in advance
MMT
flexible at media and
fully supported with MPEG-H CI
packetKRnet
level 2014, H-1. Multimediaand
HTML 5
Networking
fully supported
with MPEG-H CI
Targeting Specific Audience Group over MMT
Presenting the Multiple Content Items in MMT
MMT – Encapsulation
 Media Fragment Unit
– a generic container format, independent of any specific media codec, containing coded media data
that is independently consumable by a media decoder.
– equal to or smaller than an Access Unit (AU) and contains information that can be utilized by
delivery layers.
– aligned to “NAL” concept in AVC series standards (including HEVC)
 MMT Processing Unit
– a generic container format, independent of any specific media codec, containing one or more AUs
and additional delivery and consumption related information.
– coded media data unit that can be completely and independently processed in MMT.
 MMT Asset
– data entity that is composed of one or more MPUs.
– the largest data unit for which same composition information and data characteristics are applied.
– contains only one kind of data type including packaged or multiplexed data
(e.g. a portion of audio ES, a portion of video ES, an MPEG-U Widget Package, a portion of MPEG-2
TS, a portion of MP4 file, and a portion of MMT Package).
 MMT Package
– MMT Package is a logical entity.
– An MMT Package shall contain one MMT Composition Information (MMT-CI), one or more MMT
Assets and an associated MMT Asset Delivery Characteristics (MMT-ADC) for each MMT Asset
MMT – Packetization







length (16bits) – This field indicates the length of the payload in bytes excluding the header.
type (8bits) − This field indicates the type of payload data.
f_i (2bits) − This field indicates the fragmentation indicator contains information about fragmentation of
data unit in the payload.
fragment_counter (frag_count: 8 bits) − This field specifies the number of payload containing fragments of
same data unit succeeding this MMT payload.
number_data_unit (numDU: 4 bits) − This field specifies the number of data unit within this MMT payload.
DU_offset (16bits) − This field specifies location of each data unit from the byte indicated by data_offset.
This field shall be used, when aggregation_flag is set to ‗1‘.
payload_sequence_number (32 bits) − This field specifies the sequence number of payload associated
with the same Asset.
MMT Packet
 Similar features to MPEG-2 TS packets
– Multiplexing of components into one delivery stream
– Interleaving of data from multiple components considering consumption order
– Random access indication
 New features
– Assuming TCP/UDP/IP as underlying delivery layer protocol
– Carrying delivery time instance based on NTP for delivery jitter removal
– Two stage application layer FEC for strong error protection
MMT – Signaling
Encapsulation
Function
Encapsulation
Function
Delivery
Function
Delivery
Function
 Similar features to MPEG-2 Sections
–
–
–
–

Carrying composition information
Providing location information of components
Structure supporting repeated delivery
Hierarchical structure of information
New features
– Information for clock synchronization between MPEG-2 PCR and NTP
– Device Capability information and Downloadable DRM/CAS information are provided.
Conclusion
 MMT is a fully developed standard as an MPEG-H family (Systems).
 MMT lies between HTML5 and IP — it connects them
 MMT puts broadcaster in control of the hybrid broadcast/ broadband experience
 Single solution for encapsulation, delivery and presentation
 Designed for IP Packet based multimedia delivery
 Packet oriented delivery and use of Internet protocols and functionalities (e.g. NTP)
 Works over IP as well as non IP
 Server/System driven streaming approach
 QoS/QoE enhanced media delivery over IP
 Not only ‘AV’ but also ‘non-timed media’
 Data plane for the delivery of media data
 Control plane for signaling/management of presentation and delivery
 Enhanced Error Resilience : Two Stage AL-FEC (AL-FEC Framework)
41

MMT Packet

Transcription

Similar documents

Your partner for multimedia events at Kursaal Bern

Computer

enREDo International Design Network

New England`s leading provider of benefits education

technology - Tecnoconference Europe

- Lab for Media Search - National University of Singapore

mmt® Performance Additive for Octane—A Proven

Features

Performance Groups