Networked Media and 3D Internet

Consultation Workshop
“Future R&D Challenges on Networked
Media Systems”
Welcome and Context
Luis Rodríguez-Roselló
Director a.i “Converged Networks & Services”
Head of Unit “Networked Media Systems”
DG-INFSO
Brussels, 19th of January 2010
EU R&D on Networked Media
The current project portfolio and clusters
•
Media Delivery Platforms and Content
Delivery Networks: High quality TV via P2P;
Digital Cinema, Next generation of P2P; IPTV and
VoIP over IMS; Seamless content delivery; Scalable
video coding
•
User Centric Media: Shared interactive
•
3D Media: Mobile 3D TV over DVB-H; Digital
•
Multimedia Search: P2P search; P2P tagged
experiences; Community content (including cocreation); Dynamic personalisation and interaction;
Seamless integration of UGC and professional
content; Real-time context-aware media streaming;
New forms of mobile music; Networked games
environments; Interactive multimedia experiences
Cinema; Content generation and delivery of 3D
digital TV; Spatial sound and vision; Feeling of
physical presence
media; Multimedia content analysis; Automated
annotation; Mixed-media queries; Data fusion;
Location-based; Retrieval of 3D objects; Direct
Search
The Work Programme 2009-2010:
what was called for
• Content-aware Networks and Network-aware Applications
 User generated content/social networks, Enriched media
experiences (at the “Extended Home”, content and context-aware,
personalised, social media, real time). Optimal QoE. Users as producers,
consumers, managers of content.
• 3D Media Internet
 Mass distribution, real time delivery and rendering,
representation, augmented worlds.
• Networked Search and Retrieval
 Large scale distributed MM content, interaction, dynamic
adaptation to context and application, personalised search
• Immersive Media Experiences beyond HDTV and Electronic Cinema
 Next generation MM and cinema: higher QoE (frame rates, contrast
range, colour, resolution, “spacialised” sound, 3D, innovative
3D/multi-viewpoint coding…)
Upcoming R&D on “Networked Media and
3D Internet” (1/2)
• Content-aware Networks and Network-aware Applications:
 Networked Media “ecosystem”
 Content-centric network architecture
 P2P architecture for User Generated Content
 Network-controlled adaptive content delivery
 Optimization of bandwidth of HD-SD IPTV and Internet TV streaming
 Collaborative, social, context-aware and scalable media distribution
 Optimization of content source selection and distribution (user
preferences, network state
 Compression and delivery of multi-view video and multi-channel audio
 European reference architecture for Future Media Internet
 Contribution of Networked Media community to Web standards
Upcoming R&D on Networked Media and 3D
Internet (2/2)
• 3D Media Internet & Immersive Media Experiences
 New paradigms for realistic 3D communication over the
Internet Virtual instantaneous transportation of people
 Real time interaction between humans and virtual humans
 Immersive and interactive TV (live events, ultra-high
resolution panoramas…)
 3D display and transmission of multi-view signals
 New forms for the creation and delivery of live media
content (automatic capturing of the events in 3D, realistic,
interactive and immersive play-back…)
 Virtual Centre of Excellence
• Networked Search and Retrieval
 Open platform for multimedia and multimodal content
indexing, sharing, search and retrieval
 Use of events as the primary means to organise and index
media: experiential, new social networking (event-based
communities), personalised, automated media search and
content retrieval
 European coordination action
Future Research
Preparatory work for the Work Programme 2011-2012 in
Networked Media Systems
• Public consultation (closed 19th December 2009)
• Workshop on future R&D challenges in Networked Media
Systems based on the results of the public consultation;
• Topical Workshops
• Immersive media experiences
• Broadcast driven Media in the Future Internet
Convergence Internet/Broadcasting+ …/ The Future of Digital Broadcasting…
• Other Workshops (3D, User Centric Media…)
• NEM Strategic R&D Agenda (vers. 7, Sept 2009)
• Future Internet (R&D agenda, Public Private
Partnership - PPP)
•
•
R&D Challenge in ICT (Long-term issues): Future Media & 3D Internet
PPP: Linking technologies with applications: Smarter Infrastructures (smart
health, smart energy, smart living…); service architectures; user-centric
open innovation schemes, closer to the market.