What’s Next with WebRTC
Random Thoughts on area that we might consider
Cullen Jennings
Sept 2016
New video types
•
Dealing with 360 degree spherical
video
• Dealing with stereo video
Virtual Augmented Reality
Approaches to real time sending of:
• 3d point clouds
• video texture maps
• layered fragments of view
Location and Orientation
• Of camera and microphones
Location Privacy
•
Current approves reveal a lot about
physical location of both parties.
• See what it would take to improve
privacy here
Replace SDP with better model
•
ORTC largely is enshrining SDP in
JSON syntax
• Be nice to get something that was
way easier to work with and better
fit with modern cloud approaches
Sensors
Tie real time sensor location between
devices synchronized with media
• Includes GPS, rotation,
acceleration, magnetometer
Common request from drone
applications
Way to access custom OS sensors
(with appropriate permission model)
Replace ICE
Much simpler mechanism to move
most of the ICE machinery out of
browser and allow JS to use better
apaches
Still need basic STUN connectivity
checks in browser
Better Data Channel
Replace SCTP with QUIC
Send RTP over QUIC
Resizable Video
Make it so when the video receiver
resizes the window, the sender
dynamically changes the size of the
transmitted to video to match the
window
End to End Multi Party Security
Currently most apps that support more
than two users reveal all the media to
the cloud
Possible to provide end to end by
providing browser support for IETF
PERC WG
Simulcast / Scalable Codes
WebRTC 1.0 has limited support for
simulcast and scalable video codecs
• Provide full blown support for
sending and receiving this
Pluggable Video Codecs
Standardize a API to allow
downloadable video codecs to avoid
the codec wars
(like to point out Bernard suggested
this long long ago)
Mobility
Make media move between Wi-Fi and
cellular data with no hick ups
Congestion Control
JS does not have much fine grain
control over hints to influence media
resiliency and congestion control
Input / Output device selection
Better API for JS to allow the user to
configure what devices are used for
given operations
Camera Control
Standardize ways to deal with things
like white balance, contrast, brightness
etc. on camera
Control pan / zoom / tilt of camera
(digital or physical )