Paper - Tomorrow Is Always A Day Away

Tomorrow:
It’s Always a Day Away

Mark Schubin, SchubinCafe.com
these slides at bit.ly/ttc2018-tomorrow
SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

Tech
Retreat
2017

Journal of the Royal Institution

Every Publication in the World?
• at least English, French, German, Italian, Polish, Portuguese, & Spanish
• œil artificiel, Künstliches Auge, occhio selenico, oko sztuczne, olho artificial, ojo artificial
• “A New Artificial Eye,” The London Medical Record
• “Artificial Eyes Made Sensitive to Light,” Willamette Farmer [Oregon]
• “Truly Artificial Eye,” The Great Bend Weekly Tribune [Kansas]
• [Siemens artificial eye], The Wallaroo Times [South Australia]
• “An Artificial Eye,” Bruce Herald [New Zealand]
• “Siemens’ Sensitive Artificial Eye,” Scientific American (2nd article)
• “An artificial eye,” The Journal of Education for the Province of Quebec
• “Artificial Eyes Made Sensitive to Light,” The History of the Year 1876
Some 1877 Television Researchers
• de Paiva
O Instituto
• Senlecq
La Lumière électrique
• Ochorowicz
Kosmos
• Carey

English Mechanic and World of Science, February 7, 1879, p. 540
report of actual transmission of a video image, w/references to scanning
1842: having
developed the
printing telegraph
& the remote
synchronized clock,
Alexander Bain
combined them to
get scanning for
image transmission
The IET Archives

1843
British
patent
for the
first fax
machine
(this
image
from the
U.S.
patent)

Introduced: In 1997, for
image sending the 25th
frames anniversary
scanning lines of the Institute
pixels of Image
line sync Electronics
frame sync Engineers,
Masayuki
Miyazawa built
a fax pair based
on the 1843
Bain patent

• 1952
• 31 cinemas, 27 cities
• low def, B&W, <AM-
radio-quality sound
• >60,000 seats sold,
~US$75 top (today)
• rated highly
• even where TX was
interrupted

Cinema Audience Perception
• Group Mentality
• if they don’t complain,
why should I?
• applause
• Cognitive Dissonance
• money, time, effort
• if bad, then stupid
• therefore good

Different Era
Peasant Wedding Dance

c. 1607
Pieter Bruegel the Younger

SMPTE Journal
April 1981

• 1st operational digital video demos
• North American demo of HDTV

photo by
Deborah D. McAdams
VR - AI - HDR - IP - IMF - Archives
“Practicing Safe VR,” NAB 2018
photo: Norm Hurst, SRI
used with permission

head-tracking camera
U.S. patent 1,939,665
applied for in 1931
VR Issues
• spatial resolution
https://www.roadtovr.com/bechtel-partners-iti-expand-vr-crane-training-capabilities/
• latency
• comfort
• use

Nokia Ozo

Nokia Ozo
hit of 2016

Nokia Ozo
hit of 2016
dropped in 2017
Volumetric Video Studio

Direct a VR movie

Direct a volumetric
movie

https://www.pornhub.com/insights/virtual-reality

The New York Times

The New York Times
April 22, 1980

May 9, 1953
“3-D Invades TV”

3DTV 1928 John Logie Baird

S3D Movies
• 1941 glasses-free theatrical viewing
• Stereokino Moscow
• 1922 active-shutter theatrical viewing

• Teleview
• 1915 in cinema auditorium

• Astor Theatre New York
• 1852 Duboscq patent

• earliest photographic motion-picture patent

Direct a movie
that works as
well in S3D
and 2D

Direct a movie Direct a movie
that works as that works as
well in S3D well as a silent
and 2D and with sound

Artificial Intelligence
term coined 1955, John McCarthy, Dartmouth
• voice recognition • faster workflow

• image recognition • easier versioning
• voice reconstruction • loss of jobs
• image reconstruction • easier fixes
• technical adjustment • fake news

http://norman-ai.mit.edu/

NAB
2017

Adobe Match Color
also audio ducking,
motion graphics, etc.
NAB
2016

Technicolor at 2018 HPA Tech Retreat

Technicolor at 2018 HPA Tech Retreat
Is HDR production and post necessary?

Surprise (to me)!
I worked on HDR-to-SDR downconversion with Tom Stockham in 1975

(we called it “contrast compression”)
from “Nonlinear filtering of multiplied and convolved signals”

A.V. Oppenheim ; R.W. Schafer ; T.G. Stockham
Proceedings of the IEEE, August 1968
NAB
2017
Sony
Canvas
Sony
Crystal LED
Viewing Tests: 56” Screen
HDR (preliminary)
HD 4K
HFR
EPFL @ TSC 2014

4K=8xHD (720p or 1080i) EBU @ IBC 2013
(EBU similar)
pre- & post-compression
EBU @ HPA 2013

2x/grade 0-0.2x/grade
pre- & post-compression

data rate increase of vertical scales normalized
~16x per grade vertical change is amount of improvement
HDR Interactions
“How Independent are HDR, WCG, and HFR in
Human Visual Perception and the Creative
Process?”
SMPTE Motion Imaging Journal,
May/June 2016, pp. 24-33
Sean McCarthy,
HDR interacts with: ARRIS Group
• frame rate, viewing angle, brightness, hue (in
different directions), programming, viewing time If you care
about HDR,
this is a
must-read
HDR/Frame-Rate/FOV Interaction

coating
• reflections
• no perforations
photo by Adam Wilt with 14-element lens

https://www.provideocoalition.com/nab-2018-what-caught-my-eye/

NAB
2017
SMPTE ST 2110-x Suite of Standards
• ST 2110-0 Roadmap for the document suite

• ST 2110-10 “System Timing & Definitions”
• ST 2110-20 “Uncompressed Active Video”
• Based on RFC 4175
• ST 2110-30 “PCM Digital Audio”
• AES67
• ST 2110-21 “Traffic Shaping & Delivery Timing for Video”
Approved &
• ST 2110-22 “Compressed Video” Published!
• ST 2110-31 “AES3 Transparent Transport”
• Includes compressed audio
• ST 2110-40 “SMPTE ST 291-1 Ancillary Data”
• Captions, subtitles, time codes, active format description, dynamic range, etc.
• Co-developed with IETF as new RFC 8331 RTP Payload for SMPTE ST 291-1
Is Pro Media for IP Real?
Live use cases & interop of

real-time professional media over IP
IBC16, NAB17, IBC17, SMPTE ATC 17
@NAB18: 50+ vendors!
Photos from NAB18 IP Showcase

There Is No Patch-Around in IP
cropped from
www.theground.town/show/patchbay
IMF: Pixar Really Has Versions

David Sarnoff Predictions (credited)
• Broadcasting
• Success of TV
• Color TV
• Video recording
• Home video
• Electronic cooling
• Internet
• E-mail
• Cell phones
• iPods

David Sarnoff Predictions (other)
• Nuclear flashlights
• Broadcasting will
never be commercial

David Sarnoff on Predictions
“Predict a vast number of items

and then, when the
appropriate time [has]
arrived, point to the successes
and forget the failures.”

My 1978 Predictions
• solid-state cameras 
• not much of a prediction in 1978
• direct brain stimulation X
• some experiments
• touch-screen image manipulation 
• maybe mine
• thought-controlled PTZ X
• Battelle National Laboratory research
• video flashlights 
X=
• all in the lens not yet
• “crystal” recording X
• lab research
self-
replicating

We “Predict” Based on the Past
24-hour news cycle, based on 1844 invention of continuous-roll newsprint

1846 SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018
Why We Often Get It Wrong
prediction action
• the past • binge viewing
• what we think we can sell • vertical aspect ratio
• S3DTV “It is my desire to intone
• USB Pet Rock the hymn of the male, the
strong, the virile, active,
vertical composition!”
Sergei Eisenstein,
“The Dynamic Square” 1930
1975 2009

Silicon Retina 2014
Tobi Delbruck, Co-Founder, iNiLabs; Professor, ETH

at IBM Research Cognitive Systems Colloquium:
Brain-Inspired Computing at IBM Research - Almaden in San Jose, CA
bit.ly/ibmretinal
Silicon Retina 2014
Tobi Delbruck, Co-Founder, iNiLabs; Professor, ETH

at IBM Research Cognitive Systems Colloquium:
Brain-Inspired Computing at IBM Research - Almaden in San Jose, CA
bit.ly/ibmretinal
Ramesh Raskar TED Talk 2012
MIT 1 Tfps camera 2012 http://bit.ly/mitfast
See Around Corners
MIT 1 Tfps camera 2012 http://bit.ly/mitfast

Project Fine Demo - NAB 2012
longer version:
https://www.youtube.com/watch?v=2NJW1Pzhspg

Questions?
these slides at bit.ly/ttc2018-tomorrow

Paper - Tomorrow Is Always A Day Away

Încărcat de

Informații document

Titlu original

Drepturi de autor

Formate disponibile

Partajați acest document

Partajați sau inserați document

Opțiuni de partajare

Vi se pare util acest document?

Este necorespunzător acest conținut?

Drepturi de autor:

Formate disponibile

Paper - Tomorrow Is Always A Day Away

Încărcat de

Drepturi de autor:

Formate disponibile

Tomorrow:

It’s Always a Day Away

these slides at bit.ly/ttc2018-tomorrow

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

The IET Archives

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

Peasant Wedding Dance

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

April 22, 1980

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

• 1922 active-shutter theatrical viewing

• 1915 in cinema auditorium

• 1852 Duboscq patent

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

term coined 1955, John McCarthy, Dartmouth

• voice recognition • faster workflow

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

Is HDR production and post necessary?

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

I worked on HDR-to-SDR downconversion with Tom Stockham in 1975

from “Nonlinear filtering of multiplied and convolved signals”

EPFL @ TSC 2014

EBU @ HPA 2013

pre- & post-compression

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

photo by Adam Wilt with 14-element lens

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

• ST 2110-0 Roadmap for the document suite

Live use cases & interop of

@NAB18: 50+ vendors!

Photos from NAB18 IP Showcase

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

“Predict a vast number of items

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018

24-hour news cycle, based on 1844 invention of continuous-roll newsprint

SMPTE Toronto Section – Toronto Technical Conference (TTC) 2018