Seminar by
Syed Lateef Uddin
B110877EE
S8 EEE
OVERVIEW
• Introduction
• Light Theory
• Components of Femto photography
• Streak Camera
• Applications
• Advantages and Disadvantages
• Conclusion
Every Photon has a Story
What is
around the corner ?
Can you look
around the corner ?
Can you look
around the corner ?
2nd Bounce
Multi-path
Analysis
1st Bounce
3rd Bounce
• Light is made up of little particles.
• They obey the same laws of physics as other
masses like baseballs and planets.
• They are tiny so the particles in two
intersecting beams do not scatter off each
other.
Isaac Newton
1643-1727
NEWTON’S PARTICLE THEORY OF
LIGHT
• According to Newton’s first law, the light
particle will continue moving in a straight
line since no net force acts on it.
• Near an interface the situation is different.
Now there are more matter particles on one
side than the other, and the light particle
can experience a net force. It would
experience a brief attractive force towards
the medium with more matter particles.
DRAWBACK OF NEWTON’S PARTICLE THEORY OF LIGHT
REFRACTION PHENOMENON
• Foucault, in France, used a small steam
turbine to spin a mirror at the rate of 800
rotations/sec(!)
• This is a compelling example of how quickly a
grand theoretical structure can collapse. All it
takes is one decisive experiment like this one.
• If there is no way to modify the theory to
account for the new result, the theory must
be abandoned.
DRAWBACK OF NEWTON’S PARTICLE THEORY OF LIGHT
Decisive Test of Particle Theory
WAVE THEORY OF LIGHT
• A wave is a pattern, or shape, or disturbance,
traveling through a medium.
Christiaan Huygens
1629-1695
• Diffraction
• Refraction
• Interference
sin(i)/sin(r) = λi/ λr = f λi/f λr =vi/vr
REFRACTION PHENOMENONDIFFRACTION PHENOMENON
YOUNG TWO- SLIT INTERFERENCE
PATTERN
INTERFERENCE PHENOMENON
DRAWBACK OF WAVE THEORY OF LIGHT
• Couldn't justify the PHOTOELECTRIC EFFECT
QUANTUM THEORY OF LIGHT
Max Planck
1858-1947
Wave-Particle Duality of Light
• Quantum theory tells us that both light and
matter consists of tiny particles which have
wavelike properties associated with them.
• Light is composed of particles called photons,
and matter is composed of particles called
electrons, protons, neutrons.
• It's only when the mass of a particle gets small
enough that its wavelike properties show up.
Trillion Frames per Second
Femto-Photography
Light in Motion
World's Fastest Slow-motion Camera
Trillion FPS
ToF STREAK CAMERA = Inverse of CRO
1D camera: Single scan line stretched vertically in time
~2 ps resolution
But for small samples in biochemistry
Very accurate sync
Time-Image
Time Profile
for a single pixel
R
Steady State 4D
Impulse Response, 5D
[Raskar and Davis, 2007]
[Kajiya, 1986] [Seitz.., 2005]
Inverting Light Transport
Multiple Scattering Direct/Global
Dual Photography
[Seitz , Kutulakos, Matsushita 2005] [Nayar, Raskar et al 2006]
[Sen et al 2005]
LIDAR
[Atcheson et al 2008]
[Kutulakos, Steger 2005]
dc
a b
e
z
x
y
Intensity (Arb. U.)
Backprojected Intensity (Arb. U.) Confidence (Arb. U.)
…, rescue operations, …
Collision avoidance, robot navigation, …
…, bronchoscopies, …
…, colonoscopies, …
…, cardioscopies, …
Sub - surface scattering in
fruit implies that it is ripe.
ADVANTAGES
• High speed imaging.
• Capturing pictures around corners.
• Can see objects beyond the line of sight.
DISADVANTAGES
•Total recording time lengthens to approximately
one hour.
•Expensive setup.
•Blurring in the data along the scanned dimension.
CONLUSION
We should stop obsessing about the Megapixels in cameras and
start focusing on next dimension in imaging...
“Its about Time”.
 Femto-Photography: Capturing and Visualizing the Propagation of
Light, Ramesh Raskar, MIT Media Lab.
 NAIK,N.,ZHAO,S.,VELTEN,A.,RASKAR,R.,ANDBALA, K.2011.Single view
reflectance capture using multiplexed scattering and time-of-flight
imaging. ACMTrans.Graph.30,6, 171:1–171:10.
 CAMPILLO,A.,ANDSHAPIRO,S.1987.Pico-second streak camera
fluorometry : are view. IEEE Journal of Quantum Electronics
19,4,585–603.
 www.wikipedia.org
 web.media.mit.edu/~raskar/cornar/
 web.media.mit.edu/~raskar//trillionfps/
THANK YOU
ANY QUESTIONS ?

Femto Photography

  • 1.
    Seminar by Syed LateefUddin B110877EE S8 EEE
  • 2.
    OVERVIEW • Introduction • LightTheory • Components of Femto photography • Streak Camera • Applications • Advantages and Disadvantages • Conclusion
  • 3.
  • 4.
  • 5.
    Can you look aroundthe corner ?
  • 6.
    Can you look aroundthe corner ?
  • 7.
  • 8.
    • Light ismade up of little particles. • They obey the same laws of physics as other masses like baseballs and planets. • They are tiny so the particles in two intersecting beams do not scatter off each other. Isaac Newton 1643-1727 NEWTON’S PARTICLE THEORY OF LIGHT
  • 9.
    • According toNewton’s first law, the light particle will continue moving in a straight line since no net force acts on it. • Near an interface the situation is different. Now there are more matter particles on one side than the other, and the light particle can experience a net force. It would experience a brief attractive force towards the medium with more matter particles. DRAWBACK OF NEWTON’S PARTICLE THEORY OF LIGHT REFRACTION PHENOMENON
  • 10.
    • Foucault, inFrance, used a small steam turbine to spin a mirror at the rate of 800 rotations/sec(!) • This is a compelling example of how quickly a grand theoretical structure can collapse. All it takes is one decisive experiment like this one. • If there is no way to modify the theory to account for the new result, the theory must be abandoned. DRAWBACK OF NEWTON’S PARTICLE THEORY OF LIGHT Decisive Test of Particle Theory
  • 11.
    WAVE THEORY OFLIGHT • A wave is a pattern, or shape, or disturbance, traveling through a medium. Christiaan Huygens 1629-1695 • Diffraction • Refraction • Interference
  • 12.
    sin(i)/sin(r) = λi/λr = f λi/f λr =vi/vr REFRACTION PHENOMENONDIFFRACTION PHENOMENON
  • 13.
    YOUNG TWO- SLITINTERFERENCE PATTERN
  • 14.
  • 15.
    DRAWBACK OF WAVETHEORY OF LIGHT • Couldn't justify the PHOTOELECTRIC EFFECT
  • 16.
    QUANTUM THEORY OFLIGHT Max Planck 1858-1947 Wave-Particle Duality of Light • Quantum theory tells us that both light and matter consists of tiny particles which have wavelike properties associated with them. • Light is composed of particles called photons, and matter is composed of particles called electrons, protons, neutrons. • It's only when the mass of a particle gets small enough that its wavelike properties show up.
  • 17.
    Trillion Frames perSecond Femto-Photography Light in Motion
  • 18.
  • 19.
    Trillion FPS ToF STREAKCAMERA = Inverse of CRO 1D camera: Single scan line stretched vertically in time ~2 ps resolution But for small samples in biochemistry Very accurate sync
  • 20.
  • 22.
    Steady State 4D ImpulseResponse, 5D [Raskar and Davis, 2007] [Kajiya, 1986] [Seitz.., 2005]
  • 23.
    Inverting Light Transport MultipleScattering Direct/Global Dual Photography [Seitz , Kutulakos, Matsushita 2005] [Nayar, Raskar et al 2006] [Sen et al 2005] LIDAR [Atcheson et al 2008] [Kutulakos, Steger 2005]
  • 27.
    dc a b e z x y Intensity (Arb.U.) Backprojected Intensity (Arb. U.) Confidence (Arb. U.)
  • 30.
  • 31.
    Collision avoidance, robotnavigation, …
  • 32.
  • 33.
  • 34.
  • 36.
    Sub - surfacescattering in fruit implies that it is ripe.
  • 37.
    ADVANTAGES • High speedimaging. • Capturing pictures around corners. • Can see objects beyond the line of sight. DISADVANTAGES •Total recording time lengthens to approximately one hour. •Expensive setup. •Blurring in the data along the scanned dimension.
  • 38.
    CONLUSION We should stopobsessing about the Megapixels in cameras and start focusing on next dimension in imaging... “Its about Time”.
  • 39.
     Femto-Photography: Capturingand Visualizing the Propagation of Light, Ramesh Raskar, MIT Media Lab.  NAIK,N.,ZHAO,S.,VELTEN,A.,RASKAR,R.,ANDBALA, K.2011.Single view reflectance capture using multiplexed scattering and time-of-flight imaging. ACMTrans.Graph.30,6, 171:1–171:10.  CAMPILLO,A.,ANDSHAPIRO,S.1987.Pico-second streak camera fluorometry : are view. IEEE Journal of Quantum Electronics 19,4,585–603.  www.wikipedia.org  web.media.mit.edu/~raskar/cornar/  web.media.mit.edu/~raskar//trillionfps/
  • 40.
  • 41.