Our SIGGRAPH '96 Paper & Video


Overview

Our paper was accepted in the SIGGRAPH '96 Technical Program. The title is: Reconstructing Curved Surfaces From Specular Reflection Patterns Using Spline Surface Fitting of Normals

(Adobe Acrobat Reader) Abstract | Paper (1.1Mb Acrobat file)


The Video (big)

(1996 Siggraph Paper OPTICAL Visualization big video)
18Mb 320x240 10fps (22KHz Audio)

The Video (small)

(1996 Siggraph Paper video OPTICAL Visualization small video)
4.7Mb 160x120 5fps (11KHz Audio)

The Storyboard

(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 00 called Title) (Title Screen)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 01 called Neha) At the University of California at Berkeley, the OPTICAL project is a multidisciplinary effort in the Computer Science Division and School of Optometry.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 02 called Acronym) "OPTICAL" is an acronym for "OPtics and Topography Involving the Cornea And Lens". This project is concerned with the computer-aided measurement, modeling, reconstruction, and visualization of the shape of the human cornea, called corneal topography.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 03 called NehasEye) The cornea is the transparent tissue covering the front of the eye.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 04 called LabeledCornea) It performs 3/4 of the refraction, or bending, of light in the eye, and focuses light towards the lens and the retina. Thus, subtle variations in the shape of the cornea can significantly diminish visual performance.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 05 called ContactLenses) Eye care practitioners need to know the shape of a patient's cornea to fit contact lenses,
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 06 called Surgery) to plan and evaluate the results of surgeries that improve vision by altering the shape of the cornea,
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 07 called Keratoconus) and to diagnose keratoconus, an eye condition where the cornea has an irregular shape with a local protrusion, or "cone", which has dramatic effects on vision.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 08 called ThreeReasons) (Summarized reasons why eye clinicians need to know the shape of patients' corneas)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 09 called BrianWheeledUp) Recently, instruments to measure corneal topography have become commercially available. These devices, called videokeratographs,
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 10 called Measurement) typically shine rings of light onto the cornea
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 11 called Videokeratograph) and then capture the reflection pattern
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 12 called VKCloseUp) with a built-in video camera.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 13 called Animation00) Our task
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 14 called Animation01) is to construct
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 15 called Animation02) a model of the cornea
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 16 called Animation03) from this image and from the geometry of the videokeratograph's source pattern. For purposes of illustration, we have shrunk the source pattern to a fraction of its normal size here.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 17 called Animation04) We will use a simplified source pattern to illustrate the algorithm more easily.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 18 called Animation05) We begin our construction by guessing
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 19 called Animation06) a possible surface shape.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 20 called Animation07) (We rotate the camera to convey the 3-dimensional nature of the scene and to end up looking toward the right side of the scene)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 21 called Animation08) Then we measure
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 22 called Animation09) the difference between
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 23 called Animation10) the surface that we have guessed
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 24 called Animation11) and the real cornea.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 25 called Animation12) First we identify features in the image
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 26 called Animation13) (In the video, the red dot on the left blinks to indicate it's one of the features we were talking about)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 27 called Animation14) and their corresponding points in the source pattern. (The corresponding red point blinks too)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 28 called Animation15) (The corresponding green points blink)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 29 called Animation16) (The corresponding blue points blink)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 30 called Animation17) (Now we rotate the camera back so that we end up looking at the scene straight on, as in the beginning)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 31 called Animation18) If we assume that the lens system can be modeled by
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 32 called Animation19) a pinhole or nodal point, we can simulate the process that formed the image by using backward ray tracing.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 33 called Animation20) A ray from an image feature
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 34 called Animation21) is traced through the nodal point
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 35 called Animation22) to the surface.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 36 called Animation23) If the surface that we guessed has the correct local shape,
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 37 called Animation24) the ray will intersect the source pattern
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 38 called Animation25) at the corresponding feature.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 39 called Animation26) More commonly,
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 40 called Animation27) the surface is incorrect, (the surface changes shape to represent an incorrect guess)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 41 called Animation28) so the ray
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 42 called Animation29) misses the feature. (Doh!) The aim is to change the surface so that the ray intersects the correct location. However, we must change the shape of the surface globally, otherwise
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 43 called Animation30) rays from other features
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 44 called Animation31) will still
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 45 called Animation32) miss
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 46 called Animation33) their
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 47 called Animation34) corresponding
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 48 called Animation35) features. (Doh!)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 49 called Animation36) The appropriate global change is computed using constrained optimization.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 50 called Animation37) From the traced rays we formulate an error function that measures the difference between the guessed surface and the true cornea.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 51 called Animation38) The surface that minimizes this error funtion has a simular shape to the true cornea.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 52 called Animation39) In order to make the problem more easily solved, we constrain the surface to interpolate one or more points.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 53 called Animation40) These constraints and the error function define
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 54 called Animation41) a standard constrained minimization problem.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 55 called Animation42) We solve this problem iteratively, by taking an initial guess,
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 56 called Animation43) and stepping toward the solution. (The rays are animated as they move toward the solution)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 57 called Animation44) We have carefully formulated the error function and chosen a surface representation so that each step can be performed efficiently.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 58 called Animation45) Each iteration requires
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 59 called Animation46) tracing
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 60 called Animation47) rays,
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 61 called Animation48) computing
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 62 called Animation49) a set of normals,
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 63 called Animation50) and fitting a new surface (the surface changes shape to indicate the fitting is taking place)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 64 called Animation51) to the normals.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 65 called Animation52) In our case, we can fit the normals by solving a linear system. (Rays trace back to source pattern to indicate the new surface is correct)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 66 called Credits0) Roll Credits.
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 67 called Credits1)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 68 called Credits2)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 69 called Credits3)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 70 called Credits4)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 71 called Credits5)
(1996 SIGGRAPH Paper Video OPTICAL Visualization Scene 72 called Credits6)


Copyright © 1998 OPTICAL Research Project. All rights reserved.
WWW Maven: Dan Garcia (ddgarcia@cs.berkeley.edu) Send me feedback

Made With Macintosh OPTICAL