Optical Flow and 3-D Motion



next up previous
Next: About this document Up: Motion Flow in Computer Previous: Generation of Optical

Optical Flow and 3-D Motion

Now we want to relate the motion of the camera frame to the optical flow pattern which it generates. For simplicity we will concentrate again only on a single point with 3-D coordinates . Assume that the camera moves with translational velocity and the angular velocity and the observed scene is stationary (see Figure 5). This is referred to as egomotion.

  
Figure 5: Showing the motion of the camera relative to a point.

By differentiating the equation for a projective transformation, we find that the optical flow of a point caused by the motion of the camera is:

where gives the coordinates of the scene point corresponding to the image at . This equation is complicated, but can be understood better for the case of pure translation, that is, , in which case the flow field becomes:

 

It is of interest to note that at the point . This point is called the focus of expansion. Using this, as the origin, that is defining , it follows that

 

The useful thing about this equation (3 is that it enables us to determine the time to impact with an object at a distance , away given by . You can imagine that this is important for navigation and also your well being.

Another use of motion flow is in rendering . Here you take multiple 2-D views of a fixed scene and use it to reconstruct the 3-D shape of the object. An example of this is given in Figure (6).

  
Figure 6: 3-D reconstruction of a house from four photographs taken from different locations (left) and the photograph of the house taken from the same location (right). Figure taken from Russell and Norvig, ``Artificial Intelligence - A Modern Approach, Prentice Hall, 1995, Figure 24.11, page 738

Fancier versions of this are due to Debevec, Taylor and Malik and are available here.



next up previous
Next: About this document Up: Motion Flow in Computer Previous: Generation of Optical



S Sastry
Sun May 5 23:42:22 PDT 1996