Report 1: Optical Flow and Sift

Billy Timlen

(u,v) = inv(AtA)*At*Ft

Analyze the pixels around the point of interest

Works for slow motion and small areas
◦ Derived from fx*u +fy*v = -ft (after taking the partial
derivative in terms of each variable x,y,t
◦ Requires a degree of padding

Reduces the original image into different
levels
◦ Impyramid(image, ‘reduce’)

Computes Optical flow for each level
◦ Shifts derivative mask by u and v of prior level


Add the optical flows of each level
Should record more detailed results of
motion



Input: 18x18 patch, keypoint and orientation
angle
Outputs a descriptor
◦ Histogram of orientation magnitudes
Results vary according to the Gaussian used (for
smoothing) and the sigma used (which affects
the Gaussian)

Work with different types of masks

Use different forms of interpolation
◦ MatLab has their own function

Use another form of rounding the noninteger indices from u and v
◦ Gonzalo sent us a bilinear function to look at


Optimal Algorithms for Topologically
Constrained Correspondence
Bayesian Formulation for Event Recounting
given Event Label

3D Joint Localization for Gesture Recognition

GPS-Tag Refinement