Final Flashcards
Challenges to Trackin
1) Many Places its hard to compute optical flow
2) There can be large displacements since it could be moving rapidly. You need to take the dynamics into account.
3) Errors would compound or drift
4) Occlusions, dis-occlusions
Shi Tomasi Feature Tracker
Only compute motion where you should.
1) From frame to frame, track with lucas kanade and pure translation model
2) For each of the points you have tracked, is there an affine model to represent this translation
Tracking with Dynamics
This is used if the displacements are large because there is fast movement. Given a model of expected motion, preditucs where the object will occur in the next frame, even before seeing the image.
restricuts search of the object
imrpved estimates
Detection vs. Tracking
the incormproiation of dynamics is the differece between tracking and just detection. The detection is independent each time. Tracking we predice with estiamted dynamics and then update based on upon measurements.
Assumptions in Tracking
Continous Models of motion Paramenter
Objects do not appear and disappear instantly
Camera is not moving instantly
Gradual change in pose between scene and object
Prediction
What is the next state of the object given past measurements
Correction
Compute an update destiamte of the state from preduction and new measurments
Tracking
The process of propagation this posterior distribution of state given measurements across time
Tracking Simplyfying Assumptions
Only the Immediate Past maters
Measurements depend only on the current state
Tracking as Induction
Base Case:
Assume an initial prior tha tpredicts in the absense of any evidence
At the first frame tak ea mesurment and correct a predocution
Preditct for frame t + 1
Correct for frame t + 1
Prediction
Given t-1 information, then make a guess of t
Correction
now predict again with the yt using again. This ues Bayes rule P(A|B) = P(B|A)P(A)/P(B)
Kalman Filter
Linear Dynamics Models in gaussian noise
State densities are gaussian
Partical Filterting
Relies on non gaussian distributions
Perturbation
This is equivalent to the dynamics model
Known ways the world should change that are modeled by the filter