Nice piece of software if you ask me! 
It reminds me of my bachelor project. but of course id did not reach this advanced point.
For Learning, I got the help mainly from this article:
“Visual Learning and Recognition of 3D Objects from Appearance,”
H. Murase and S.K. Nayar,
International Journal on Computer Vision,
Vol.14, No.1, pp.5-24, Jan, 1995.
[url]Department of Computer Science, Columbia University
And for traking I used Kalman Filter.
Minority report or what!!!
That a awesome piece of software :o