Arbitrary view action recognition via transfer dictionary learning on synthetic training data

Jingtian Zhang, Lining Zhang, Hubert P. H. Shum, Ling Shao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)
7 Downloads (Pure)


Human action recognition is an important problem in robotic vision. Traditional recognition algorithms usually require the knowledge of view angle, which is not always available in robotic applications such as active vision. In this paper, we propose a new framework to recognize actions with arbitrary views. A main feature of our algorithm is that view-invariance is learned from synthetic 2D and 3D training data using transfer dictionary learning. This guarantees the availability of training data, and removes the hassle of obtaining real world video in specific viewing angles. The result of the process is a dictionary that can project real world 2D video into a view-invariant sparse representation. This facilitates the training of a view-invariant classifier. Experimental results on the IXMAS and N-UCLA datasets show significant improvements over existing algorithms.
Original languageEnglish
Title of host publication2016 IEEE International Conference on Robotics and Automation (ICRA)
PublisherThe Institute of Electrical and Electronics Engineers (IEEE)
Publication statusPublished - 9 Jun 2016
Event2016 IEEE International Conference on Robotics and Automation (ICRA) -, Stockholm, Sweden
Duration: 16 May 201621 May 2016


Conference2016 IEEE International Conference on Robotics and Automation (ICRA)

Cite this