NDLI: Recognize Human Activities from Partially Observed Videos

Content Provider	IEEE Xplore Digital Library
Author	Yu Cao Barrett, D. Barbu, A. Narayanaswamy, S. Haonan Yu Michaux, A. Yuewei Lin Dickinson, S. Siskind, J.M. Song Wang
Copyright Year	2013
Description	Author affiliation: Dept. of Comput. Sci., Univ. of Toronto, Toronto, ON, Canada (Dickinson, S.) \|\| Dept. of Comput. Sci. & Eng., Univ. of South Carolina, Columbia, SC, USA (Yu Cao; Yuewei Lin; Song Wang) \|\| Sch. of Electr. & Comput. Eng., Purdue Univ., West Lafayette, IN, USA (Barrett, D.; Barbu, A.; Narayanaswamy, S.; Haonan Yu; Michaux, A.; Siskind, J.M.)
Abstract	Recognizing human activities in partially observed videos is a challenging problem and has many practical applications. When the unobserved subsequence is at the end of the video, the problem is reduced to activity prediction from unfinished activity streaming, which has been studied by many researchers. However, in the general case, an unobserved subsequence may occur at any time by yielding a temporal gap in the video. In this paper, we propose a new method that can recognize human activities from partially observed videos in the general case. Specifically, we formulate the problem into a probabilistic framework: 1) dividing each activity into multiple ordered temporal segments, 2) using spatiotemporal features of the training video samples in each segment as bases and applying sparse coding (SC) to derive the activity likelihood of the test video sample at each segment, and 3) finally combining the likelihood at each segment to achieve a global posterior for the activities. We further extend the proposed method to include more bases that correspond to a mixture of segments with different temporal lengths (MSSC), which can better represent the activities with large intra-class variations. We evaluate the proposed methods (SC and MSSC) on various real videos. We also evaluate the proposed methods on two special cases: 1) activity prediction where the unobserved subsequence is at the end of the video, and 2) human activity recognition on fully observed videos. Experimental results show that the proposed methods outperform existing state-of-the-art comparison methods.
Starting Page	2658
Ending Page	2665
File Size	554935
Page Count	8
File Format	PDF
ISBN	9780769549897
ISSN	10636919
DOI	10.1109/CVPR.2013.343
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-06-23
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Videos Training Encoding Feature extraction Spatiotemporal phenomena Vectors Educational institutions
Content Type	Text
Resource Type	Article
Subject	Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Learning spatiotemporal graphs of human activities

Action Recognition with Actons

Motionlets: Mid-level 3D Parts for Human Motion Recognition

A chains model for localizing participants of group activities in videos

Recognizing realistic actions from videos “in the wild”

Modeling human activities as speech

Quasi Real-Time Summarization for Consumer Videos

Multimodal feature fusion for robust event detection in web videos

In defense of soft-assignment coding

Recognize Human Activities from Partially Observed Videos

Similar Documents

Learning spatiotemporal graphs of human activities

Action Recognition with Actons

Motionlets: Mid-level 3D Parts for Human Motion Recognition

A chains model for localizing participants of group activities in videos

Recognizing realistic actions from videos “in the wild”

Modeling human activities as speech

Quasi Real-Time Summarization for Consumer Videos

Multimodal feature fusion for robust event detection in web videos

In defense of soft-assignment coding

Recognize Human Activities from Partially Observed Videos