T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos: Paper and Code

Get our free extension to see links to code for papers anywhere online!Free add-on: code for papers everywhere!Free add-on: See code for papers anywhere!

Add to Chrome

Add to Firefox

Add to Edge

T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos

Aug 03, 2017
Kai Kang, Hongsheng Li, Junjie Yan, Xingyu Zeng, Bin Yang, Tong Xiao, Cong Zhang, Zhe Wang, Ruohui Wang, Xiaogang Wang, Wanli Ouyang

Figure 1 for T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos

Figure 2 for T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos

Figure 3 for T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos

Figure 4 for T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos

Share this with someone who'll enjoy it:

The state-of-the-art performance for object detection has been significantly improved over the past two years. Besides the introduction of powerful deep neural networks such as GoogleNet and VGG, novel object detection frameworks such as R-CNN and its successors, Fast R-CNN and Faster R-CNN, play an essential role in improving the state-of-the-art. Despite their effectiveness on still images, those frameworks are not specifically designed for object detection from videos. Temporal and contextual information of videos are not fully investigated and utilized. In this work, we propose a deep learning framework that incorporates temporal and contextual information from tubelets obtained in videos, which dramatically improves the baseline performance of existing still-image detection frameworks when they are applied to videos. It is called T-CNN, i.e. tubelets with convolutional neueral networks. The proposed framework won the recently introduced object-detection-from-video (VID) task with provided data in the ImageNet Large-Scale Visual Recognition Challenge 2015 (ILSVRC2015).

* ImageNet 2015 VID challenge tech report. The first two authors share co-first authorship. Accepted as a Transaction paper by T-CSVT Special Issue on Large Scale and Nonlinear Similarity Learning for Intelligent Video Analysis

View paper on

Share this with someone who'll enjoy it: