IBM Smart Surveillance Research Publications



2013

Spatio-Temporal Fisher Vector Coding for Surveillance Event Detection
Qiang Chen, Yang Cai, Lisa Brown, Ankur Datta, Quanfu Fan, Rogerio Feris, Shuicheng Yan, Alex Hauptmann, Sharathchandra Pankanti
ACM Multimedia, 2013

Relative Attributes For Large-scale Abandoned Object Detection
Quanfu Fan; Prasad Gabbur ; Sharath Pankanti
International Conference on Computer Vision (ICCV), 2013

Retail video analytics: an overview and survey
Jonathan Connell, Quanfu Fan, Prasad Gabbur, Norman Haas, Sharath Pankanti, Hoang Trinh
IS\&T/SPIE Electronic Imaging, 2013

Fast Face Detector Training Using Tailored Views
Kristina Scherbaum, Rogerio Feris, James Petterson, Volker Blanz
IEEE International Conference on Computer Vision (ICCV), 2013

Hierarchical Feature Pooling with Structure Learning: A new method for Pedestrian Detection
Xiaoyu Wang, Liangliang Cao, Rogerio Feris, Ankur Data, Tony X. Han
CVPR Workshop on Structured Prediction: Tractability, Learning, and Inference, 2013

Boosting object detection performance in crowded surveillance videos
Rogerio Feris, Ankur Datta, Sharath Pankanti, Ming-Ting Sun
Workshop on Applications of Computer Vision (WACV), pp. 427--432, 2013

Domain adaptive object detection
Fatemeh Mirrashed, Vlad I Morariu, Behjat Siddiquie, Rogerio S Feris, Larry S Davis
Workshop on Applications of Computer Vision (WACV), pp. 323--330, 2013

Video Surveillance: Past, Present, and Now the Future [DSP Forum]
Fatih Porikli, Fran\c{c}ois Br\'emond, Shiloh L Dockstader, James Ferryman, Anthony Hoogs, Brian C Lovell, Sharath Pankanti, Bernhard Rinner, Peter Tu, P\'eter L Venetianer
Signal Processing Magazine, IEEE 30(3), 190--198, IEEE, 2013

Efficient Maximum Appearance Search for Large-Scale Object Detection
Qiang Chen, Zheng Song, Rogerio Feris, Ankur Datta, Liangliang Cao, Zhongyang Huang, Shuicheng Yan
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013


2012

Multimodal Ranking for Non-Compliance Detection in Retail Surveillance
Hoang Trinh, Sharath Pankanti, Quanfu Fan
IEEE Workshop on the Applications of Computer Vision, 2012

Large-Scale Vehicle Detection, Indexing, and Search in Urban Surveillance Videos
Rogerio Feris, Behjat Siddiquie, James Petterson, Yun Zhai, Ankur Datta, Lisa Brown, Sharath Pankanti
IEEE Transactions on Multimedia, 14(99), 2012

Learning Detectors from Large Datasets for Object Retrieval in Video Surveillance
Rogerio Feris, Sharath Pankanti, Behjat Siddiquie
Multimedia and Expo (ICME), 2012 IEEE International Conference on, pp. 284--289

Robust Foreground and Abandonment Analysis for Large-scale Abandoned Object Detection in City Surveillance
Q. Fan, S. Pankanti
Advanced Video and Signal-Based Surveillance (AVSS), 2012 9th IEEE International Conference on, 2012

Appearance Modeling for Person Re-identification using Weighted Brightness Transfer Functions
Ankur Datta, Lisa M Brown, Rogerio Feris, Sharathchandra Pankanti
21st International Conference on Pattern Recognition (ICPR), November, pp. 2367--2370, 2012

Robust Foreground and Abandonment Analysis For Large-scale Abandoned Object Detection in Complex Surveillance Videos
Quanfu Fan, Sharath Pankanti
Advanced Video and Signal-Based Surveillance (AVSS), 2012 IEEE Ninth International Conference on, pp. 58--63

Hand tracking by binary quadratic programming and its application to retail activity recognition
Hoang Trinh, Quanfu Fan, Prasad Gabbur, Sharath Pankanti
Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pp. 1902--1909

CMU-IBM-NUS@ TRECVID 2012: Surveillance Event Detection
Yang Cai, Qiang Chen, Lisa Brown, Ankur Datta, Quanfu Fan, Rogerio Feris, Shuicheng Yan, Alex Hauptmann, Sharath Pankanti
NIST Technical Report, 2012

Unsupervised model selection for view-invariant object detection in surveillance environments
Behjat Siddiquie, Rogerio S Feris, Ankur Datta, Larry S Davis
Pattern Recognition (ICPR), 2012 21st International Conference on, pp. 3252--3255

Efficient UAV video event summarization
Hoang Trinh, Jun Li, Sachiko Miyazawa, Juan Moreno, Sharath Pankanti
Pattern Recognition (ICPR), 2012 21st International Conference on, pp. 2226--2229

Exploiting Color Strength to Improve Color Correction
Lisa Brown, Ankur Datta, Sharathchandra Pankanti
IEEE International Symposium on Multimedia (ISM), Irvine, California, December, pp. 179--182, 2012


2011

Automatic Video Activity Recognition
H Liu, M T Sun, R Feris
Multimedia Analysis, Processing and Communications, 327--349, Springer, 2011

Parsing Object Events in Heavy Urban Traffic
Yun Zhai, Rogerio Feris, Arun Hampapur, Stephen Russo, Sharath Pankanti
Object Tracking, Intech, 2011

Benchmarking Datasets for Human Activity Recognition
H Liu, R Feris, M T Sun
Visual Analysis of Humans, 411--427, Springer, 2011

Image ranking and retrieval based on multi-attribute queries
B Siddiquie, R S Feris, L S Davis
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011 , pp. 801--808

Attribute-based vehicle search in crowded surveillance videos
Rogerio Feris, Behjat Siddiquie, Yun Zhai, James Petterson, Lisa Brown, Sharath Pankanti
Proceedings of the 1st ACM International Conference on Multimedia Retrieval, pp. 18, 2011

Detecting human activities in retail surveillance using hierarchical finite state machine
Hoang Trinh, Quanfu Fan, Jiyan Pan, Prasad Gabbur, Sachiko Miyazawa, Sharath Pankanti
Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on, pp. 1337--1340, ICASSP

Practical computer vision: example techniques and challenges
S Pankanti, L Brown, J Connell, A Datta, Q Fan, R Feris, N Haas, Y Li, N Ratha, H Trinh
IBM Journal of Research and Development 55(5), 2011

Soft margin keyframe comparison: Enhancing precision of fraud detection in retail surveillance
Jiyan Pan, Quanfu Fan, Sharath Pankanti, Hoang Trinh, Prasad Gabbur, Sachiko Miyazawa
Applications of Computer Vision (WACV), 2011 IEEE Workshop on, pp. 549--556, WACV

Large-scale vehicle detection in challenging urban surveillance environments
Rogerio Feris, James Petterson, Behjat Siddiquie, Lisa Brown, Sharath Pankanti
IEEE Workshop on Applications of Computer Vision (WACV), pp. 527--533, 2011

Modeling of temporarily static objects for robust abandoned object detection in urban surveillance
Quanfu Fan, Sharath Pankanti
Advanced Video and Signal-Based Surveillance (AVSS), 2011 8th IEEE International Conference on, pp. 36--41


2010

Robust detection of abandoned and removed objects in complex surveillance videos
Y L Tian, R Feris, H Liu, A Hampapur, M Sun
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, pp. 99, 1--12, IEEE, 2010

Robust symbolic dual-view facial expression recognition with skin wrinkles: local versus global approach
Yizhen Huang, Ying Li and Na Fan
IEEE Transactions on Multimedia 12(6), 536-543, 2010

A fast connected components labeling algorithm and its application to real-time pupil detection
Prasad Gabbur, Hong Hua, Kobus Barnard
Machine Vision and Applications 21(5), 779-787, Springer, 2010

Detection of user-defined, semantically high-level, composite events, and retrieval of event queries
S. Velipasalar, L.M. Brown, A. Hampapur
Journal of Multimedia Tools and Applications 50(1), 249--278, Springer, 2010

Unsupervised Action Classification Using Space-Time Link Analysis
L Haowei, F Rogerio, K Volker, S Ming-Ting
EURASIP Journal on Image and Video Processing2010, 2, Hindawi Publishing Corporation

Example-Based Color Vehicle Retrieval for Surveillance
L M Brown
In Proceedings of the Multimedia Systems for Surveillance (MMSS) Workshop at the 7th IEEE International Conference on Advanced Video and Signal- Based Surveillance (AVSS), pp. 91--96, 2010


2009

Dynamic seethroughs: Synthesizing hidden views of moving objects
P Barnum, Y Sheikh, A Datta, T Kanade
Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality, pp. 111--114

Case Study: IBM Smart Surveillance System
R Feris, A Hampapur, Y Zhai, R Bobbitt, L Brown, D A Vaquero, Y Tian, H Liu, M T Sun
Intelligent Video Surveillance: System and Technology, by Taylor & Francis Group, LLC, 2009

Video Analytics in Urban Environments
Hampapur A et al.
In Proceedings of the 2009 Sixth IEEE Int'l Conference on Advanced Video and Signal Based Surveillance, pp. 128--133

Attribute-Based People Search in Surveillance Environments
D. Vaquero, R. Feris, D. Tran, L. Brown, A. Hampapur and M. Turk
In Proceedings of the IEEE Workshop on Applications in Computer Vision (WACV), pp. 1--8, 2009

Shape classification through structured learning of matching measures
L Chen, J J McAuley, R S Feris, T S Caetano, M Turk
Computer Vision and Pattern Recognition (CVPR 2009), pp. 365--372, IEEE

Multi-Scale People Detection and Motion Analysis for Video Surveillance
Tian Y-L et al.
Machine Learning for Human Motion Analysis: Theory and Practise, CRC Press, 2009

Multi-media compliance: A practical paradigm for managing business integrity
S Pankanti, Q Fan, Y Zhai, R Bobbitt, A Yanagawa, S Miyazawa, R Kjeldsen, A Hampapur
Multimedia and Expo, 2009. ICME 2009. IEEE International Conference on, pp. 1562--1563

Recognition of repetitive sequential human activity
Quanfu Fan, Russell Bobbitt, Yun Zhai, Akira Yanagawa, Sharath Pankanti, Arun Hampapur
Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pp. 943--950

Detecting sweethearting in retail surveillance videos
Quanfu Fan, Akira Yanagawa, Russell Bobbitt, Yun Zhai, Rick Kjeldsen, Sharath Pankanti, Arun Hampapur
Acoustics, Speech and Signal Processing, 2009. ICASSP 2009. IEEE International Conference on, pp. 1449--1452

Event detection, query, and retrieval for video surveillance
YL Tian, A Hampapur, L Brown, R Feris, M Lu, A Senior, CF Shu, Y Zhai
Information Science Reference, 2009


2008

Intelligent surveillance system and method for integrated event based surveillance
C F Shu, A Hampapur, Z Lu, Y L Tian, L M Brown, A W Senior
US Patent App. 12/132,872

Vehicle-use visual field assistance system in which information dispatch apparatus transmits images of blind spots to vehicles
H Sakai, Y Tamatsu, A Datta, Y Sheikh, T Kanade
US Patent App. 12/283,422

Efficient partial shape matching using Smith-Waterman algorithm
L Chen, R Feris, M Turk
Computer Vision and Pattern Recognition Workshops, 2008, pp. 1--6
US Patent App. 12/017,511

On the sustained tracking of human motion
Y A Sheikh, A Datta, T Kanade
8th IEEE International Conference on Automatic Face and Gesture Recognition, 2008

Event Detection, query and retrieval for video surveillance
Tian Y-L et al.
Artificial Intelligence for Maximizing Content Based Image Retrieval, Information Science Reference, 2008

Composite Event Detection in Multi-Camera and Multi-Sensor Surveillance Networks
Y. Zhai, et al.
Multi-Camera Networks: Concepts & Applications, pp. 457, Elsevier, 2008

An Integrated System for Moving Object Classification in Surveillance Videos
Chen L et al.
In Proceedings of the IEEE Int'l Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 52--59, 2008

Facial Image Analysis Using Local Feature Adaptation Prior to Learning
R Feris, Y Tian, Y Zhai, A Hampapur
IEEE International Conference on Automatic Face and Gesture Recognition, pp. 1--6, 2008

Real-Time Detection of Abandoned and Removed Objects in Complex Environments
Y Tian, R Feris, A Hampapur
IEEE International Workshop on Visual Surveillance (in conjunction with ECCV'08), 2008

Color Retrieval for Video Surveillance
L M Brown
IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance, pp. 283--290, 2008


2007

Video analytics for retail
AW Senior, L Brown, A Hampapur, C F Shu, Y Zhai, RS Feris, Y L Tian, S Borger, C Carlson
Advanced Video and Signal Based Surveillance, 2007, pp. 423--428

Searching surveillance video
A Hampapur, L Brown, R Feris, A Senior, C F Shu, Y Tian, Y Zhai, M Lu
Advanced Video and Signal Based Surveillance, 2007, pp. 75--80

Capturing people in surveillance video
R Feris, Y L Tian, A Hampapur
Visual Surveillance, pp. 1--8, 2007


2006

Specifying, interpreting and detecting high-level, spatio-temporal composite events in single and multi-camera systems
S Velipasalar, L M Brown, A Hampapur
Computer Vision and Pattern Recognition Workshop, 2006, pp. 110--110

Wavelet Subspace Method for Real-Time Face Tracking
V Kriiger, RS Feris
Pattern Recognition: 23rd DAGM Symposium, Munich, Germany, …, 2006 - books.google.com


2005

Distributed active multicamera networks
Andrew Senior, Arun Hampapur, Lisa Brown, YL Tian, CF Shu, S Pankanti
Ambient Intelligence, 89--105, Springer, 2005

Face verification in polar frequency domain: a biologically motivated approach
Y Zana, R Cesar-Jr, R Feris, M Turk
Advances in Visual Computing, 183--190, Springer, 2005

Improving performance via post track analysis
L M Brown, M Lu, C F Shu, Y Tian, A Hampapur
Visual Surveillance and Performance Evaluation of Tracking and Surveillance, 2005, pp. 341--347

Performance evaluation of surveillance systems under varying conditions
L M Brown, A W Senior, Y Tian, J Connell, A Hampapur, C F Shu, H Merkl, M Lu
IEEE Int'l Workshop on Performance Evaluation of Tracking and Surveillance, Colorado, pp. 1--8, 2005


2004

Manifold based analysis of facial expression
C Hu, Y Chang, R Feris, M Turk
Computer Vision and Pattern Recognition Workshop, pp. 81--81, 2004

A wavelet subspace method for real-time face tracking
R S Feris, V Krueger, R M Cesar, others
Real-Time Imaging 10(6), 339--350, Elsevier, 2004

View independent vehicle/person classification
L M Brown
Proceedings of the ACM 2nd international workshop on Video surveillance & sensor networks, pp. 114--123, 2004


2003

Real-time view-based face alignment using active wavelet networks
C Hu, R Feris, M Turk
Analysis and Modeling of Faces and Gestures, 2003, pp. 215--221, Published by the IEEE Computer Society

Active wavelet networks for face alignment
C Hu, R Feris, M Turk
British Machine Vision Conference, 2003


2002

Hierarchical wavelet networks for facial feature localization
R S Feris, J Gemmell, K Toyama, V Kruger
Automatic Face and Gesture Recognition, 2002, pp. 118--123

TLA based face tracking
M Turk, C Hu, R Feris, F Lashkari, A Beall
Proc, pp. 229--235, 2002

Facial feature detection using a hierarchical wavelet face database
R S Feris, J Gemmell, K Toyama, V Kr{"u}ger
University of Maryland, Citeseer, 2002

Comparative study of coarse head pose estimation
L M Brown, Y L Tran
Motion and Video Computing, 2002, pp. 125--130, Published by the IEEE Computer Society


2001

Locating and tracking facial landmarks using Gabor wavelet networks
R Feris, R Cesar
Advances in Pattern Recognition—ICAPR 2001, 313--322, Springer

Efficient real-time face tracking in wavelet subspace
R S Feris, R M Cesar Jr, V Kruger
Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, 2001, pp. 113--118

Wavelet subspace method for real-time face tracking
V Kruger and R. Feris
Pattern Recognition: 23rd DAGM Symposium, Munich, Germany, September 12-14, 2001, pp. 186--193, Springer

3D head tracking using motion adaptive texture-mapping
L M Brown
Computer Vision and Pattern Recognition, 2001, pp. 998-1003, Published by the IEEE Computer Society


2000


A framework for face recognition from video sequences using gwn and eigenfeature selection
T E Campos de, R S Feris, R M C Junior
Workshop on Artificial Intelligence and Computer Vision, pp. 141--145, 2000

Eigenfaces versus eigeneyes: First steps toward performance assessment of representations for face recognition
T Campos de, R Schmidt Feris, R Marcondes
MICAI 2000: Advances in Artificial Intelligence1793, 193--201, Springer

Tracking facial features using Gabor wavelet networks
R S Feris, RM Cesar Jr
Computer Graphics and Image Processing, 2000, pp. 22--27

Detection and tracking of facial features in video sequences
R Schmidt Feris, T Campos de, R Marcondes
MICAI 2000: Advances in artificial intelligence: Mexican International Conference on Artificial Intelligence, Acapulco, Mexico, April 2000: proceedings, pp. 127--135, Springer