Identification and Tracking of Groups of People using Object Detection and Object Tracking Techniques

Abstract

Object detection is one of the most important areas in the fields of data science and computer vision. In this paper, we present a novel approach to identify and track groups of people, couples, and individuals in videos by using deep learning-based object detection and object tracking techniques along with a proposed grouping algorithm. The approach has applied transfer learning on YOLO v3 model for detection of people in video frames and applied Deep SORT for tracking each detected person throughout the video. Results obtained from person detection and person tracking were used by the proposed grouping algorithm to identify and track groups, couples, and individuals who are appearing in input videos. Our proposed grouping algorithm is based on the proximity between each individual and the time duration that proximity is maintained for. It also considers how to identify and track groups, if people are moving within the groups. This approach was evaluated using CCTV videos captured from the restaurant domain and it enabled to perform the group detection and tracking tasks successfully.