Motion analysis in CCTV records

Filip Mazan

This project deals with analysis of video captures from CCTVs to detect people’s motion and extract their trajectories in time. The output of this project is a relatively short video file containing only frames of the original where the movement was detected along with shown trajectories of people. The second output consists of cumulative image of all trajectories. This can be later used to classify trajectories as (not) suspicious.

1. Each frame of input video is converted into grayscale and median filtered to remove noise
2. First 30 seconds of video is used as a learning phase for MOG2 background subtractor
3. For each next frame the MOG2 mask is calculated and morphological closing is applied to it
4. If count of non-zero pixels is greater than a set threshold, we claim there is a movement present
   1. Good features to track are found if there is not many left
   2. Optical flow is calculated
   3. Each point which has moved is stored along with frame number
5. If there is no movement on current frame, postprocess last movement interval (if any)
   1. All stored tracking points (x, y, frame number) from previous phase are clusterized by k-means into variable number of centroids
      
   2. All centroids are sorted by their frame number dimension
   3. Trajectory is drawn onto the output frame
      
   4. Movement sequence is written into the output video file along with continuously drawn trajectory

Following image shows the sum of all trajectories found in 2 hours long input video. This can be used to classify trajectories as (not) suspicious.