Automated Surveillance from a Mobile Robot

In this paper, we propose to augment an existing video surveillance system with a mobile robot. This robot acts as a collaborator with a human who together monitor an environment to both look for objects that are out of the ordinary as well as to to describe people found near these objects. To find anomalies, our robot must first build a dictionary describing the things that are normally seen while navigating through each environment. We use a computational cognitive model, ACT-R/E to learn which dictionary elements are normal for each environment. Finally, the robot makes note of people seen in the environment and builds a human understandable description of each individual. When an anomaly is seen, the robot can then report people recently seen, as they may be potential witnesses or people of interest. Our system operates in real-time, and we demonstrate operation on several examples.