Modelling and Simulation of Neuromorphic Datasets for Anomaly Detection in Computer Vision
Authors: Mike Middleton, Teymoor Ali, Hakan Kayan, Basabdatta Sen Bhattacharya, Charith Perera, Oliver Rhodes, Elena Gheorghiu, Mark Vousden, Martin A. Trefzer
Organizations: Bio-Inspired Systems and Technologies Lab, University of York, York, UK · Faculty of Natural Sciences, University of Stirling, Stirling, UK · School of Computer Science and Informatics, Cardiff University, Cardiff, UK · School of Electrical and Electronic Engineering, University of Manchester, Manchester, UK · Electronics and Computer Science, University of Southampton, Southampton, UK
Limitations on the availability of Dynamic Vision Sensors (DVS) present a fundamental challenge to researchers of neuromorphic computer vision applications. In response, datasets have been created by the research community, but often contain a limited number of samples or scenarios. To address the lack of a comprehensive simulator of neuromorphic vision datasets, we introduce the Anomalous Neuromorphic Tool for Shapes (ANTShapes), a novel dataset simulation framework. Built in the Unity engine, ANTShapes simulates abstract, configurable 3D scenes populated by objects displaying randomly-generated behaviours describing attributes such as motion and rotation. The sampling of object behaviours, and the labelling of anomalously-acting objects, is a statistical process following central limit theorem principles. Datasets containing an arbitrary number of samples can be created and exported from ANTShapes, along with accompanying label and frame data, through the adjustment of a limited number of parameters within the software. ANTShapes addresses the limitations of data availability to researchers of event-based computer vision by allowing for the simulation of bespoke datasets to suit purposes including object recognition and localisation alongside anomaly detection.
Figures & tables
Fig. 1: A screenshot of ANTShapes. The colour of an object indicates its P-value and the likelihood of its existence in the scene by extension. Blue objects occur relatively frequently, with greener objects being increasingly rarer. Agents that cross the threshold into anomalies are coloured red. Here, anomalies are defined based on position.
Fig. 2: Event representation of the scene in Figure 1 . Anomalies are defined on the distance of agents from the center of the scene, which are are masked in red. Each agent is rotating by an equal value on all three axes which produces spiking events.
Fig. 3: Frame- and event-views from two different temporal moments within a complex scene populated by many shapes with randomised behaviours. Anomalies were defined as fast-moving objects to produce this example.
International Centre for Neuromorphic Systems (ICNS) Western Sydney University Sydney, Australia · International Centre for Neuromorphic Systems (ICNS) The University of Manchester Manchester, United Kingdom