DeltaVisionX: A Low-Cost Vision-Guided Automation System Using YOLOv11 and PLC-Based Actuation
Authors: Lara Sobh, Marc Nahhas, Francisco Katach El Halabi, Michel Owayjan, Fadi Elias Sleiman
Organizations: AUST · Faculty of Engineering and Computer Science, American University of Science & Technology, Beirut, Lebanon · AUST, IREENA, Nantes Univ · Institut de Recherche en Energie Electric de Nantes Atlantique (IREENA), Nantes University, Saint-Nazaire, France · Raymond Feghaly Co., Roumieh, Lebanon
This paper presents DeltaVisionX, a low-cost industrial automation system that integrates real-time computer vision with PLC-based actuation for object classification and sorting. The system uses the YOLOv11 (You Only Look Once) deep learning model to detect objects on an operating conveyor belt and communicates detection results to a Delta DVP-SE PLC, which actuates pneumatic pistons for sorting. A custom dataset was created, labeled, and augmented to train the YOLOv11 model, achieving a mean average precision of 0.97 with real-time inference of 100 ms per frame. Encoder-based tracking ensures reliable synchronization between detection and actuation, supporting a throughput of 80 objects per minute. Results show that affordable, locally developed automation can reduce labor dependency and improve manufacturing efficiency. The novelty of the proposed system lies in its encodersynchronized vision-PLC integration rather than in the detection model itself. Future work includes integrating a highspeed Delta robot with EtherCAT-based servo control for advanced pick-and-place operations.
Autonomous industrial inspection requires strictly deterministic real-time inference under tight memory and computational constraints. However, existing Video Instance Segmentation (VIS) models suffer from prohibitive scaling: dense temporal memory grows with spatial resolution and sequence length, while fixed-capacity decoders fail to exploit the inherent sparsity of industrial scenes, creating a practical memory wall on resource-constrained edge platforms. We present DetM-Tracker, a streamlined VIS framework for autonomous industrial inspection, where target objects often exhibit highly similar appearance under constrained "micro" fields of view. DetM-Tracker eliminates architectural redundancy through three synergistic components: (1) Compact Scalar Memory, which condenses high-dimensional instance features into four-scalar descriptors, reducing temporal memory complexity from O(T⋅N⋅R) to O(T⋅N^). This mechanism effectively compresses frame-level representations into a bank of active instances, where R denotes resolution, N and N^ represent global and window-specific instance counts, respectively and T the temporal window size; and (2) Dynamic Instance Channels, which adaptively allocate query capacity according to the actual number of visible objects; and (3) Entropy-Gated Skip Connection, which concentrates computational budget on high-uncertainty spatial regions to refine object boundaries in a single forward pass without auxiliary refinement heads. Our approach effectively bridges the gap between modern VIS models and the practical demands of industrial edge deployment, reducing inference latency by approximately 20× and VRAM consumption by 6× compared to state-of-the-art dense-feature baselines.
You-Rui Lin, Jen-Chieh Wu, Tzu-Ti Wei +2
College of Artificial Intelligence National Yang Ming Chiao Tung University · Department of Computer Science National Yang Ming Chiao Tung University
Conveyor belts are vital arteries in continuous bulk material handling, particularly in heavy process industries such as cement manufacturing. Undetected structural anomalies (longitudinal tears, holes, degraded patch repairs, and impact punctures) cause catastrophic belt snapping, costly downtime, and severe safety hazards. While deep learning offers high accuracy, existing models rely on power-hungry workstation GPUs, hindering practical deployment at remote industrial edge points. In this paper, we propose, implement, and validate an end-to-end, low-power edge AI vision system for real-time conveyor belt defect detection deployed on a Raspberry Pi 5 accelerated by a Google Coral Edge TPU coprocessor. The system leverages an optimized YOLOv11 nano (YOLOv11n) architecture trained on a multi-source industrial corpus exceeding 3,000 augmented samples from an operational cement plant in West Java, open-source datasets, and automated captures. The model undergoes post-training full integer quantization (INT8) compiled for systolic tensor execution. Experimental results demonstrate robust detection capability, achieving precision of 0.742, recall of 0.730, and [email protected] of 0.764 across four defect classes. Deployed on-site in an IP-rated enclosure interfaced with an RTSP PoE industrial camera, the system achieves stable throughput of 30-40 FPS at 320x320 resolution with an end-to-end latency of 70-90 ms. Operational profiling under harsh clinker dust confirms thermal equilibrium at 55 +/- 5 deg C on the host CPU and ~65 deg C on the Edge TPU with zero frame loss. This demonstrates that edge AI bridges the gap between high-accuracy computer vision and cost-effective predictive maintenance in continuous manufacturing.
Muhammad Nur Bijak Bestari, Mulki Indana Zulfa
Department of Electrical Engineering, Faculty of Engineering, Universitas Jenderal Soedirman, Purwokerto 53123, Central Java, Indonesia
Recent advancements in computer vision, driven by artificial intelligence, have significantly enhanced monitoring systems. One notable application is traffic monitoring, which leverages computer vision alongside deep learning-based object detection and counting. We present an offline, real-time traffic monitoring system that couples a pre-trained YOLOv11 detector with BoT-SORT/ByteTrack for multi-object tracking, implemented in PyTorch/OpenCV and wrapped in a Qt-based desktop UI. The CNN pipeline enables efficient vehicle detection and counting from video streams without cloud dependencies. Across diverse scenes, the system achieves (66.67-95.83%) counting accuracy. Class-wise detection yields high precision (cars: 0.97-1.00; trucks: 1.00) with strong recall (cars: 0.82-1.00; trucks: 0.70-1.00), resulting in F1 scores of (0.90-1.00 for cars and 0.82-1.00 for trucks). While adverse weather conditions may negatively impact this performance, results remain robust in typical conditions. By integrating lightweight models with an accessible, cloud-independent interface, this paper contributes to the modernization and development of future smart cities by showing the capacity of AI-driven traffic monitoring systems.
Shkelqim Sherifi
Dept. of Computer Science, University of Tetovo, Tetove, R.N.Macedonia