Beyond Exact Match: Task-Aware GRPO for Cross-Domain PCBA Visual Question Answering
Organizations: Hefei University of Technology Hefei, China · Hefei University of Technology Intelligent Interconnected Systems Laboratory of Anhui Province Hefei, China · Universiti Malaya Kuala Lumpur, Malaysia
Abstract
In automated Printed Circuit Board Assembly (PCBA) inspection, standards-guided decisions require systems to jointly reason over fine-grained visual cues, component semantics, and manufacturing knowledge. Although large vision-language models (VLMs) provide a promising foundation, their deployment is hindered by the domain shift between standards-derived samples and real-world production-line imagery, together with heterogeneous output spaces spanning choice-based and numerical counting tasks. To address these challenges, we propose a multimodal reasoning framework for cross-domain PCBA visual question answering. The framework converts standards-derived, real-world, and auxiliary PCB-domain data into a unified instruction format and constructs verified reasoning traces aligned with visual evidence, question semantics, candidate options, and ground-truth answers. We further introduce Task-Aware Group Relative Policy Optimization (GRPO), which moves beyond exact-match supervision by integrating multi-component semantic rewards for choice-based questions, distance-aware rewards for counting questions, and an auxiliary format reward for valid outputs. During inference, answer-option semantic consistency correction, self-consistency voting, and multi-model arbitration are combined to improve prediction robustness. The proposed system achieves an Overall Score of 83.24 on the official PCBA Standard-to-Real Grand Challenge leaderboard, demonstrating the effectiveness of task-aware reward design and robust inference for cross-domain PCBA visual question answering.
Figures & tables
| Rank | Submission | Overall | Attribute | Comp. Type | Count Comp. | Count Pin | Defect Exist. | Defect Type | Mount Side | Standard Know. |
| 1 | syds3sxhdjs | 83.82 | 100.00 | 95.08 | 98.96 | 99.55 | 81.25 | 85.25 | 87.50 | 66.00 |
| 2 | Ours | 83.24 | 100.00 | 90.16 | 98.87 | 98.11 | 82.47 | 84.43 | 87.50 | 66.00 |
| 3 | travis111 | 81.33 | 100.00 | 95.08 | 98.99 | 99.52 | 80.85 | 79.51 | 91.67 | 60.00 |
| 4 | gmehong | 80.11 | 100.00 | 96.72 | 98.96 | 98.13 | 76.92 | 77.05 | 91.67 | 61.00 |
| 5 | dkhonker | 77.52 | 100.00 | 93.44 | 98.72 | 97.58 | 77.08 | 73.77 | 75.00 | 58.00 |
| Setting | Overall | Attribute | Comp. Type | Count Comp. | Count Pin | Defect Exist. | Defect Type | Mount Side | Standard Know. |
| Backbone Scale and Auxiliary Data | |||||||||
| Qwen3.5-4B | 82.66 | 80.25 | 73.80 | 97.81 | 98.45 | 94.82 | 81.15 | 87.25 | 66.63 |
| Qwen3.5-9B | 83.99 | 98.75 | 83.90 | 97.84 | 97.66 | 93.91 | 77.75 | 84.50 | 68.75 |
| Qwen3.5-27B | 86.84 | 100.00 | 89.00 | 98.35 | 98.69 | 94.78 | 82.50 | 84.75 | 72.38 |
| Qwen3.5-27B + PCB-Bench | 86.93 | 99.50 | 90.10 | 97.55 | 98.89 | 95.09 | 82.05 | 84.50 | 72.69 |
| GRPO Reward Design | |||||||||
Visual Question Answering
Visual Question Answering (VQA) develops systems that answer natural-language questions about images, videos, and visual documents.
See all 253 papers