Smartphone clip-on microscopes turn everyday devices into low-cost, portable imaging systems that can even reveal fungal structures at the microscopic level, enabling mold inspection beyond unaided visual checks. In this paper, we introduce MobileMold, an open smartphone-based microscopy dataset for food mold detection and food classification. MobileMold contains 4,941 handheld microscopy images spanning 11 food types, 4 smartphones, 3 microscopes, and diverse real-world conditions. Beyond the dataset release, we establish baselines for (i) mold detection and (ii) food-type classification, including a multi-task setting that predicts both attributes. Across multiple pretrained deep learning architectures and augmentation strategies, we obtain near-ceiling performance (accuracy = 0.9954, F1 = 0.9954, MCC = 0.9907), validating the utility of our dataset for detecting food spoilage. To increase transparency, we complement our evaluation with saliency-based visual explanations highlighting mold regions associated with the model's predictions. MobileMold aims to contribute to research on accessible food-safety sensing, mobile imaging, and exploring the potential of smartphones enhanced with attachments.
Figures & tables
Figure 1. Effective field of view comparison using millimeter paper. Both images are cropped according to the preprocessing pipeline and show an effective FOV of 11mm×11mm .
Figure 2. Typical data acquisition setup mimicking consumer use. A smartphone equipped with the Apexel 100× attachment is held manually over a carrot sample.
Figure 3. MobileMold per-food distribution of mold vs. no mold .
Figure 4. Samples of MobileMold.
Model
ACC
F1
AUC
PR AUC
Kappa
MCC
DenseNet
0.9859
0.9858
0.9995
0.9995
0.9718
0.9720
MobileNet
0.9836
0.9838
0.9992
0.9992
0.9671
0.9674
Resnet
0.9648
0.9650
0.9965
0.9965
0.9296
0.9297
VGG
0.9859
0.9860
0.9993
0.9993
0.9718
0.9719
ShuffleNet
0.9742
0.9740
0.9933
0.9913
0.9484
0.9485
Swin
0.9883
0.9884
0.9989
0.9984
0.9765
0.9768
Table 1. Model comparison on the MobileMold test set.
Model
ACC
F1
AUC
PR AUC
Kappa
MCC
None
0.9883
0.9884
0.9989
0.9984
0.9765
0.9768
Flip + Rotation
0.9953
0.9953
0.9999
0.9999
0.9906
0.9907
TrivialAugment
0.9953
0.9953
0.9996
0.9996
0.9906
0.9906
RandAugment
0.9930
0.9929
0.9998
0.9998
0.9859
0.9859
AutoAugment
0.9906
0.9907
0.9995
0.9995
0.9812
0.9813
AugMix
0.9930
0.9929
0.9998
0.9998
0.9859
0.9859
Table 2. Augmentation comparison on the MobileMold test set for Swin Transformer.
Model
ACC
F1
AUC
PR AUC
Kappa
MCC
None
0.9836
0.9838
0.9993
0.9993
0.9672
0.9675
Flip + Rotation
0.9695
0.9695
0.9978
0.9979
0.9390
0.9390
TrivialAugment
0.9907
0.9907
0.9999
0.9999
0.9813
0.9813
RandAugment
0.9907
0.9907
0.9995
0.9995
0.9813
0.9813
AutoAugment
0.9883
0.9883
0.9996
0.9996
0.9766
0.9766
AugMix
0.9954
0.9954
0.9999
0.9999
0.9907
0.9907
Table 3. Augmentation comparison on the MobileMold test set for MobileNet.
Model
Task
ACC
F1 (macro)
AUC (OvR)
Kappa
MCC
Swin
Mold
0.9883
0.9883
0.9998
0.9765
0.9766
Food
1.0000
1.0000
1.0000
1.0000
1.0000
MobileNet
Mold
0.9906
0.9906
0.9997
0.9812
0.9812
Food
0.9977
0.9964
1.0000
0.9973
0.9973
Table 4. Test performance for multitask learning on mold detection (binary) and food type classification (multiclass). F1 is macro-averaged, multiclass AUC is reported using One-versus-rest.
Figure 5. Saliency maps of MobileNet for 3 random samples of the test set with mold.
Figure 6. Main screen interface (left) and analysis screen showing mold detection results (right) of our app.
Food defect detection is critical for automated quality control, yet existing studies lack unified benchmarks and suffer from data scarcity. We introduce FDD-48, a comprehensive dataset with fine-grained annotations across 13 food types and 48 defect categories under diverse real-world conditions. To improve detection with limited labeled data, we propose FDDet, a semi-supervised framework featuring two key components: (1) BBoxMixUp, a data augmentation technique that mixes same-category defect regions to reduce spurious feature associations, and (2) CGPC (Consistency-Guided Pseudo-Label Calibration), which filters pseudo-labels based on intra-sample consistency. Experiments show FDDet significantly outperforms mainstream detectors on FDD-48, demonstrating its effectiveness for food defect detection under data-limited scenarios.
Ruihao Xu, Yong Liu, Yansong Tang
Tsinghua Shenzhen International Graduate School, Tsinghua University
Most Deepfake detectors report near-perfect AUC scores on their reference benchmarks. However, a recent ICML position paper argues that these evaluations collectively neglect the impact of modern smartphone photography: the widely used on-device neural image-signal processing pipelines (like multi-sensor fusion or noise and motion-blur suppression) increasingly shift the imaging paradigm from simple lens projections towards computational photography. Hence, devices actually generate, rather than record photos. This increases the risk that deepfake detectors may flag ordinary phone photos as fake. Due to the lack of large-scale datasets containing images from modern smartphones, this hypothesis has so far only been tested in small proof-of-concept studies. The aim of this paper is to close this gap. We introduce LAION-Mobile, an open dataset containing about 1 million smartphone images with EXIF metadata distilled from re-LAION-5B. Evaluating twelve state-of-the-art deepfake detectors with their original paper checkpoints on a 9,115-image evaluation sample of this pool (DIRE on 738), we report three key findings: (i) On modern AI content no detector exceeds AUC 0.624, and five of twelve fall below chance. (ii) Real-photo false-alarm rates are an artefact of threshold calibration: thresholds fitted on legacy GAN data make several detectors look deployable (less than 11 percent FPR), yet the same detectors flag 17-91 percent of real photos once the identical criterion is refit on modern content. (iii) Consequently, no detector both beats chance on modern AI content and keeps a deployable real-photo false-alarm rate. Mirroring the device mix of web collections, the corpus probes the first neural-ISP generation (2018-2020); current flagships are essentially absent, leaving the modern-ISP regime as the open gap.
Woody Breast (WB) and Spaghetti Meat (SM) myopathies significantly impact poultry meat quality, yet current detection methods rely either on subjective manual evaluation or costly laboratory-grade imaging systems. We address the problem of low-cost, non-destructive multi-class myopathy classification using consumer smartphones. MyoVision is introduced as a mobile transillumination imaging framework in which 14-bit RAW images are captured and structural texture descriptors indicative of internal tissue abnormalities are extracted. To classify three categories (Normal, Woody Breast, Spaghetti Meat), we propose a NEATBoost-Attention Ensemble model, which is a neuroevolution-optimized weighted fusion of LightGBM and attention-based MLP models. Hyperparameters are automatically discovered using NeuroEvolution of Augmenting Topologies (NEAT), eliminating manual tuning and enabling architecture diversity for small tabular datasets. On a dataset of 336 fillets collected from a commercial processing facility, our method achieves 82.4% test accuracy (F1 = 0.83), outperforming conventional machine learning and deep learning baselines and matching performance reported by hyperspectral imaging systems costing orders of magnitude more. Beyond classification performance, MyoVision establishes a reproducible mobile RGB-D acquisition pipeline for multimodal meat quality research, demonstrating that consumer-grade imaging can support scalable internal tissue assessment.
Chaitanya Pallerla, Siavash Mahmoudi, Dongyi Wang
Department of Biological and Agricultural Engineering, University of Arkansas, Fayetteville, AR · Department of Food Science, University of Arkansas, Fayetteville, AR