Multimodal <scp>AI</scp> for Real‐Time Food Safety and Quality: From Sensors to Foundation Models, Edge Deployment, and Regulation
Zhaojie Chen, Guangyu Zhang, Fan Zhang
Abstract
Real-time assurance of food safety and quality requires decisions at line speed, from farm to retail, using signals that span vision, spectroscopy, volatiles, biosensing, and process telemetry. This review investigates and summarizes evidence on multimodal artificial intelligence that fuses such heterogeneous data to detect hazards, verify authenticity, and predict freshness within seconds. We outline sensing coverage along the chain, typical response times, and reported limits of detection, then detail data engineering practices that make disparate streams analysis-ready, including time synchronization, co-registration to ground truth, and robust sampling for multisite and multiseason generalization. We appraise fusion strategies, from early and late schemes to attention-based hybrids that learn joint embeddings across images, spectra, and gas sensor time series, and we summarize head-to-head studies where multimodality improves accuracy or reduces error against unimodal baselines. We discuss the maturation of foundation scale encoders and vision language systems for food tasks, together with efficient adaptation, knowledge infusion from HACCP, and bias control. Finally, we examine edge deployment and validation in industrial settings, including hardware constraints, latency budgets, repeatability and reproducibility, documentation for audits, and perspectives on regulatory alignment in EU and US contexts, extended to China's standards-driven framework where the National Health Commission (NHC) and the State Administration for Market Regulation (SAMR) jointly issue and update National Food Safety Standards (GB) that govern key compliance requirements for labelling and contaminant limits. Evidence gaps persist, notably few multisite deployments over long durations, limited public benchmarks for hyperspectral and e-nose fusion, and sparse cost-benefit analyses in the scholarly record. Addressing these gaps will enable trustworthy, auditable multimodal AI that complements existing controls and reduces waste while protecting consumers.