Novel Method for Detecting Coughing Pigs with Audio-Visual Multimodality for Smart Agriculture Monitoring
Heechan Chae, Junhee Lee, Junhee Lee, 김종관, Sejun Lee, Jonguk Lee, Jonguk Lee, Yongwha Chung, Daihee Park
Abstract
While the pig industry is crucial in global meat consumption, accounting for 34% of total consumption, respiratory diseases in pigs can cause substantial economic losses to pig farms. To alleviate this issue, we propose an advanced audio-visual monitoring system for the early detection of coughing, a key symptom of respiratory diseases in pigs, that will enhance disease management and animal welfare. The proposed system is structured into three key modules: the cough sound detection (CSD) module, which detects coughing sounds using audio data; the pig object detection (POD) module, which identifies individual pigs in video footage; and the coughing pig detection (CPD) module, which pinpoints which pigs are coughing among the detected pigs. These modules, using a multimodal approach, detect coughs from continuous audio streams amidst background noise and accurately pinpoint specific pens or individual pigs as the source. This method enables continuous 24/7 monitoring, leading to efficient action and reduced human labor stress. It achieved a substantial detection accuracy of 0.95 on practical data, validating its feasibility and applicability. The potential to enhance farm management and animal welfare is shown through proposed early disease detection.