Auditory chaos classification in real-world environments

• Main Authors: Priyanka Khante (Author), Edison Thomaz (Author), Kaya de Barbaro (Author)
• Format: Book
• Published: Frontiers Media S.A., 2023-12-01T00:00:00Z.
• Subjects: article
• Online Access: Connect to this object online.
• Notes: 2673-253X; 10.3389/fdgth.2023.1261057
• Keywords: auditory classification; deep learning; household chaos; real-world dataset; developmental psychology; Medicine; R; Public aspects of medicine; RA1-1270; Electronic computers. Computer science; QA75.5-76.95
• Source: Frontiers in Digital Health, Vol 5 (2023)

Background & motivationHousehold chaos is an established risk factor for child development. However, current methods for measuring household chaos rely on parent surveys, meaning existing research efforts cannot disentangle potentially dynamic bidirectional relations between high chaos environments and child behavior problems.Proposed approachWe train and make publicly available a classifier to provide objective, high-resolution predictions of household chaos from real-world child-worn audio recordings. To do so, we collect and annotate a novel dataset of ground-truth auditory chaos labels compiled from over 411 h of daylong recordings collected via audio recorders worn by N=22 infants in their homes. We leverage an existing sound event classifier to identify candidate high chaos segments, increasing annotation efficiency 8.32× relative to random sampling.ResultOur best-performing model successfully classifies four levels of real-world household auditory chaos with a macro F1 score of 0.701 (Precision: 0.705, Recall: 0.702) and a weighted F1 score of 0.679 (Precision: 0.685, Recall: 0.680).SignificanceIn future work, high-resolution objective chaos predictions from our model can be leveraged for basic science and intervention, including testing theorized mechanisms by which chaos affects children's cognition and behavior. Additionally, to facilitate further model development we make publicly available the first and largest balanced annotated audio dataset of real-world household chaos.