You are here

Multi-modal analysis of infant cry types characterization: Acoustics, body language and brain signals

Multi-modal analysis of infant cry types characterization: Acoustics, body language and brain signals

Authors: 
Ana Laguna, Sandra Pusil, Àngel Bazán, Jonathan Adrián Zegarra-Valdivia, Anna Lucia Paltrinieri, Paolo Piras, Clàudia Palomares i Perera, Alexandra Pardos Véglia, Oscar Garcia-Algar, Silvia Orlandi,
Year: 
2023
Journal: 
Science Direct, Computers in Biology and Medicine
Abstract: 

Background

Infant crying is the first attempt babies use to communicate during their initial months of life. A misunderstanding of the cry message can compromise infant care and future neurodevelopmental process.

Methods

An exploratory study collecting multimodal data (i.e., crying, electroencephalography (EEG), near-infrared spectroscopy (NIRS), facial expressions, and body movements) from 38 healthy full-term newborns was conducted. Cry types were defined based on different conditions (i.e., hunger, sleepiness, fussiness, need to burp, and distress). Statistical analysis, Machine Learning (ML), and Deep Learning (DL) techniques were used to identify relevant features for cry type classification and to evaluate a robust DL algorithm named Acoustic MultiStage Interpreter (AMSI).

Results

Significant differences were found across cry types based on acoustics, EEG, NIRS, facial expressions, and body movements. Acoustics and body language were identified as the most relevant ML features to support the cause of crying. The DL AMSI algorithm achieved an accuracy rate of 92%.

Conclusions

This study set a precedent for cry analysis research by highlighting the complexity of newborn cry expression and strengthening the potential use of infant cry analysis as an objective, reliable, accessible, and non-invasive tool for cry interpretation, improving the infant-parent relationship and ensuring family well-being.

Read more....

© Copyright 1999 - 2024 ANT Neuro | www.ant-neuro.com | Terms of Use | Privacy Statement | Contact | USA Customers