author_facet Di Mitri, Daniele
Schneider, Jan
Specht, Marcus
Drachsler, Hendrik
Di Mitri, Daniele
Schneider, Jan
Specht, Marcus
Drachsler, Hendrik
author Di Mitri, Daniele
Schneider, Jan
Specht, Marcus
Drachsler, Hendrik
spellingShingle Di Mitri, Daniele
Schneider, Jan
Specht, Marcus
Drachsler, Hendrik
Sensors
Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks
Electrical and Electronic Engineering
Biochemistry
Instrumentation
Atomic and Molecular Physics, and Optics
Analytical Chemistry
author_sort di mitri, daniele
spelling Di Mitri, Daniele Schneider, Jan Specht, Marcus Drachsler, Hendrik 1424-8220 MDPI AG Electrical and Electronic Engineering Biochemistry Instrumentation Atomic and Molecular Physics, and Optics Analytical Chemistry http://dx.doi.org/10.3390/s19143099 <jats:p>This study investigated to what extent multimodal data can be used to detect mistakes during Cardiopulmonary Resuscitation (CPR) training. We complemented the Laerdal QCPR ResusciAnne manikin with the Multimodal Tutor for CPR, a multi-sensor system consisting of a Microsoft Kinect for tracking body position and a Myo armband for collecting electromyogram information. We collected multimodal data from 11 medical students, each of them performing two sessions of two-minute chest compressions (CCs). We gathered in total 5254 CCs that were all labelled according to five performance indicators, corresponding to common CPR training mistakes. Three out of five indicators, CC rate, CC depth and CC release, were assessed automatically by the ReusciAnne manikin. The remaining two, related to arms and body position, were annotated manually by the research team. We trained five neural networks for classifying each of the five indicators. The results of the experiment show that multimodal data can provide accurate mistake detection as compared to the ResusciAnne manikin baseline. We also show that the Multimodal Tutor for CPR can detect additional CPR training mistakes such as the correct use of arms and body weight. Thus far, these mistakes were identified only by human instructors. Finally, to investigate user feedback in the future implementations of the Multimodal Tutor for CPR, we conducted a questionnaire to collect valuable feedback aspects of CPR training.</jats:p> Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks Sensors
doi_str_mv 10.3390/s19143099
facet_avail Online
Free
finc_class_facet Chemie und Pharmazie
Allgemeines
Technik
Mathematik
Physik
format ElectronicArticle
fullrecord blob:ai-49-aHR0cDovL2R4LmRvaS5vcmcvMTAuMzM5MC9zMTkxNDMwOTk
id ai-49-aHR0cDovL2R4LmRvaS5vcmcvMTAuMzM5MC9zMTkxNDMwOTk
institution DE-L229
DE-D275
DE-Bn3
DE-Brt1
DE-Zwi2
DE-D161
DE-Gla1
DE-Zi4
DE-15
DE-Pl11
DE-Rs1
DE-105
DE-14
DE-Ch1
imprint MDPI AG, 2019
imprint_str_mv MDPI AG, 2019
issn 1424-8220
issn_str_mv 1424-8220
language English
mega_collection MDPI AG (CrossRef)
match_str dimitri2019detectingmistakesincprtrainingwithmultimodaldataandneuralnetworks
publishDateSort 2019
publisher MDPI AG
recordtype ai
record_format ai
series Sensors
source_id 49
title Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks
title_unstemmed Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks
title_full Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks
title_fullStr Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks
title_full_unstemmed Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks
title_short Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks
title_sort detecting mistakes in cpr training with multimodal data and neural networks
topic Electrical and Electronic Engineering
Biochemistry
Instrumentation
Atomic and Molecular Physics, and Optics
Analytical Chemistry
url http://dx.doi.org/10.3390/s19143099
publishDate 2019
physical 3099
description <jats:p>This study investigated to what extent multimodal data can be used to detect mistakes during Cardiopulmonary Resuscitation (CPR) training. We complemented the Laerdal QCPR ResusciAnne manikin with the Multimodal Tutor for CPR, a multi-sensor system consisting of a Microsoft Kinect for tracking body position and a Myo armband for collecting electromyogram information. We collected multimodal data from 11 medical students, each of them performing two sessions of two-minute chest compressions (CCs). We gathered in total 5254 CCs that were all labelled according to five performance indicators, corresponding to common CPR training mistakes. Three out of five indicators, CC rate, CC depth and CC release, were assessed automatically by the ReusciAnne manikin. The remaining two, related to arms and body position, were annotated manually by the research team. We trained five neural networks for classifying each of the five indicators. The results of the experiment show that multimodal data can provide accurate mistake detection as compared to the ResusciAnne manikin baseline. We also show that the Multimodal Tutor for CPR can detect additional CPR training mistakes such as the correct use of arms and body weight. Thus far, these mistakes were identified only by human instructors. Finally, to investigate user feedback in the future implementations of the Multimodal Tutor for CPR, we conducted a questionnaire to collect valuable feedback aspects of CPR training.</jats:p>
container_issue 14
container_start_page 0
container_title Sensors
container_volume 19
format_de105 Article, E-Article
format_de14 Article, E-Article
format_de15 Article, E-Article
format_de520 Article, E-Article
format_de540 Article, E-Article
format_dech1 Article, E-Article
format_ded117 Article, E-Article
format_degla1 E-Article
format_del152 Buch
format_del189 Article, E-Article
format_dezi4 Article
format_dezwi2 Article, E-Article
format_finc Article, E-Article
format_nrw Article, E-Article
_version_ 1792330640373317636
geogr_code not assigned
last_indexed 2024-03-01T13:28:02.575Z
geogr_code_person not assigned
openURL url_ver=Z39.88-2004&ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fvufind.svn.sourceforge.net%3Agenerator&rft.title=Detecting+Mistakes+in+CPR+Training+with+Multimodal+Data+and+Neural+Networks&rft.date=2019-07-13&genre=article&issn=1424-8220&volume=19&issue=14&pages=3099&jtitle=Sensors&atitle=Detecting+Mistakes+in+CPR+Training+with+Multimodal+Data+and+Neural+Networks&aulast=Drachsler&aufirst=Hendrik&rft_id=info%3Adoi%2F10.3390%2Fs19143099&rft.language%5B0%5D=eng
SOLR
_version_ 1792330640373317636
author Di Mitri, Daniele, Schneider, Jan, Specht, Marcus, Drachsler, Hendrik
author_facet Di Mitri, Daniele, Schneider, Jan, Specht, Marcus, Drachsler, Hendrik, Di Mitri, Daniele, Schneider, Jan, Specht, Marcus, Drachsler, Hendrik
author_sort di mitri, daniele
container_issue 14
container_start_page 0
container_title Sensors
container_volume 19
description <jats:p>This study investigated to what extent multimodal data can be used to detect mistakes during Cardiopulmonary Resuscitation (CPR) training. We complemented the Laerdal QCPR ResusciAnne manikin with the Multimodal Tutor for CPR, a multi-sensor system consisting of a Microsoft Kinect for tracking body position and a Myo armband for collecting electromyogram information. We collected multimodal data from 11 medical students, each of them performing two sessions of two-minute chest compressions (CCs). We gathered in total 5254 CCs that were all labelled according to five performance indicators, corresponding to common CPR training mistakes. Three out of five indicators, CC rate, CC depth and CC release, were assessed automatically by the ReusciAnne manikin. The remaining two, related to arms and body position, were annotated manually by the research team. We trained five neural networks for classifying each of the five indicators. The results of the experiment show that multimodal data can provide accurate mistake detection as compared to the ResusciAnne manikin baseline. We also show that the Multimodal Tutor for CPR can detect additional CPR training mistakes such as the correct use of arms and body weight. Thus far, these mistakes were identified only by human instructors. Finally, to investigate user feedback in the future implementations of the Multimodal Tutor for CPR, we conducted a questionnaire to collect valuable feedback aspects of CPR training.</jats:p>
doi_str_mv 10.3390/s19143099
facet_avail Online, Free
finc_class_facet Chemie und Pharmazie, Allgemeines, Technik, Mathematik, Physik
format ElectronicArticle
format_de105 Article, E-Article
format_de14 Article, E-Article
format_de15 Article, E-Article
format_de520 Article, E-Article
format_de540 Article, E-Article
format_dech1 Article, E-Article
format_ded117 Article, E-Article
format_degla1 E-Article
format_del152 Buch
format_del189 Article, E-Article
format_dezi4 Article
format_dezwi2 Article, E-Article
format_finc Article, E-Article
format_nrw Article, E-Article
geogr_code not assigned
geogr_code_person not assigned
id ai-49-aHR0cDovL2R4LmRvaS5vcmcvMTAuMzM5MC9zMTkxNDMwOTk
imprint MDPI AG, 2019
imprint_str_mv MDPI AG, 2019
institution DE-L229, DE-D275, DE-Bn3, DE-Brt1, DE-Zwi2, DE-D161, DE-Gla1, DE-Zi4, DE-15, DE-Pl11, DE-Rs1, DE-105, DE-14, DE-Ch1
issn 1424-8220
issn_str_mv 1424-8220
language English
last_indexed 2024-03-01T13:28:02.575Z
match_str dimitri2019detectingmistakesincprtrainingwithmultimodaldataandneuralnetworks
mega_collection MDPI AG (CrossRef)
physical 3099
publishDate 2019
publishDateSort 2019
publisher MDPI AG
record_format ai
recordtype ai
series Sensors
source_id 49
spelling Di Mitri, Daniele Schneider, Jan Specht, Marcus Drachsler, Hendrik 1424-8220 MDPI AG Electrical and Electronic Engineering Biochemistry Instrumentation Atomic and Molecular Physics, and Optics Analytical Chemistry http://dx.doi.org/10.3390/s19143099 <jats:p>This study investigated to what extent multimodal data can be used to detect mistakes during Cardiopulmonary Resuscitation (CPR) training. We complemented the Laerdal QCPR ResusciAnne manikin with the Multimodal Tutor for CPR, a multi-sensor system consisting of a Microsoft Kinect for tracking body position and a Myo armband for collecting electromyogram information. We collected multimodal data from 11 medical students, each of them performing two sessions of two-minute chest compressions (CCs). We gathered in total 5254 CCs that were all labelled according to five performance indicators, corresponding to common CPR training mistakes. Three out of five indicators, CC rate, CC depth and CC release, were assessed automatically by the ReusciAnne manikin. The remaining two, related to arms and body position, were annotated manually by the research team. We trained five neural networks for classifying each of the five indicators. The results of the experiment show that multimodal data can provide accurate mistake detection as compared to the ResusciAnne manikin baseline. We also show that the Multimodal Tutor for CPR can detect additional CPR training mistakes such as the correct use of arms and body weight. Thus far, these mistakes were identified only by human instructors. Finally, to investigate user feedback in the future implementations of the Multimodal Tutor for CPR, we conducted a questionnaire to collect valuable feedback aspects of CPR training.</jats:p> Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks Sensors
spellingShingle Di Mitri, Daniele, Schneider, Jan, Specht, Marcus, Drachsler, Hendrik, Sensors, Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks, Electrical and Electronic Engineering, Biochemistry, Instrumentation, Atomic and Molecular Physics, and Optics, Analytical Chemistry
title Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks
title_full Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks
title_fullStr Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks
title_full_unstemmed Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks
title_short Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks
title_sort detecting mistakes in cpr training with multimodal data and neural networks
title_unstemmed Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks
topic Electrical and Electronic Engineering, Biochemistry, Instrumentation, Atomic and Molecular Physics, and Optics, Analytical Chemistry
url http://dx.doi.org/10.3390/s19143099