Cardiovascular magnetic resonance imaging feature tracking

Impact of training on observer performance and reproducibility

Sören J. Backhaus, Georg Metschies, Marcus Billing, Johannes T. Kowallick, Roman J. Gertz, Tomas Lapinskas, Burkert Pieske, Joachim Lotz, Boris Bigalke, Shelby Kutty, Gerd Hasenfuß, Philipp Beerbaum, Sebastian Kelle, Andreas Schuster

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Background Cardiovascular magnetic resonance feature tracking (CMR-FT) is increasingly used for myocardial deformation assessment including ventricular strain, showing prognostic value beyond established risk markers if used in experienced centres. Little is known about the impact of appropriate training on CMR-FT performance. Consequently, this study aimed to evaluate the impact of training on observer variance using different commercially available CMR-FT software. Methods Intra- and inter-observer reproducibility was assessed prior to and after dedicated one-hour observer training. Employed FT software included 3 different commercially available platforms (TomTec, Medis, Circle). Left (LV) and right (RV) ventricular global longitudinal as well as LV circumferential and radial strains (GLS, GCS and GRS) were studied in 12 heart failure patients and 12 healthy volunteers. Results Training improved intra- and inter-observer reproducibility. GCS and LV GLS showed the highest reproducibility before (ICC >0.86 and >0.81) and after training (ICC >0.91 and >0.92). RV GLS and GRS were more susceptible to tracking inaccuracies and reproducibility was lower. Inter-observer reproducibility was lower than intra-observer reproducibility prior to training with more pronounced improvements after training. Before training, LV strain reproducibility was lower in healthy volunteers as compared to patients with no differences after training. Whilst LV strain reproducibility was sufficient within individual software solutions inter-software comparisons revealed considerable software related variance. Conclusion Observer experience is an important source of variance in CMR-FT derived strain assessment. Dedicated observer training significantly improves reproducibility with most profound benefits in states of high myocardial contractility and potential to facilitate widespread clinical implementation due to optimized robustness and diagnostic performance.

Original languageEnglish (US)
Article numbere0210127
JournalPloS one
Volume14
Issue number1
DOIs
StatePublished - Jan 1 2019

Fingerprint

Magnetic resonance
magnetic resonance imaging
reproducibility
Software
Magnetic Resonance Imaging
Imaging techniques
Magnetic Resonance Spectroscopy
Healthy Volunteers
volunteers
Heart Failure
heart failure
risk factors

ASJC Scopus subject areas

  • Biochemistry, Genetics and Molecular Biology(all)
  • Agricultural and Biological Sciences(all)

Cite this

Backhaus, S. J., Metschies, G., Billing, M., Kowallick, J. T., Gertz, R. J., Lapinskas, T., ... Schuster, A. (2019). Cardiovascular magnetic resonance imaging feature tracking: Impact of training on observer performance and reproducibility. PloS one, 14(1), [e0210127]. https://doi.org/10.1371/journal.pone.0210127

Cardiovascular magnetic resonance imaging feature tracking : Impact of training on observer performance and reproducibility. / Backhaus, Sören J.; Metschies, Georg; Billing, Marcus; Kowallick, Johannes T.; Gertz, Roman J.; Lapinskas, Tomas; Pieske, Burkert; Lotz, Joachim; Bigalke, Boris; Kutty, Shelby; Hasenfuß, Gerd; Beerbaum, Philipp; Kelle, Sebastian; Schuster, Andreas.

In: PloS one, Vol. 14, No. 1, e0210127, 01.01.2019.

Research output: Contribution to journalArticle

Backhaus, SJ, Metschies, G, Billing, M, Kowallick, JT, Gertz, RJ, Lapinskas, T, Pieske, B, Lotz, J, Bigalke, B, Kutty, S, Hasenfuß, G, Beerbaum, P, Kelle, S & Schuster, A 2019, 'Cardiovascular magnetic resonance imaging feature tracking: Impact of training on observer performance and reproducibility', PloS one, vol. 14, no. 1, e0210127. https://doi.org/10.1371/journal.pone.0210127
Backhaus, Sören J. ; Metschies, Georg ; Billing, Marcus ; Kowallick, Johannes T. ; Gertz, Roman J. ; Lapinskas, Tomas ; Pieske, Burkert ; Lotz, Joachim ; Bigalke, Boris ; Kutty, Shelby ; Hasenfuß, Gerd ; Beerbaum, Philipp ; Kelle, Sebastian ; Schuster, Andreas. / Cardiovascular magnetic resonance imaging feature tracking : Impact of training on observer performance and reproducibility. In: PloS one. 2019 ; Vol. 14, No. 1.
@article{31f337f3861c49d4a640846ff3e02151,
title = "Cardiovascular magnetic resonance imaging feature tracking: Impact of training on observer performance and reproducibility",
abstract = "Background Cardiovascular magnetic resonance feature tracking (CMR-FT) is increasingly used for myocardial deformation assessment including ventricular strain, showing prognostic value beyond established risk markers if used in experienced centres. Little is known about the impact of appropriate training on CMR-FT performance. Consequently, this study aimed to evaluate the impact of training on observer variance using different commercially available CMR-FT software. Methods Intra- and inter-observer reproducibility was assessed prior to and after dedicated one-hour observer training. Employed FT software included 3 different commercially available platforms (TomTec, Medis, Circle). Left (LV) and right (RV) ventricular global longitudinal as well as LV circumferential and radial strains (GLS, GCS and GRS) were studied in 12 heart failure patients and 12 healthy volunteers. Results Training improved intra- and inter-observer reproducibility. GCS and LV GLS showed the highest reproducibility before (ICC >0.86 and >0.81) and after training (ICC >0.91 and >0.92). RV GLS and GRS were more susceptible to tracking inaccuracies and reproducibility was lower. Inter-observer reproducibility was lower than intra-observer reproducibility prior to training with more pronounced improvements after training. Before training, LV strain reproducibility was lower in healthy volunteers as compared to patients with no differences after training. Whilst LV strain reproducibility was sufficient within individual software solutions inter-software comparisons revealed considerable software related variance. Conclusion Observer experience is an important source of variance in CMR-FT derived strain assessment. Dedicated observer training significantly improves reproducibility with most profound benefits in states of high myocardial contractility and potential to facilitate widespread clinical implementation due to optimized robustness and diagnostic performance.",
author = "Backhaus, {S{\"o}ren J.} and Georg Metschies and Marcus Billing and Kowallick, {Johannes T.} and Gertz, {Roman J.} and Tomas Lapinskas and Burkert Pieske and Joachim Lotz and Boris Bigalke and Shelby Kutty and Gerd Hasenfu{\ss} and Philipp Beerbaum and Sebastian Kelle and Andreas Schuster",
year = "2019",
month = "1",
day = "1",
doi = "10.1371/journal.pone.0210127",
language = "English (US)",
volume = "14",
journal = "PLoS One",
issn = "1932-6203",
publisher = "Public Library of Science",
number = "1",

}

TY - JOUR

T1 - Cardiovascular magnetic resonance imaging feature tracking

T2 - Impact of training on observer performance and reproducibility

AU - Backhaus, Sören J.

AU - Metschies, Georg

AU - Billing, Marcus

AU - Kowallick, Johannes T.

AU - Gertz, Roman J.

AU - Lapinskas, Tomas

AU - Pieske, Burkert

AU - Lotz, Joachim

AU - Bigalke, Boris

AU - Kutty, Shelby

AU - Hasenfuß, Gerd

AU - Beerbaum, Philipp

AU - Kelle, Sebastian

AU - Schuster, Andreas

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Background Cardiovascular magnetic resonance feature tracking (CMR-FT) is increasingly used for myocardial deformation assessment including ventricular strain, showing prognostic value beyond established risk markers if used in experienced centres. Little is known about the impact of appropriate training on CMR-FT performance. Consequently, this study aimed to evaluate the impact of training on observer variance using different commercially available CMR-FT software. Methods Intra- and inter-observer reproducibility was assessed prior to and after dedicated one-hour observer training. Employed FT software included 3 different commercially available platforms (TomTec, Medis, Circle). Left (LV) and right (RV) ventricular global longitudinal as well as LV circumferential and radial strains (GLS, GCS and GRS) were studied in 12 heart failure patients and 12 healthy volunteers. Results Training improved intra- and inter-observer reproducibility. GCS and LV GLS showed the highest reproducibility before (ICC >0.86 and >0.81) and after training (ICC >0.91 and >0.92). RV GLS and GRS were more susceptible to tracking inaccuracies and reproducibility was lower. Inter-observer reproducibility was lower than intra-observer reproducibility prior to training with more pronounced improvements after training. Before training, LV strain reproducibility was lower in healthy volunteers as compared to patients with no differences after training. Whilst LV strain reproducibility was sufficient within individual software solutions inter-software comparisons revealed considerable software related variance. Conclusion Observer experience is an important source of variance in CMR-FT derived strain assessment. Dedicated observer training significantly improves reproducibility with most profound benefits in states of high myocardial contractility and potential to facilitate widespread clinical implementation due to optimized robustness and diagnostic performance.

AB - Background Cardiovascular magnetic resonance feature tracking (CMR-FT) is increasingly used for myocardial deformation assessment including ventricular strain, showing prognostic value beyond established risk markers if used in experienced centres. Little is known about the impact of appropriate training on CMR-FT performance. Consequently, this study aimed to evaluate the impact of training on observer variance using different commercially available CMR-FT software. Methods Intra- and inter-observer reproducibility was assessed prior to and after dedicated one-hour observer training. Employed FT software included 3 different commercially available platforms (TomTec, Medis, Circle). Left (LV) and right (RV) ventricular global longitudinal as well as LV circumferential and radial strains (GLS, GCS and GRS) were studied in 12 heart failure patients and 12 healthy volunteers. Results Training improved intra- and inter-observer reproducibility. GCS and LV GLS showed the highest reproducibility before (ICC >0.86 and >0.81) and after training (ICC >0.91 and >0.92). RV GLS and GRS were more susceptible to tracking inaccuracies and reproducibility was lower. Inter-observer reproducibility was lower than intra-observer reproducibility prior to training with more pronounced improvements after training. Before training, LV strain reproducibility was lower in healthy volunteers as compared to patients with no differences after training. Whilst LV strain reproducibility was sufficient within individual software solutions inter-software comparisons revealed considerable software related variance. Conclusion Observer experience is an important source of variance in CMR-FT derived strain assessment. Dedicated observer training significantly improves reproducibility with most profound benefits in states of high myocardial contractility and potential to facilitate widespread clinical implementation due to optimized robustness and diagnostic performance.

UR - http://www.scopus.com/inward/record.url?scp=85060531712&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060531712&partnerID=8YFLogxK

U2 - 10.1371/journal.pone.0210127

DO - 10.1371/journal.pone.0210127

M3 - Article

VL - 14

JO - PLoS One

JF - PLoS One

SN - 1932-6203

IS - 1

M1 - e0210127

ER -