Network Accelerated Motion Estimation and Reduction (NAMER): Convolutional neural network guided retrospective motion correction using a separable motion model

Magn Reson Med. 2019 Oct;82(4):1452-1461. doi: 10.1002/mrm.27771. Epub 2019 May 2.

Abstract

Purpose: We introduce and validate a scalable retrospective motion correction technique for brain imaging that incorporates a machine learning component into a model-based motion minimization.

Methods: A convolutional neural network (CNN) trained to remove motion artifacts from 2D T2 -weighted rapid acquisition with refocused echoes (RARE) images is introduced into a model-based data-consistency optimization to jointly search for 2D motion parameters and the uncorrupted image. Our separable motion model allows for efficient intrashot (line-by-line) motion correction of highly corrupted shots, as opposed to previous methods which do not scale well with this refinement of the motion model. Final image generation incorporates the motion parameters within a model-based image reconstruction. The method is tested in simulations and in vivo motion experiments of in-plane motion corruption.

Results: While the convolutional neural network alone provides some motion mitigation (at the expense of introduced blurring), allowing it to guide the iterative joint-optimization both improves the search convergence and renders the joint-optimization separable. This enables rapid mitigation within shots in addition to between shots. For 2D in-plane motion correction experiments, the result is a significant reduction of both image space root mean square error in simulations, and a reduction of motion artifacts in the in vivo motion tests.

Conclusion: The separability and convergence improvements afforded by the combined convolutional neural network+model-based method shows the potential for meaningful postacquisition motion mitigation in clinical MRI.

Keywords: convolutional neural networks; deep learning; image reconstruction; machine learning; magnetic resonance; motion correction.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't
  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Artifacts
  • Brain / diagnostic imaging
  • Computer Simulation
  • Deep Learning
  • Humans
  • Image Processing, Computer-Assisted / methods*
  • Magnetic Resonance Imaging / methods*
  • Movement / physiology
  • Neural Networks, Computer*