Skip to content

[Communications Medicine] "Efficient deep learning-based automated diagnosis from echocardiography with contrastive self-supervised learning" by Gregory Holste, Evangelos Oikonomou, Bobak Mortazavi, Zhangyang Wang, and Rohan Khera

Notifications You must be signed in to change notification settings

CarDS-Yale/EchoCLR

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Efficient deep learning-based automated diagnosis from echocardiography with contrastive self-supervised learning

Gregory Holste, Evangelos K. Oikonomou, Bobak J. Mortazavi, Zhangyang Wang, Rohan Khera

(For a previous version of this paper presented at the ICML workshop, IMLH 2022, see the imlh-2022/ directory.)


Description

Overview of EchoCLR, a self-supervised learning approach for echocardiography. Unlike standard contrastive learning methods, two distinct videos of each patient acquired during a single exam are randomly sampled and deemed positive pairs for “multi-instance” contrastive learning (A). The frames of each video are then randomly shuffled along the temporal axis and fed into a 3D CNN, which learns similar representations of distinct videos from the same patient and dissimilar representations of videos from different patients (B). These video-level representations are then used to directly predict the order of shuffled video frames. This frame reordering pretext task encourages temporal coherence, which we demonstrate to be beneficial for downstream echocardiogram video-based disease classification tasks (C). After self-supervised pretraining, the 3D CNN backbone can then be efficiently fine-tuned for cardiac disease classification based on very few labeled echocardiograms.

Usage

To reproduce the results in the paper,

  1. Prepare the conda environment.
  • conda env create -f echo.yml
  • conda activate echo
  1. Run pretraining experiments. This will train the SimCLR, MI-SimCLR, and EchoCLR models.
  • bash ssl/run_ssl_experiments.sh
  1. Run fine-tuning experiments. For each init (Random, Kinetics-400, SimCLR, MI-SimCLR, and EchoCLR), this will fine-tune a model to predict severe aortic stenosis (AS) and left ventricular hypertrophy (LVH) on various ratios of the training data.
  • bash finetune/run_random_train_ratio_experiments.sh
  • bash finetune/run_kinetics_train_ratio_experiments.sh
  • bash finetune/run_simclr_train_ratio_experiments.sh
  • bash finetune/run_mi-simclr_train_ratio_experiments.sh
  • bash finetune/run_echoclr_train_ratio_experiments.sh

Citation

@article{holste2024efficient,
  title={Efficient deep learning-based automated diagnosis from echocardiography with contrastive self-supervised learning},
  author={Holste, Gregory and Oikonomou, Evangelos K and Mortazavi, Bobak and Wang, Zhangyang and Khera, Rohan},
  journal={Communications Medicine},
  year={2024},
  month={7},
  volume={4},
  doi={10.1038/s43856-024-00538-3},
  url={https://doi.org/10.1038/s43856-024-00538-3}
}

Contact

Reach out to Greg Holste ([email protected]) and Rohan Khera ([email protected]) with any questions!

About

[Communications Medicine] "Efficient deep learning-based automated diagnosis from echocardiography with contrastive self-supervised learning" by Gregory Holste, Evangelos Oikonomou, Bobak Mortazavi, Zhangyang Wang, and Rohan Khera

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published