youngzhou12 commited on
Commit
d891cb8
·
verified ·
1 Parent(s): aa655c3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -20
README.md CHANGED
@@ -6,14 +6,14 @@ tags:
6
  - BenchX
7
  ---
8
 
9
- # M-FLAG Checkpoint Model Card
10
 
11
- A retrained M-FLAG model for benchmarking medical vision-language pre-training methods within the BenchX framework.
12
 
13
  ## Model Details
14
- - **Model Type**: M-FLAG
15
- - **Architecture**: ResNet-50 image encoder and CXR-BERT text encoder
16
- - **Original Papers**: [M-FLAG: Medical Vision-Language Pre-training with Frozen Language Models and Latent Space Geometry Optimization](https://arxiv.org/abs/2307.08347)
17
  - **Benchmark Paper**: [BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays](https://arxiv.org/abs/2410.21969)
18
  - **Benchmark Framework**: https://github.com/yangzhou12/BenchX
19
 
@@ -37,44 +37,43 @@ Please follow the [instruction](https://github.com/yangzhou12/BenchX/blob/releas
37
 
38
  ### 1. Classification
39
 
40
- To fine-tune M-FLAG for classification, run this command:
41
 
42
  ```
43
- python bin/train.py config/classification/<dataset_name>/M-FLAG.yml
44
  ```
45
 
46
  ### 2. Segmentation
47
- To fine-tune M-FLAG for segmentation, run this command:
48
 
49
  ```
50
- python mmsegmentation/tools/train.py config/benchmark/<dataset_name>/M-FLAG.yml
51
  ```
52
 
53
  ### 3. Report Generation
54
- To fine-tune M-FLAG for report generation, run this command:
55
  ```
56
- python bin/train.py config/report_generation/<dataset_name>/M-FLAG.yml
57
  ```
58
 
59
  ### 4. Evaluation
60
- To evaluate fine-tuned M-FLAG models, run:
61
 
62
  ```
63
  # For classification and report generation
64
- python bin/test.py config/<task_name>/<dataset_name>/M-FLAG.yml validator.splits=[test] ckpt_dir=<path_to_checkpoint>
65
 
66
  # For segmentation
67
- python mmsegmentation/tools/my_test.py mmsegmentation/config/<dataset_name>/M-FLAG.yml <path_to_checkpoint>
68
  ```
69
 
70
  ## Citations
71
  ```bibtex
72
- @inproceedings{huang2021M-FLAG,
73
- title={M-FLAG: Medical Vision-Language Pre-training with Frozen Language Models and Latent Space Geometry Optimization},
74
- author={Liu, Che and Cheng, Sibo and Chen, Chen and Qiao, Mengyun and Zhang, Weitong and Shah, Anand and Bai, Wenjia and Arcucci, Rossella},
75
- booktitle={Proceedings of MICCAI},
76
- pages={637--647},
77
- year={2023},
78
  }
79
  ```
80
  ```bibtex
 
6
  - BenchX
7
  ---
8
 
9
+ # MRM Checkpoint Model Card
10
 
11
+ A retrained MRM model for benchmarking medical vision-language pre-training methods within the BenchX framework.
12
 
13
  ## Model Details
14
+ - **Model Type**: MRM
15
+ - **Architecture**: ViT-Base image encoder and custom BERT text encoder
16
+ - **Original Papers**: [Advancing Radiograph Representation Learning with Masked Record Modeling](https://arxiv.org/abs/2301.13155)
17
  - **Benchmark Paper**: [BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays](https://arxiv.org/abs/2410.21969)
18
  - **Benchmark Framework**: https://github.com/yangzhou12/BenchX
19
 
 
37
 
38
  ### 1. Classification
39
 
40
+ To fine-tune MRM for classification, run this command:
41
 
42
  ```
43
+ python bin/train.py config/classification/<dataset_name>/MRM.yml
44
  ```
45
 
46
  ### 2. Segmentation
47
+ To fine-tune MRM for segmentation, run this command:
48
 
49
  ```
50
+ python mmsegmentation/tools/train.py config/benchmark/<dataset_name>/MRM.yml
51
  ```
52
 
53
  ### 3. Report Generation
54
+ To fine-tune MRM for report generation, run this command:
55
  ```
56
+ python bin/train.py config/report_generation/<dataset_name>/MRM.yml
57
  ```
58
 
59
  ### 4. Evaluation
60
+ To evaluate fine-tuned MRM models, run:
61
 
62
  ```
63
  # For classification and report generation
64
+ python bin/test.py config/<task_name>/<dataset_name>/MRM.yml validator.splits=[test] ckpt_dir=<path_to_checkpoint>
65
 
66
  # For segmentation
67
+ python mmsegmentation/tools/my_test.py mmsegmentation/config/<dataset_name>/MRM.yml <path_to_checkpoint>
68
  ```
69
 
70
  ## Citations
71
  ```bibtex
72
+ @inproceedings{zhou2023advancing,
73
+ title={Advancing Radiograph Representation Learning with Masked Record Modeling},
74
+ author={Hong-Yu Zhou and Chenyu Lian and Liansheng Wang and Yizhou Yu},
75
+ booktitle={Proceedings of ICLR},
76
+ year={2023}
 
77
  }
78
  ```
79
  ```bibtex