youngzhou12 commited on
Commit
da6b803
·
verified ·
1 Parent(s): ca6596f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -20
README.md CHANGED
@@ -6,14 +6,14 @@ tags:
6
  - BenchX
7
  ---
8
 
9
- # M-FLAG Checkpoint Model Card
10
 
11
- A retrained M-FLAG model for benchmarking medical vision-language pre-training methods within the BenchX framework.
12
 
13
  ## Model Details
14
- - **Model Type**: M-FLAG
15
- - **Architecture**: ResNet-50 image encoder and CXR-BERT text encoder
16
- - **Original Papers**: [M-FLAG: Medical Vision-Language Pre-training with Frozen Language Models and Latent Space Geometry Optimization](https://arxiv.org/abs/2307.08347)
17
  - **Benchmark Paper**: [BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays](https://arxiv.org/abs/2410.21969)
18
  - **Benchmark Framework**: https://github.com/yangzhou12/BenchX
19
 
@@ -37,44 +37,46 @@ Please follow the [instruction](https://github.com/yangzhou12/BenchX/blob/releas
37
 
38
  ### 1. Classification
39
 
40
- To fine-tune M-FLAG for classification, run this command:
41
 
42
  ```
43
- python bin/train.py config/classification/<dataset_name>/M-FLAG.yml
44
  ```
45
 
46
  ### 2. Segmentation
47
- To fine-tune M-FLAG for segmentation, run this command:
48
 
49
  ```
50
- python mmsegmentation/tools/train.py config/benchmark/<dataset_name>/M-FLAG.yml
51
  ```
52
 
53
  ### 3. Report Generation
54
- To fine-tune M-FLAG for report generation, run this command:
55
  ```
56
- python bin/train.py config/report_generation/<dataset_name>/M-FLAG.yml
57
  ```
58
 
59
  ### 4. Evaluation
60
- To evaluate fine-tuned M-FLAG models, run:
61
 
62
  ```
63
  # For classification and report generation
64
- python bin/test.py config/<task_name>/<dataset_name>/M-FLAG.yml validator.splits=[test] ckpt_dir=<path_to_checkpoint>
65
 
66
  # For segmentation
67
- python mmsegmentation/tools/my_test.py mmsegmentation/config/<dataset_name>/M-FLAG.yml <path_to_checkpoint>
68
  ```
69
 
70
  ## Citations
71
  ```bibtex
72
- @inproceedings{huang2021M-FLAG,
73
- title={M-FLAG: Medical Vision-Language Pre-training with Frozen Language Models and Latent Space Geometry Optimization},
74
- author={Liu, Che and Cheng, Sibo and Chen, Chen and Qiao, Mengyun and Zhang, Weitong and Shah, Anand and Bai, Wenjia and Arcucci, Rossella},
75
- booktitle={Proceedings of MICCAI},
76
- pages={637--647},
77
- year={2023},
 
 
78
  }
79
  ```
80
  ```bibtex
 
6
  - BenchX
7
  ---
8
 
9
+ # REFERS Checkpoint Model Card
10
 
11
+ A retrained REFERS model for benchmarking medical vision-language pre-training methods within the BenchX framework.
12
 
13
  ## Model Details
14
+ - **Model Type**: REFERS
15
+ - **Architecture**: Vit-Base image encoder and BERT text encoder
16
+ - **Original Papers**: [Generalized Radiograph Representation Learning via Cross-Supervision Between Images and Free-Text Radiology Reports](https://arxiv.org/abs/2111.03452)
17
  - **Benchmark Paper**: [BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays](https://arxiv.org/abs/2410.21969)
18
  - **Benchmark Framework**: https://github.com/yangzhou12/BenchX
19
 
 
37
 
38
  ### 1. Classification
39
 
40
+ To fine-tune REFERS for classification, run this command:
41
 
42
  ```
43
+ python bin/train.py config/classification/<dataset_name>/REFERS.yml
44
  ```
45
 
46
  ### 2. Segmentation
47
+ To fine-tune REFERS for segmentation, run this command:
48
 
49
  ```
50
+ python mmsegmentation/tools/train.py config/benchmark/<dataset_name>/REFERS.yml
51
  ```
52
 
53
  ### 3. Report Generation
54
+ To fine-tune REFERS for report generation, run this command:
55
  ```
56
+ python bin/train.py config/report_generation/<dataset_name>/REFERS.yml
57
  ```
58
 
59
  ### 4. Evaluation
60
+ To evaluate fine-tuned REFERS models, run:
61
 
62
  ```
63
  # For classification and report generation
64
+ python bin/test.py config/<task_name>/<dataset_name>/REFERS.yml validator.splits=[test] ckpt_dir=<path_to_checkpoint>
65
 
66
  # For segmentation
67
+ python mmsegmentation/tools/my_test.py mmsegmentation/config/<dataset_name>/REFERS.yml <path_to_checkpoint>
68
  ```
69
 
70
  ## Citations
71
  ```bibtex
72
+ @article{zhou2022generalized,
73
+ title={Generalized radiograph representation learning via cross-supervision between images and free-text radiology reports},
74
+ author={Zhou, Hong-Yu and Chen, Xiaoyu and Zhang, Yinghao and Luo, Ruibang and Wang, Liansheng and Yu, Yizhou},
75
+ journal={Nature Machine Intelligence},
76
+ volume={4},
77
+ number={1},
78
+ pages={32--40},
79
+ year={2022}
80
  }
81
  ```
82
  ```bibtex