x-lai commited on
Commit
a891f97
·
1 Parent(s): 077a7c2
Files changed (1) hide show
  1. README.md +8 -2
README.md CHANGED
@@ -1,6 +1,6 @@
1
  # LISA: Reasoning Segmentation Via Large Language Model
2
 
3
- This is the official implementation of ***LISA (large Language Instructed Segmentation Assistant)***.
4
 
5
  ## News
6
  - [x] [2023.8.2] Paper is released and github repo is created.
@@ -10,7 +10,13 @@ This is the official implementation of ***LISA (large Language Instructed Segmen
10
  - [ ] ReasonSeg Dataset Release
11
  - [ ] Codes and models Release
12
 
13
- LISA can handle cases involving: 1) complex reasoning; 2) world knowledge; 3) explanatory answers; 4) multi-turn conversation.It demonstrates robust zero-shot capability when trained exclusively on reasoning-free datasets.
 
 
 
 
 
 
14
  <p align="center"> <img src="imgs/fig_teaser4_crop.png" width="100%"> </p>
15
 
16
  ## Abstract
 
1
  # LISA: Reasoning Segmentation Via Large Language Model
2
 
3
+ This is the official implementation of ***LISA*** (large ***L***anguage ***I***nstructed ***S***egmentation ***A***ssistant).
4
 
5
  ## News
6
  - [x] [2023.8.2] Paper is released and github repo is created.
 
10
  - [ ] ReasonSeg Dataset Release
11
  - [ ] Codes and models Release
12
 
13
+ ***LISA*** unlocks the new segmentation capabilities of multi-modal LLM, and can handle cases involving:
14
+ 1. complex reasoning;
15
+ 2. world knowledge;
16
+ 3. explanatory answers;
17
+ 4. multi-turn conversation.
18
+
19
+ ***LISA*** also demonstrates robust zero-shot capability when trained exclusively on reasoning-free datasets. In addition, fine-tuning the model with merely 239 reasoning segmentation image-instruction pairs results in further performance enhancement.
20
  <p align="center"> <img src="imgs/fig_teaser4_crop.png" width="100%"> </p>
21
 
22
  ## Abstract