Suparious commited on
Commit
b74acaf
·
verified ·
1 Parent(s): 55bcbcb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -2
README.md CHANGED
@@ -1,4 +1,7 @@
1
  ---
 
 
 
2
  library_name: transformers
3
  tags:
4
  - 4-bit
@@ -6,10 +9,35 @@ tags:
6
  - text-generation
7
  - autotrain_compatible
8
  - endpoints_compatible
 
9
  pipeline_tag: text-generation
10
  inference: false
11
  quantized_by: Suparious
12
  ---
13
- #
14
 
15
- **UPLOAD IN PROGRESS**
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: mit
3
+ language:
4
+ - en
5
  library_name: transformers
6
  tags:
7
  - 4-bit
 
9
  - text-generation
10
  - autotrain_compatible
11
  - endpoints_compatible
12
+ - vision
13
  pipeline_tag: text-generation
14
  inference: false
15
  quantized_by: Suparious
16
  ---
17
+ # LeroyDyer/Mixtral_AI_TinyTronVision AWQ
18
 
19
+ ## Model Summary
20
+
21
+ ### ADD HEAD
22
+ ```
23
+
24
+
25
+
26
+ print('Add Vision...')
27
+ # ADD HEAD
28
+ # Combine pre-trained encoder and pre-trained decoder to form a Seq2Seq model
29
+
30
+
31
+
32
+ Vmodel = VisionEncoderDecoderModel.from_encoder_decoder_pretrained(
33
+ "google/vit-base-patch16-224-in21k", "LeroyDyer/Mixtral_AI_Tiny"
34
+ )
35
+ _Encoder_ImageProcessor = Vmodel.encoder
36
+ _Decoder_ImageTokenizer = Vmodel.decoder
37
+ _VisionEncoderDecoderModel = Vmodel
38
+ # Add Pad tokems
39
+ LM_MODEL.VisionEncoderDecoder = _VisionEncoderDecoderModel
40
+ # Add Sub Components
41
+ LM_MODEL.Encoder_ImageProcessor = _Encoder_ImageProcessor
42
+ LM_MODEL.Decoder_ImageTokenizer = _Decoder_ImageTokenizer
43
+ LM_MODEL