nyap commited on
Commit
7515cc3
·
verified ·
1 Parent(s): 4afd2fd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -1
README.md CHANGED
@@ -1,11 +1,23 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
 
 
 
 
3
  ---
4
  ## Development Process
5
  This model was created with the intention of supplmenting our mobile application as an ingredient counter. Such that a user could take an image and have AI determine whether they have the necessary ingredients to create a recipe. As a result of the straightforward usecase, we were motivated to use a lightweight model for this classification task. We were recommended Moondream by a mentor from Intel, which we fine-tuned in this project.
6
 
7
  Upon exploring potential datasets, we found that there was no existing data which included various ingredients within the same scene in addition to quantitative labeling data for each ingredient. We decided to work with a small subset of potential ingredients for our project, to minimize the volatility of our demo-model and prove the efficacy of this feature. During the Hackathon, we acquired 3 produce items and a bag of chips from a local grocery store, which we then used to capture image data and label the quantities of said items.
8
 
 
 
9
  ## Model Details
10
 
11
  - **Model Name**: Moondream Fine-tuned Variant
@@ -41,4 +53,4 @@ Upon exploring potential datasets, we found that there was no existing data whic
41
 
42
  - **License**: Model released under MIT License.
43
  - **Contact Information**: For inquiries, contact [[email protected]](mailto:[email protected]).
44
- - **Acknowledgments**: Acknowledge Intel team for starter code and assistance in fine-tuning.
 
1
  ---
2
  license: mit
3
+ language:
4
+ - en
5
+ pipeline_tag: object-detection
6
+ tags:
7
+ - VIT
8
+ - Cooking
9
+ - Vegetables
10
+ - Moondream
11
+ - Intel
12
+ - IPEX
13
  ---
14
  ## Development Process
15
  This model was created with the intention of supplmenting our mobile application as an ingredient counter. Such that a user could take an image and have AI determine whether they have the necessary ingredients to create a recipe. As a result of the straightforward usecase, we were motivated to use a lightweight model for this classification task. We were recommended Moondream by a mentor from Intel, which we fine-tuned in this project.
16
 
17
  Upon exploring potential datasets, we found that there was no existing data which included various ingredients within the same scene in addition to quantitative labeling data for each ingredient. We decided to work with a small subset of potential ingredients for our project, to minimize the volatility of our demo-model and prove the efficacy of this feature. During the Hackathon, we acquired 3 produce items and a bag of chips from a local grocery store, which we then used to capture image data and label the quantities of said items.
18
 
19
+ We utilized the Jupyter server provided by Intel to fine-tune, and deployed on a IDC compute instance with a Small VM - Intel® Xeon 4th Gen ® Scalable processor to connect with our frontend.
20
+
21
  ## Model Details
22
 
23
  - **Model Name**: Moondream Fine-tuned Variant
 
53
 
54
  - **License**: Model released under MIT License.
55
  - **Contact Information**: For inquiries, contact [[email protected]](mailto:[email protected]).
56
+ - **Acknowledgments**: Acknowledge Intel team for starter code and assistance in fine-tuning.