Update README.md
Browse files
README.md
CHANGED
@@ -1,11 +1,23 @@
|
|
1 |
---
|
2 |
license: mit
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
4 |
## Development Process
|
5 |
This model was created with the intention of supplmenting our mobile application as an ingredient counter. Such that a user could take an image and have AI determine whether they have the necessary ingredients to create a recipe. As a result of the straightforward usecase, we were motivated to use a lightweight model for this classification task. We were recommended Moondream by a mentor from Intel, which we fine-tuned in this project.
|
6 |
|
7 |
Upon exploring potential datasets, we found that there was no existing data which included various ingredients within the same scene in addition to quantitative labeling data for each ingredient. We decided to work with a small subset of potential ingredients for our project, to minimize the volatility of our demo-model and prove the efficacy of this feature. During the Hackathon, we acquired 3 produce items and a bag of chips from a local grocery store, which we then used to capture image data and label the quantities of said items.
|
8 |
|
|
|
|
|
9 |
## Model Details
|
10 |
|
11 |
- **Model Name**: Moondream Fine-tuned Variant
|
@@ -41,4 +53,4 @@ Upon exploring potential datasets, we found that there was no existing data whic
|
|
41 |
|
42 |
- **License**: Model released under MIT License.
|
43 |
- **Contact Information**: For inquiries, contact [[email protected]](mailto:[email protected]).
|
44 |
-
- **Acknowledgments**: Acknowledge Intel team for starter code and assistance in fine-tuning.
|
|
|
1 |
---
|
2 |
license: mit
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
pipeline_tag: object-detection
|
6 |
+
tags:
|
7 |
+
- VIT
|
8 |
+
- Cooking
|
9 |
+
- Vegetables
|
10 |
+
- Moondream
|
11 |
+
- Intel
|
12 |
+
- IPEX
|
13 |
---
|
14 |
## Development Process
|
15 |
This model was created with the intention of supplmenting our mobile application as an ingredient counter. Such that a user could take an image and have AI determine whether they have the necessary ingredients to create a recipe. As a result of the straightforward usecase, we were motivated to use a lightweight model for this classification task. We were recommended Moondream by a mentor from Intel, which we fine-tuned in this project.
|
16 |
|
17 |
Upon exploring potential datasets, we found that there was no existing data which included various ingredients within the same scene in addition to quantitative labeling data for each ingredient. We decided to work with a small subset of potential ingredients for our project, to minimize the volatility of our demo-model and prove the efficacy of this feature. During the Hackathon, we acquired 3 produce items and a bag of chips from a local grocery store, which we then used to capture image data and label the quantities of said items.
|
18 |
|
19 |
+
We utilized the Jupyter server provided by Intel to fine-tune, and deployed on a IDC compute instance with a Small VM - Intel® Xeon 4th Gen ® Scalable processor to connect with our frontend.
|
20 |
+
|
21 |
## Model Details
|
22 |
|
23 |
- **Model Name**: Moondream Fine-tuned Variant
|
|
|
53 |
|
54 |
- **License**: Model released under MIT License.
|
55 |
- **Contact Information**: For inquiries, contact [[email protected]](mailto:[email protected]).
|
56 |
+
- **Acknowledgments**: Acknowledge Intel team for starter code and assistance in fine-tuning.
|