File size: 3,617 Bytes
a33458e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 |
# Personal AI Assistant with RAG (Hugging Face Edition)
A powerful personal AI assistant built with LangChain, integrating Retrieval-Augmented Generation (RAG) with a vector database (Qdrant) for improved contextual awareness and memory. This version uses Hugging Face models and can be deployed to Hugging Face Spaces for free hosting.
[](https://huggingface.co/spaces)
[](https://colab.research.google.com)
## Features
- Large Language Model integration using Hugging Face's free models
- RAG-based memory system with vector database storage
- Document ingestion pipeline for various file types
- Simple web UI built with Streamlit
- Conversation history tracking and retrieval
- Free deployment on Hugging Face Spaces
## Project Structure
```
.
├── README.md
├── requirements.txt
├── .env.example
├── app.py # Main entry point for Hugging Face Spaces
├── space.py # Hugging Face Spaces SDK integration
├── app/
│ ├── main.py # FastAPI application entry point
│ ├── config.py # Configuration settings
│ ├── ui/
│ │ └── streamlit_app.py # Streamlit web interface
│ ├── core/
│ │ ├── llm.py # LLM integration (Hugging Face)
│ │ ├── memory.py # RAG and vector store integration
│ │ ├── agent.py # Agent orchestration
│ │ └── ingestion.py # Document processing pipeline
│ └── utils/
│ └── helpers.py # Utility functions
└── data/
├── documents/ # Store for uploaded documents
└── vector_db/ # Local vector database storage
```
## Setup
1. Clone this repository
2. Install dependencies:
```
pip install -r requirements.txt
```
3. Copy `.env.example` to `.env` and fill in your Hugging Face API keys (optional)
4. Start the Streamlit UI:
```
streamlit run app/ui/streamlit_app.py
```
## Usage
1. Upload documents through the web interface
2. Chat with your assistant, which can now reference your documents
3. The assistant will automatically leverage your document knowledge to provide more personalized responses
## Deployment to Hugging Face Spaces
This app can be easily deployed to Hugging Face Spaces for free hosting:
1. Create a Hugging Face account at [huggingface.co](https://huggingface.co)
2. Set environment variables:
```
export HF_USERNAME=your-username
export HF_TOKEN=your-huggingface-token
export SPACE_NAME=personal-rag-assistant # optional
```
3. Run the deployment script:
```
python space.py
```
4. Visit your deployed app at `https://huggingface.co/spaces/{your-username}/{space-name}`
Alternatively, you can manually create a new Space on Hugging Face and link it to your GitHub repository.
## Models Used
This implementation uses the following free models from Hugging Face:
- LLM: [google/flan-t5-large](https://huggingface.co/google/flan-t5-large) - A powerful instruction-tuned model
- Embeddings: [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2) - Efficient embedding model
You can change these in the `.env` file.
## Extending
- Add more document loaders in `ingestion.py`
- Integrate additional tools in `agent.py`
- Customize the UI in `streamlit_app.py`
- Switch to a different LLM in `llm.py` and `.env` |