webscarper / instruction.txt
mobenta's picture
Upload folder using huggingface_hub
1a979d0 verified
raw
history blame
744 Bytes
1. Create a new folder and Install & activate your virtual environnement
bash (create virtual environment)
python -m venv .venv
2. Create a file requirements.txt and copy the following libraries
requirements.txt
openai
python-dotenv
pandas
pydantic
requests
beautifulsoup4
html2text
tiktoken
selenium
readability-lxml
streamlit
streamlit-tags
openpyxl
groq
google-generativeai
3. pip install requirements
bash
pip install -r requirements.txt
4. Create .env file and add your api keys
.env
OPENAI_API_KEY=sk-xxxxxxxx(place your own key)
GOOGLE_API_KEY=AIzaSyxxxxxxx
GROQ_API_KEY=gskxxxxxxxxx
5. Downlaod ChromeDriver from https://googlechromelabs.github.io/chrome-for-testing/