https://huggingface.co/spaces/decodingdatascience/newrag-pine
📞 Telecom Customer Support LLM with Groq API
This project demonstrates how to build a fast, production-grade AI-powered telecom customer support assistant using the Groq API and optimized GenAI configurations.
📌 Project Overview
A step-by-step guide to:
- Sending POST requests using Postman
- Connecting to the Groq API
- Testing default vs. optimized GenAI configurations
- Applying structured prompt templates
- Deploying a simple LLM-powered support API
🔧 Tech Stack
| Layer | Tool/Tech |
|---|---|
| LLM | Groq API |
| API Platform | FastAPI / Postman |
| Prompt Design | Custom templates |
| Deployment | Localhost / Cloud (optional) |
🧠 AI Configuration
| Parameter | Description |
|---|---|
temperature |
Controls randomness (default: 0.7) |
top_p |
Nucleus sampling |
max_tokens |
Max tokens to generate |
frequency_penalty |
Repetition control |
presence_penalty |
Topic diversity |
🔄 Experiment Setup
1. No Prompt Template + Default Config
- Basic user input
- Uses Groq defaults
- For benchmarking
2. With Prompt Template + Tuned Config
- Structured input (e.g., role, intent, constraints)
- Custom temperature and token limits
- Optimized for domain-specific responses
🚀 Quickstart
Step 1: Clone the repo
git clone https://github.com/your-username/telecom-support-llm.git
cd telecom-support-llm