Mistral giving random outputs when hit consequently multiple times
#190
by
parthhdikshit
- opened
I have deployed Mistral 7b as an endpoint on AWS Sagemaker. When I hit that endpoint with multiple requests, mistrals breaks and gives me random, blank, or special characters (dashes or underscores) as a response. My program doesn't require remembering the history or context of previous hits, every hit is an independent hit. What could be the reason for this?