S. Dale Morrey PRO
sdalemorrey
AI & ML interests
I solve problems and build tools
Recent Activity
liked
a Space
17 days ago
Steveeeeeeen/Zonos
replied to
csabakecskemeti's
post
about 1 month ago
Check out my idea:
LLmaaS - Local LLM as a Service
With LLmaaS, I propose leveraging locally running LLMs as a service, providing a standardized way for websites to access and utilize them for LLM-powered operations directly on the user’s device.
Demo, code, more detailed description.
https://devquasar.com/llmaas/
https://github.com/csabakecskemeti/LLmaaS
https://youtu.be/OOWGr8jcP5Q
Call for contributors
Join me a develop the LLmaaS proxy to make this a generic purpose tool to leverage local LLMs on web. Build in security measures.
I'm looking for help to make the proxy more generic support multiple local LLM services without any change on the HTML side.
Also looking for ideas how to make the HTML par more modular and easy to use.
updated
a model
about 2 months ago
syntropiq/anah-v2-Q8_0-GGUF
Organizations
sdalemorrey's activity
Best embeddings model I've seen!
1
#2 opened about 2 months ago
by
sdalemorrey

This one is great!
#3 opened about 2 months ago
by
sdalemorrey

What's with the AI Assistant?
#3 opened about 2 months ago
by
sdalemorrey

Is LM Studio support the ‘mllama’ architecture?
6
#80 opened 4 months ago
by
wilsonchou1996

🚩 Report: Legal issue(s)
7
#9 opened 3 months ago
by
nightflightdk
This model needs more training to be really useful.
1
#2 opened 7 months ago
by
sdalemorrey

What prompt template?
3
#2 opened 7 months ago
by
sdalemorrey

Does this come in an English speaking version?
3
#7 opened 7 months ago
by
sdalemorrey

Please provide ggml variants for local execution
1
#3 opened 7 months ago
by
TobDeBer
Recommended hardware?
13
#1 opened 7 months ago
by
sdalemorrey

Minimum RAM requirements?
#3 opened 7 months ago
by
sdalemorrey

Why Mistral?
2
#1 opened 7 months ago
by
sdalemorrey

More explanation on performance?
1
#1 opened 7 months ago
by
sdalemorrey

The Marquis de Sade would blush
2
#2 opened 8 months ago
by
sdalemorrey

Use in MLC chat?
#1 opened 8 months ago
by
sdalemorrey

Can this be used with Foocus also?
1
#24 opened 8 months ago
by
SaltyNSpicy
Recommended settings?
#1 opened 10 months ago
by
sdalemorrey

Usecase
13
#8 opened 10 months ago
by
takeraparterer

IQ4_NL please?
1
#1 opened 10 months ago
by
sdalemorrey

Paper?
#1 opened 10 months ago
by
sdalemorrey
