title: MoA Ollama-UI
emoji: ⚡
colorFrom: indigo
colorTo: green
sdk: docker
header: mini
pinned: false
app_port: 1338
short_description: MoA implementation
#MoA (https://arxiv.org/abs/2406.04692) implementation on top of Ollama WebUI Mobile use is currently not supported. It's also worth mentioning that despite the repo (having built on top of Ollama WebUI) having remnants of proxy APIs and other features like the possibility of adding jailbreaks, as result of making tweaks for MoA they are functionally disabled and can be safely removed from the codebase if you intend so, perhaps if wishing to run it locally. If you intend to use it locally or duplicate to higher tier hardware, it's highly recommended to swap the aggregator and reference models to the ones mentioned in the paper as it's really easy to do given they're all ollama supported models. -E
From here on is the typical Ollama WebUI readme:
The purpose of this LLM repository is have an LLM locally. If you dont have
internet and you need al llm this is a solution.
Table of Contents
- To-Do List
- Getting Started
- Running the Application
- Docker
- Incorporated Projects
- Star History
- Legal Notice
Getting Started :white_check_mark:
To get started with this project, you'll need download ollama and then clone the repository and have Python installed on your system.
Cloning the Repository :inbox_tray:
Run the following command to clone the repository:
git clone https://github.com/ruslanmv/ollama-webui.git
Install Dependencies :wrench:
Navigate to the project directory:
cd ollama-webui
Install the dependencies:
pip install -r requirements.txt
Running the Application :rocket:
To run the application, run the following command:
python run.py
Access the application in your browser using the URL:
http://127.0.0.1:1338
or
http://localhost:1338
Docker 🐳
Prerequisites
Before you start, make sure you have installed Docker on your machine.
Running the Docker
Pull the Docker image from Docker Hub:
docker pull ruslanmv/ollama-webui
Run the application using Docker:
docker run -p 1338:1338 ruslanmv/ollama-webui
Access the application in your browser using the URL:
http://127.0.0.1:1338
or
http://localhost:1338
When you're done using the application, stop the Docker containers using the following command:
docker stop <container-id>
Incorporated Projects :busts_in_silhouette:
I highly recommend visiting and supporting both projects.
Star History
Legal Notice
This repository is not associated with or endorsed by providers of the APIs contained in this GitHub repository. This project is intended for educational purposes only. This is just a little personal project. Sites may contact me to improve their security or request the removal of their site from this repository.
Please note the following:
Disclaimer: The APIs, services, and trademarks mentioned in this repository belong to their respective owners. This project is not claiming any right over them nor is it affiliated with or endorsed by any of the providers mentioned.
Responsibility: The author of this repository is not responsible for any consequences, damages, or losses arising from the use or misuse of this repository or the content provided by the third-party APIs. Users are solely responsible for their actions and any repercussions that may follow. We strongly recommend the users to follow the TOS of the each Website.
Educational Purposes Only: This repository and its content are provided strictly for educational purposes. By using the information and code provided, users acknowledge that they are using the APIs and models at their own risk and agree to comply with any applicable laws and regulations.
Copyright: All content in this repository, including but not limited to code, images, and documentation, is the intellectual property of the repository author, unless otherwise stated. Unauthorized copying, distribution, or use of any content in this repository is strictly prohibited without the express written consent of the repository author.
Indemnification: Users agree to indemnify, defend, and hold harmless the author of this repository from and against any and all claims, liabilities, damages, losses, or expenses, including legal fees and costs, arising out of or in any way connected with their use or misuse of this repository, its content, or related third-party APIs.
Updates and Changes: The author reserves the right to modify, update, or remove any content, information, or features in this repository at any time without prior notice. Users are responsible for regularly reviewing the content and any changes made to this repository.
By using this repository or any code related to it, you agree to these terms. The author is not responsible for any copies, forks, or reuploads made by other users. This is the author's only account and repository. To prevent impersonation or irresponsible actions, you may comply with the GNU GPL license this Repository uses.