autogen/website/blog/2023-07-14-Local-LLMs/index.md
Preparations  ### Clone FastChat  FastChat provides OpenAI-compatible APIs for its supported models, so you can use FastChat as a local drop-in replacement for OpenAI APIs. However, its code needs minor modification in order to function properly.  ```bash git clone https://github.com/lm-sys/FastChat.git cd FastChat ```  ### Download checkpoint  ChatGLM-6B is an open bilingual language model based on General Language Model (GLM) framework, with 6.2 billion parameters. ChatGLM2-6B is its second-generation version.  Before downloading from HuggingFace Hub, you need to have Git LFS [installed](https://docs.github.com/en/repositories/working-with-files/managing-large-files/installing-git-large-file-storage).  ```bash git clone https://huggingface.co/THUDM/chatglm2-6b ``` 