号称可以成为 ChatGPT 平替的开源模型 “Dolly”
ChatGPT AI

> 
> 你需要一款 ChatGPT 的平替？还得是开源的？看起来我们已经被卷入了与 ChatGPT 的开源大战。
> 
> 
> 


![open source model dolly](/data/attachment/album/202303/31/095413k2xax88kyki1jqg8.jpg)


Databricks 这家软件公司，在各个领域都有所建树，尤其是在数据仓库和基于人工智能的解决方案方面。


最近，随着 ChatGPT 横空出世，Meta、谷歌甚至 Mozilla 都开始效仿 ChatGPT。


而现在，Databricks 开源了其 <ruby> <a href="https://en.wikipedia.org/wiki/Large_language_model?ref=its-foss-news">  大型语言模型 </a> <rt>  large language model </rt></ruby>（LLM）“Dolly”，也正在以自己的方式进行尝试。


我们一起来看看它。


**发生了什么？** 在最近的公告中，Databricks 介绍了他们号称 “**廉价构建**” 的 LLM，使用 [EleutherAI](https://www.eleuther.ai/?ref=its-foss-news) 的已经开源的参数 [模型](https://huggingface.co/EleutherAI/gpt-j-6B?ref=its-foss-news) 提供功能。


他们在该模型基础上稍作调整，赋予了 Dolly 指令诸如头脑风暴和文本生成的能力。


当你拿它与 GPT-3 中的 **1750 亿个参数** 比较时，Dolly 的 **60 亿个参数** 就可能显得微不足道。


但是，当 Databricks 的人看到即使数据量与 GPT-3 相差这么多，Dolly 也能 **展示很多与 ChatGPT 相同的能力** 时，他们感到非常震惊。


下面是他们展示的其中一个例子：


![a screenshot of how dolly performs in an open question and answer scenario](/data/attachment/album/202303/31/095418ryvn7bib74vi79r9.jpg)


原始模型使用了 [Alpaca](https://crfm.stanford.edu/2023/03/13/alpaca.html?ref=its-foss-news) 的数据，该模型由斯坦福大学以 Meta 的 [LLaMA](https://ai.facebook.com/blog/large-language-model-llama-meta-ai/?ref=its-foss-news) LLM 为基础建立。


但是，正如你所看到的，原始模型产生了一个非常杂乱无章的结果，而 Dolly，通过不同的模型和调整，能够产生一个更为可用的答案。



> 
> ? 有趣的事实：“<ruby> 多莉 <rt>  Dolly </rt></ruby>” 名字取自世界上第一只克隆羊。
> 
> 
> 


**为什么是现在？** 根据 Databricks 的说法，他们认为 \*\*许多公司更愿意建立自己的模型，\*\*而不是将数据发送给某个紧紧掌握模型只对外提供 API 的集中式供应商。


许多公司可能不愿意将他们最敏感的数据交给第三方，然后在模型质量、成本和所需行为方面进行各种权衡。


**你想看看吗？**


当然，但有一个问题。


你必须 **使用他们的平台来使用 Dolly**，他们已经开源了一个 [Databricks 笔记本](https://github.com/databrickslabs/dolly?ref=its-foss-news)，可以帮助你在 Databricks 上构建它。


此外，如果你想获得训练好的权重，你必须联系他们。不过我不确定他们是否会免费提供使用权。


总而言之，这种开源其模型的举动应该对其他公司有好处，可以保护他们的数据、节省运营成本，其他公司也能使用它创建自己的模型。


你可以查看其 [公告博客](https://www.databricks.com/blog/2023/03/24/hello-dolly-democratizing-magic-chatgpt-open-models.html?ref=its-foss-news)，以了解更多技术细节和其他计划。




---


via: <https://news.itsfoss.com/open-source-model-dolly/>


作者：[Sourav Rudra](https://news.itsfoss.com/author/sourav/) 选题：[lkxed](https://github.com/lkxed/) 译者：[lxbwolf](https://github.com/lxbwolf) 校对：[wxy](https://github.com/wxy)


本文由 [LCTT](https://github.com/LCTT/TranslateProject) 原创编译，[Linux中国](https://linux.cn/) 荣誉推出


OK
![](/assets/images/pikapods-banner-v3.webp)


![](/assets/images/pikapods-banner-v3.webp)

Databricks is a software company that has established itself in a variety of sectors, with data warehousing, and AI-based solutions being their primary focus.

In recent times, we have seen the meteoric rise of ChatGPT, resulting in similar efforts from the likes of Meta, Google, and even Mozilla.

And now, Databricks is trying in their own way by open-sourcing its [large language model](https://en.wikipedia.org/wiki/Large_language_model?ref=news.itsfoss.com) (LLM) 'Dolly'.

Let's take a look at it.

**Suggested Read **📖

[Mozilla Plans to Work On Open-Source AI to Develop Solutions like ChatGPTMozilla’s getting into the A.I. game? I think we need more of this!](https://news.itsfoss.com/mozilla-open-source-ai/)![](https://news.itsfoss.com/content/images/2023/03/mozilla-ai-opensource.png)


![](https://news.itsfoss.com/content/images/2023/03/mozilla-ai-opensource.png)

**What is happening?: **In a recent announcement, Databricks introduced what they term as **'a cheap-to-build'** LLM that functions by using an existing open-source parameter [model](https://huggingface.co/EleutherAI/gpt-j-6B?ref=news.itsfoss.com) by [EleutherAI](https://www.eleuther.ai/?ref=news.itsfoss.com).

The model has been slightly tweaked to give Dolly instruction following capabilities such as brainstorming and text generation.

When you compare the **175 billion parameters** in GPT-3, Dolly's** 6 billion parameters** might seem puny in comparison.

But, the folks over at Databricks were surprised when they saw that even with this much data, Dolly was **able to** **exhibit many of the same capabilities as ChatGPT**.

Below is one of the examples they showcased:

![a screenshot of how dolly performs in an open question and answer scenario](https://news.itsfoss.com/content/images/2023/03/Dolly_AI.jpg)

The original model used data from [Alpaca](https://crfm.stanford.edu/2023/03/13/alpaca.html?ref=news.itsfoss.com), the model built by Stanford using the [LLaMA](https://ai.facebook.com/blog/large-language-model-llama-meta-ai/?ref=news.itsfoss.com) LLM by Meta as a base.

But, as you can see, the original model produced a very haphazard result, whereas Dolly, with its different model and tweaks, was able to produce a far usable answer.

**Why now?: **According to Databricks, they think that **many companies would prefer to build their own model** rather than sending data to some centralized provider who has locked their model behind an API.

Many companies might not be comfortable handing over their most sensitive data to a third party, and then there are the various tradeoffs in terms of model quality, cost, and desired behavior.

**Do you want to check it out?**

Sure, but there's a catch.

You will have to **use their platform to use Dolly**, they have open-sourced a [Databricks notebook](https://github.com/databrickslabs/dolly?ref=news.itsfoss.com) that will help you build it on Databricks.

Moreover, if you want to get access to the trained weights, you will have to contact them. I am uncertain whether they will provide access to it for free, though.

In a nutshell, this move to open-source their model should be good for companies to help safeguard their data, save on operating costs, and more by enabling them to create their own model.

You can check out the[ announcement blog](https://www.databricks.com/blog/2023/03/24/hello-dolly-democratizing-magic-chatgpt-open-models.html?ref=news.itsfoss.com) to learn more about the technical details and other plans for it.

**Suggested Read **📖

[ChatGPT but Open Source: That’s What This Project is Aiming ForWill we finally have a working open-source alternative to ChatGPT? This looks promising!](https://news.itsfoss.com/open-source-chatgpt/)![](https://news.itsfoss.com/content/images/2023/03/opensource-alternative-to-chatGPT.png)


![](https://news.itsfoss.com/content/images/2023/03/opensource-alternative-to-chatGPT.png)

## More from It's FOSS...

- Support us by opting for
[It's FOSS Plus](https://itsfoss.com/#/portal/signup)membership. - Join our
[community forum](https://itsfoss.community/). - 📩 Stay updated with the latest on Linux and Open Source. Get our
[weekly Newsletter](https://itsfoss.com/newsletter/).