开源音频编辑器 Audacity 的 AI 工具来了
Audacity AI
![](/data/attachment/album/202401/16/135942ybxu5aergzk7r8ga.jpg)



> 
> Audacity 现在配备了新的 AI 工具。
> 
> 
> 


在过去的几年中，我们已经看到了 AI 的显著发展，包括将 AI 驱动的功能添加到各种流行的工具中。而且，我们在 [2024 年 Linux 和开源预测](https://news.itsfoss.com/predictions-linux-open-source-2024/) 中已经提到了更多的人工智能。


这次是 Audacity，[Linux 的最佳音频编辑之一](https://itsfoss.com/best-audio-editors-linux/)，迎来了 AI。现在，用户可以通过利用 AI 的力量来增强其音频编辑体验。


让我们来看看这些迷人的功能都有哪些。


### 英特尔打造 AI 工具 ?️


英特尔公司推出了由 AI 驱动的处理语音音频和音乐的新功能。


这些功能是 **OpenVino** 插件套件的一部分。对于那些不知道的人来说，英特尔的 OpenVino 是一个 AI 框架，有助于加速深度学习模型。


值得注意的一个很酷但也很重要的方面是，所有这些功能在本地的 PC 上运行！ 更具体地说，PC 的 CPU 或 GPU 将用于处理部分。


#### 播客编辑


曾经想快速转录甚至翻译音频吗？


由 OpenAI 的 Whisper 支持的转录功能可以让用户做到这一点。


![Transcription | Source: GitHub Intel](/data/attachment/album/202401/16/140007f824iph1hhjant20.png)


* 它能根据给定的音频样本生成包含转录/翻译文本的新标签音轨。
* 翻译将始终以英语产生输出，而转录将以与源音频相同的语言产生输出。
* 目前，默认情况下仅支持 *Whisper Base* 模型。稍后可能会支持更多模型。


与现有的 “噪音去除”效果类似，**“噪音抑制”** 可帮助去除口语音频样本中不需要的背景噪音。


* 由于它是由 AI 提供动力的，因此你可以期望此功能的效果优于噪音去除。
* 目前，默认情况下仅支持 *denseunet* 模型。稍后可能会支持更多模型。


#### 音乐生成


是的，你没看错：现在，你可以在机器内生成新音乐！


**音乐生成** 允许用户生成音乐片段。这要归功于一个名为 **Riffusion** 的开源项目，这是一个基于 **Stable Diffusion** 的音乐生成模型（一种流行的开源模型，用于生成图像。）


![Music Generation | Source: GitHub Intel repo](/data/attachment/album/202401/16/140008c5gn222g3mvpkeg6.png)


* 你通过给出文本提示并调整其他一些参数（例如持续时间）来生成音乐。
* 在文本提示符中，你指定要生成的音乐流派，AI 将尽力在生成音乐时保持这种类型。
* 你可以选择在默认的简单模式和可选的高级模式之间切换，以进行更多的控制，例如指定开始提示和结束提示。


此外，你甚至可以通过**音乐风格混音**，选择音乐曲目的一部分，对音乐进行混音！


#### 音乐分离


如果你想为自己喜欢的歌曲创建自己的器乐曲目，该怎么办？也许还能与朋友来一场有趣的卡拉 OK 呢？


**音乐分离**使你可以将歌曲分为声音或乐器版本。提供了两种分离模式：


![Music Separation. Source: github.com/intel/openvino-plugins-ai-audacity](/data/attachment/album/202401/16/140009rvh6292vf9y98vgy.png)


* 2-Stem 为人声和器乐制作两个新音轨。
* 4-Stem 可生成四条新音轨，包括人声、鼓声、贝司声，最后一条是其他乐器声。


### 如何使用 AI 工具？ ?


如果你是 Linux 用户，请等一等。


虽然该插件的 [Windows 版本](https://github.com/intel/openvino-plugins-ai-audacity/releases) 可供下载，但其 Linux 对应版本暂时还不可用。


如果你仍然想尝试一下，则需要自己编译该项目。[你可以参考此的官方说明](https://github.com/intel/openvino-plugins-ai-audacity/blob/main/doc/build_doc/linux/README.md)。


希望 Linux 构建很快到来！?


? 你觉得 Audacity 的这些新人工智能功能怎么样？请在评论中告诉我们你的想法！




---


via: <https://news.itsfoss.com/audacity-ai-tools/>


作者：[Rishabh Moharir](https://news.itsfoss.com/author/rishabh/) 选题：[lujun9972](https://github.com/lujun9972) 译者：[geekpi](https://github.com/geekpi) 校对：[wxy](https://github.com/wxy)


本文由 [LCTT](https://github.com/LCTT/TranslateProject) 原创编译，[Linux中国](https://linux.cn/) 荣誉推出


OK
![](/assets/images/pikapods-banner-v3.webp)


![](/assets/images/pikapods-banner-v3.webp)

Over the past couple of years, we have seen notable developments in AI, including AI-powered functionalities being added to various popular tools. And, more AI is something we already mentioned in our [predictions for Linux and open source for 2024](https://news.itsfoss.com/predictions-linux-open-source-2024/).

This time it is Audacity, [one of the best audio editors for Linux](https://itsfoss.com/best-audio-editors-linux/?ref=news.itsfoss.com), that has welcomed AI. Users can now enhance their audio editing experience by leveraging the power of AI.

Let's take a look at what these fascinating features bring to the table.

## Intel Makes AI Tools 🛠️

The folks over at Intel have introduced new features for working with spoken audio and music, all powered by AI.

These features are a part of the **OpenVINO** plugin suite. For those unaware, Intel's OpenVINO is an AI framework that helps accelerate deep-learning models.

One cool, yet important, aspect to note is that all these features run on your PC locally! More specifically, the PC's CPU or GPU will be utilized for the processing part.

### Podcast Editing

Ever wanted to quickly transcribe or even translate the audio?**Transcription**, which is powered by OpenAI's Whisper, allows users to do exactly this.

![openvino whisper trascription](https://github.com/intel/openvino-plugins-ai-audacity/raw/main/doc/feature_doc/whisper_transcription/properties.png)

- It produces a new label track that includes transcribed/translated text based on a given audio sample.
- Translation will always produce the output in English, while transcribing will produce the output in the same language as the source audio.
- For now, only the
*Whisper Base*model is supported by default. Support for more models may arrive later.

Similar to the existing Noise Removal effect, there's **Noise Suppression **which helps remove unwanted background noise from a spoken audio sample.

- Since it's powered by AI, you can expect this feature to perform better than the Noise Removal effect.
- For now, only the
*denseunet*model is supported by default. Support for more models may arrive later.

### Music Generation

Yes, you read it right: You can now generate new music right inside your machine!

**Music Generation **allows users to generate a snippet of music. This is possible thanks to an open-source project called **Riffusion**, which is a music generation model based on **Stable Diffusion **(a popular open-source model used to generate images.)

![openvino music generation](https://github.com/intel/openvino-plugins-ai-audacity/raw/main/doc/feature_doc/music_generation/simple_properties.png)

- You generate music by giving a text prompt and adjusting some other parameters like the duration.
- In the text prompt, you specify the genre of music to be generated and the AI will try its best to maintain the genre when generating music.
- There exists an option to switch between the default Simple mode and an optional Advance mode for more control like specifying a start prompt and end prompt.

Furthermore, you can even remix music with **Music Style Remix** by selecting a portion of a music track!

### Music Separation

What if you wished to create your own instrumental track of your favourite song? Maybe even have a fun karaoke session with your friends?

**Music Separation** allows you to split a song into either a vocal or instrumental version. There are two separation modes offered:

![](https://github.com/intel/openvino-plugins-ai-audacity/raw/main/doc/feature_doc/music_separation/properties.png)

- 2-Stem produces two new tracks for vocals and instrumental.
- 4-Stem produces four new tracks for vocals, drums, bass and the last one of other instruments combined.

## How to Use The AI Tools? 📥

If you're a Linux user, hold on to your horses.

While the [Windows version](https://github.com/intel/openvino-plugins-ai-audacity/releases?ref=news.itsfoss.com) of the plugin is available for download, its Linux counterpart isn't available... just yet.

If you still want to try it out, you will need to compile the project yourself. [You can refer to the official instructions for this.](https://github.com/intel/openvino-plugins-ai-audacity/blob/main/doc/build_doc/linux/README.md?ref=news.itsfoss.com)

Hopefully, a Linux build arrives soon!🤞

*💬 What do you think about these new AI goodies for Audacity? Let us know your thoughts in the comments!*

## More from It's FOSS...

- Support us by opting for
[It's FOSS Plus](https://itsfoss.com/#/portal/signup)membership. - Join our
[community forum](https://itsfoss.community/). - 📩 Stay updated with the latest on Linux and Open Source. Get our
[weekly Newsletter](https://itsfoss.com/newsletter/).