跳到正文
Arthur Mensch· @arthurmensch · X·· 2 小时前AI 评分40

Mistral CEO 称强大 AI 模型应回归公共所有

AI 导读

我相信人类会确保强大的 AI 模型回归公共所有

正文 · 原文

I am confident humanity will ensure that powerful AI models are returned to the commons

引用Igor Babuschkin@ibab

There’s a way of thinking about the ethics of building LLMs which deserves much more attention:

During pretraining of LLMs we distill vast amounts of humanity’s collective work from the internet into the model’s weights. When that knowledge was created, we were not aware that LLMs would be possible. The content was released for others to read freely, essentially as a common good. This includes not only all of our writing, but also the vast amounts of open source code on platforms like GitHub.

Once LLMs were discovered, AI companies were able to access the content easily (in the trillions of tokens), train powerful models and then sell them back to us for hundreds of billions of dollars. They took something we released for free for the common good, and then turned it into trillion-dollar companies to primarily benefit themselves. Coding models in particular, trained from GitHub, are very useful and highly profitable.

At the same time, I believe that we can’t make a strong copyright claim on all of the training data. LLMs, similar to humans, do not perfectly reproduce the source text, but rather learn from it and then synthesize new content. If we wanted to forbid LLMs from learning from it, we would need to answer why humans are allowed to do the same.

There is an elegant way to resolve this tension: We should return the resulting models to the commons, releasing them openly for anyone to download and use freely. This way the data is not repurposed for a few people’s profit, but merely transformed into a more useful form for society. This is the core idea behind open-weight models, which are gathering momentum and are starting to rival the models of proprietary AI labs.

After working in the AI industry for many years, building many LLMs, I’ve come to strongly believe that this is the right point of view.

Although most people today don’t seem to think along these lines, I believe that in the fullness of time this will become the majority opinion and the current state of AI development will look odd in retrospect. Provided the models haven’t taken over at that point.

在 X 查看被引用的帖子

来源:Arthur Mensch · x.com