Hugging Face 开源了 DNA 模型 Carbon-X,基于 Qwen3-14B 用 300B tokens 的 DNA、英文及交错数据中训练,并采用英文 BPE 加 DNA 6-mer 的混合 tokenizer。
Frontier labs are advancing the capabilities in AI for biology but preventing the good guys (scientists, academia, non-profits, health agencies,...) to use, study and understand it with widespread but shallow guardrails that the bad guys are bypassing easily (blocked me to proofread this tweet for example 😅).
This will automatically create massive assymetry and risks in the coming years, just like in cybersecurity, especially now that frontier labs are building wet labs (HF cybersecurity scenario for biology when?).
This is why we created Carbon-X, the best open-source DNA model by midtraining Qwen3-14B on 300B tokens of DNA, English and interleaved data. We also used a hybrid tokenizer that tokenizes English with BPE and DNA with a 6-mer tokenizer.
As a result, Carbon-X outperforms all open language models we evaluated on five benchmarks of DNA understanding and generation. This is a 27-point improvement over Qwen3-14B, showing how much a language model can gain from DNA training. It is also API frontier level at 1,800x less cost than GPT 6.1 Sol!
We hope Carbon-X helps researchers explore DNA in new ways. Releasing it openly means anyone can study its capabilities, limitations, and risks. Let's make the AI biology frontier open-source to make it safe and impactful for the whole world (not just a few companies).
Apache 2.0 Model on @huggingface: https://huggingface.co/HuggingFaceBio/Carbon-X
来源:clem 🤗 · x.com