跳到正文
Lisa Su· @LisaSu · X·· 3 小时前AI 评分59
AI 导读

Lisa Su 转发并祝贺 Google Cloud 发布第八代 TPU 新品,包括面向超大上下文窗口和高机架计算密度的 TPU 8i Max,以及面向安全机密推理的 TPU 8tx。Google 称这是首次在一年内推出四款不同 TPU 系统,并开放 TorchTPU 原生运行 PyTorch 与 Hugging Face 模型、开源 TPU Sync 降低 KV 传输延迟超 90%、Agent Compute Engine 减少闲置算力。Lisa Su 补充 AMD EPYC 担任 TPU 8tx 的主机处理器。

正文 · 原文

Congratulations to our friends at @googlecloud and @AminVahdat! We’re proud to partner with you, with @AMD EPYC serving as the host processor for TPU 8tx.

引用Amin Vahdat@AminVahdat

Thrilled to share a big milestone from our AI & Infrastructure team at @Google.

Today we’re expanding our 8th generation TPU portfolio with:

  • TPU 8i Max: Built for massive context windows and the highest compute density per rack
  • TPU 8tx: Purpose-built for secure, confidential inference

This marks the first time we’ve introduced four distinct TPU systems in a single generation, in one year.

For developers, hardware is only as good as the software stack. And we want you to be able to build with TPUs as easily and efficiently as we do at Google. You can now:
↳ Run native PyTorch & Hugging Face models via TorchTPU (zero code rewrites)
↳ Cut KV transfer latency >90% with open-source TPU Sync
↳ Eliminate idle compute waste with Agent Compute Engine

Read more about our newest TPUs on our blog: bit.ly/3VfETPR

I look forward to connecting with builders, researchers, engineers and organizations pushing the boundaries of AI and computing!

在 X 查看被引用的帖子

来源:Lisa Su · x.com