跳到正文
Sundar Pichai· @sundarpichai · X·· 8 小时前AI 评分57
AI 导读

Google 宣布扩充第八代 TPU 产品组合,新增 TPU 8i Max(面向大上下文窗口和单机架最高算力密度)与 TPU 8tx(面向安全机密推理),是一代之内一年内推出四套不同 TPU 系统的首次。配套软件栈方面,开发者可通过 TorchTPU 原生运行 PyTorch 和 Hugging Face 模型且无需改写代码,开源 TPU Sync 可将 KV 传输延迟降低 90% 以上,Agent Compute Engine 用于消除闲置算力浪费。Sundar Pichai 转发时强调,与等待传统半导体周期不同,硬件工程师与 Google DeepMind 协同设计使创新速度更快。

正文 · 原文

Four distinct TPU systems in a single generation in one year! Instead of waiting years for a traditional semiconductor cycle, hardware engineers co-designing systems alongside Google Deepmind means we can keep innovating quickly for customers.

引用Amin Vahdat@AminVahdat

Thrilled to share a big milestone from our AI & Infrastructure team at @Google.

Today we’re expanding our 8th generation TPU portfolio with:

  • TPU 8i Max: Built for massive context windows and the highest compute density per rack
  • TPU 8tx: Purpose-built for secure, confidential inference

This marks the first time we’ve introduced four distinct TPU systems in a single generation, in one year.

For developers, hardware is only as good as the software stack. And we want you to be able to build with TPUs as easily and efficiently as we do at Google. You can now:
↳ Run native PyTorch & Hugging Face models via TorchTPU (zero code rewrites)
↳ Cut KV transfer latency >90% with open-source TPU Sync
↳ Eliminate idle compute waste with Agent Compute Engine

Read more about our newest TPUs on our blog: bit.ly/3VfETPR

I look forward to connecting with builders, researchers, engineers and organizations pushing the boundaries of AI and computing!

在 X 查看被引用的帖子

来源:Sundar Pichai · x.com