Mark Zuckerberg just revealed that Meta is already training post-Watermelon models.

for context, Watermelon is the unreleased successor to Avocado/Spark, and will be the biggest model Meta has built so far. It’s reportedly being trained with roughly 10X more compute.

“We're using Prometheus (Meta’s 1-gigawatt AI compute cluster) to now scale the post-watermelon models. Um we're past watermelon.”

----

From "Sources Podcast and @alexeheath YouTube channel, (full video link in comment)