TPU 8tx and TPU 8i Max

(blog.google)

183 points | by _benx_ 3 hours ago ago

34 comments

  • _kst_ 29 minutes ago

    The article mentions "TPU" 79 times, but never explains what the term means.

    (It's "Tensor Processing Unit".)

    • zamadatix a few seconds ago

      There does come a point where if you're in the follow up article discussing what's new in 2 new variants of the 8th generation of a niche product for that vendor it stops being reasonable from them explaining what everything means each time and starts being reasonable to either click the links to the earlier introduction or search around for it to get a proper understanding as if you didn't know "TPU" was "Tensor Processing Unit" then there is a lot more you want to know before reading this article.

    • hellohello2 25 minutes ago

      Maybe they assumed you would just Google it ;)

  • gnabgib 2 hours ago

    Title: Our newest TPUs: 8tx and 8i Max, built for the agentic era Small discussion previously (16 points, 4 comments) https://news.ycombinator.com/item?id=50425018

  • mekpro 7 minutes ago

    I wish Google Colab start to provide new TPU model, the most powerful we can get on Colab is still v6e-1 which is too small for serious work.

  • xiaoyu2006 an hour ago

    And again no one can use it.

    • asdfasgasdgasdg an hour ago

      Plenty of people and firms use TPUs, both directly and indirectly. You can rent them via Google Cloud. Apple Intelligence and Anthropic both use them. And of course your Gemini traffic is using the TPUs as well.

    • Yajirobe 38 minutes ago

      I know right?

      > TPUs are now a rapidly growing business with nearly 100 customers

      ‘Nearly 100 customers’ in 10 years isn’t very impressive

      • faangguyindia 31 minutes ago

        Each customer spending a billion dollars is impressive

      • IncreasePosts 15 minutes ago

        4 customers make up a majority of nvidias revenue

    • ur-whale an hour ago

      > And again no one can use it.

      Did you by chance fail to read who builds these things?

  • qntty 2 hours ago

    Why doesn’t Google sell these?

    • Twirrim 12 minutes ago

      They are finally starting to. Oracle just announced a week or so ago that they're going to be introducing TPUs to their cloud next year for customers to use.

      https://www.msn.com/en-us/technology/tech-companies/oracle-e...

      Interesting times ahead with a number of chip makers now vying for this market. TPUs are a mature chip now which gives some strong advantage. At the same time as the TPU announcement, they also mentioned they'll be deploying Cerebras systems as well.

    • tybit an hour ago
    • 0cf8612b2e1e an hour ago

      It’s a competitive advantage which allows them to deliver lower cost per inference. If quality continues to asymptote, best value becomes most interesting to consumers.

      Then again, if they can provide competition to Nvidia, it may force Nvidia to lower prices across the board.

    • kccqzy an hour ago

      They do. In particular they sold to Anthropic.

  • ur-whale an hour ago

    Where's the watt/token or $/token figures for each of these?

    And how does each compare to their NVDA price equivalent?

  • a1o an hour ago

    Is it just me or the write up have very little information? I can’t grasp how this compare to other tech.

    • danpalmer 38 minutes ago

      This is a marketing announcement, it's got the right level of info for the target audience. If you want more technical detail there's loads available elsewhere online.

  • bigwheels an hour ago

    TFA makes some claims but offers zero data on specs or anything else. Is this a press release?

  • hi_hi 2 hours ago

    Typical Google. A literal headline “Opening up TPUs to every developer” but zero information or links on how I, a developer, can use said TPUs.

    • asdfasgasdgasdg 43 minutes ago

      There are various bits of this blog post that detail how they’re making it easier for devs to use TPUs, particularly the discussion of TorchTPU and the attendant link. That being said if you’re looking for a link to a tutorial I think it’s easily findable on Google. “Tpu tutorial Google cloud” or “Tpu developer hub” would be good queries. For example [this](https://docs.cloud.google.com/compute/docs/tpus/quickstart-c...) is at least somewhat responsive.

    • 2 hours ago
      [deleted]
    • jiggawatts 2 hours ago

      I don’t know why everyone keeps complaining! It’s just a simple twenty-seven step process neatly spread across three portals! (Documentation coming soon.)

      • genghisjahn an hour ago

        You’ll know sign up is complete when you started getting charged.

  • oofbey 34 minutes ago

    > While we’ve always co-designed our TPUs in partnership with Google DeepMind

    I love it when companies expose their org charts publicly like this. As if anybody cares that they think about Google and DeepMind as different.

  • yieldcrv an hour ago

    I’m guessing their skipping the T8 Pro model for the T9

    /sarcasm at the unoriginal naming scheme

    • sterlind an hour ago

      I'm hearing good things about the T1000. it's an ideal platform for highly survivable autonomous agents.

  • dude250711 an hour ago

    I am ready for the post-agentic era now... The agentic era turned out to be the most proclaimed era in the history... It's time for a change.

    • ryandrake an hour ago

      I can't take anyone who uses "agentic" seriously.

  • waterTanuki an hour ago

    A product announcement page with 0 links to purchase or ways to purchase is useless.

    • Alien1Being 40 minutes ago

      So an announcement about a hypothetical highly effective new chemotherapy for glioblastoma, with no links for you to buy it yourself is useless ?

      You are not the target market.

      • waterTanuki 36 minutes ago

        Then why is the page available for me to view?

  • jfckenfishf 2 hours ago

    The stock market really hates $GOOG doesn't it?