Announcing Tinker

(thinkingmachines.ai)

97 points | by pr337h4m 5 hours ago ago

47 comments

  • bastawhiz 3 minutes ago

    Absolutely unacceptable that their TOS basically gives them unrestricted access to your datasets, as far as I read it. The terms let them use your datasets for pretty much whatever they decide they want to do with it (though they do say they would anonymize the data, which isn't especially helpful). The TOS leaves a lot of wiggle room for them to do pretty much whatever they want to the data.

    I wouldn't touch this until they get serious about having real assurances that they're not going to access customer data without a real, justifiable reason. If Amazon gave themselves free reign to read S3 data it would be outrageous, this is basically the same thing.

  • rotskoff 4 hours ago

    My research group at Stanford has been alpha testing Tinker, it's both very useful and also really technically impressive in my opinion. It's a unified framework for post-training models and it abstracts almost all of the complexity of managing these jobs across resources. That it manages to do this while also allowing a lot of algorithmic flexibility is pretty unique.

    • ahmedfromtunis 3 hours ago

      Silly question: how is it different from, say, hf's transformers and similar libraries and APIs?

      • stephenroller 3 hours ago

        with hf transformers, you still need to manage GPUs

  • paxys 3 hours ago

    Interesting that their first product is an infrastructure play. Is it really so hard to set up a fine-tuning pipeline for yourself that a $12 billion startup with unlimited hype needs to be offering it? Maybe they have figured, whether correctly or not, that building AI tooling is going to be more lucrative than the AI itself.

    • alyxya 19 minutes ago

      The thing about this that’s interesting to me is that it can be used as a foundation for products they or other people make that combine real time RL rewards and fine tuning to improve the model. I see a lot of potential here compared to the standard paradigm of ChatGPT wrappers that involve tweaking the prompt or harness to improve it, which is a lot more constrained.

  • bayarearefugee 3 hours ago

    Commonly attempting the "private beta with a waitlist" pseudo-release model (until they finally learned their lesson relatively recently) is a large part of how google fumbled the LLM ball to OpenAI and others.

  • dlojudice 3 hours ago

    > Tinker is a flexible API for efficiently fine-tuning open source models with LoRA.

    It would be great if they offered inference from the trained model as well. Ideally pay per token.

  • vin92997 4 hours ago

    Given that Thinking Machines has employed so many smart scientists, focusing solely on infra and fine-tuning is kind of a letdown.

    • babelfish 4 hours ago

      I feel like this is what the current team excelled at at OpenAI, only makes sense that they would productize it

  • apcragg 4 hours ago

    Funny timing that they are announcing their first product days after Matt Levine highlighted their lack of a public product or direction in the Money Stuff newsletter.

  • Oras 4 hours ago

    Isn't this a feature offered by many LLM providers? What's your USP here?

    • aabhay 3 hours ago

      It is? Which ones give you distributed post training of MoE LLMs?

  • dang 34 minutes ago

    Usually we want an announcement to come with more than a waitlist before doing a frontpage thread on HN, but I guess this company is high-profile enough that the post is relevant anyway?

  • hamonrye 3 hours ago

    A/B testing the python scripts

  • closewith 4 hours ago

    The name chosen is an antiquated ethnic slur in much of the Anglosphere.

    • mrcwinn 4 hours ago

      I’ve never heard of this in my life. Isn’t tinker a verb meaning to fiddle or edit or modify in small increments? That seems like the perfect name given what the software they’re present. In any case I guess this is back to the debate: does it matter how a word is intended or does it matter how a word is received?

      • gwbas1c 3 hours ago

        Almost anything can be a slur in some context.

        Back in the '90s, people would say "oh he's 'special'" as a slur.

        That being said, in a world like we live in today, pretty much anything you say or do will offend someone for some obscure reason that you just can't reasonably anticipate.

        It's in these contexts that I think the most appropriate response is "get a life."

      • goopypoop 3 hours ago

        let's not sanction being niggardly when mooting intent

      • closewith 4 hours ago

        > does it matter how a word is intended or does it matter how a word is received?

        If you apply that argument to an ethnic slur that's common where you live, you'll see that it wouldn't be a good product name in an international market.

      • echelon 4 hours ago

        Never heard this before either.

        I googled "Tinker Slur" and Gemini said this:

        > The term "tinker" is a racial slur when used against Irish and Scottish Travellers and Romani people. Originally derived from the name of an itinerant profession, the word evolved into a derogatory ethnic insult with connotations of being dirty, dishonest, and criminal.

        Further sources:

        https://hatebase.org/vocabulary/tinker

        https://www.threads.com/@yourlocaltj/post/DCbY6wMIJ7J?hl=en

        TIL

        Shame that people do this. It's been a salient word all my life, and it's a useful word too.

        I'll keep calling myself a tinkerer.

        • labrador 4 hours ago

          I'm an American of Irish and Scottish descent with some travellers in my background. Never heard this word as a slur, only as "I like to tinker with machines." Tinker as a slur hasn't travelled off the islands of Great Britain apparently.

          Edit: I'm not changing my usage of the word. I like to tinker.

        • buildbot 4 hours ago

          Interesting, Robert Jordan basically directly lifts that term for the Romani-esque tinkers in Wheel of Time.

        • closewith 4 hours ago

          The ethnic slur predates (and is the etymology of) the meaning you're familiar with.

          • chuckadams 4 hours ago

            Meanings become obsolete. Calling someone "nice" used to mean they were stupid.

          • gs17 4 hours ago

            Do you have a source for this? I can't find any etymology dictionary that says it doesn't come from either "tin" as in the metal or "tink" as an onomatopoeia (or a verb that refers to mending things). To be fair, they say it's uncertain, but you seem very confident about your alternative etymology.

            • overscore 3 hours ago

              The formation etymology (whether from tin or onomatopoeia) is uncertain. The part that is certain is the semantic chronology. The noun tinker was used from at least the 13th century for an itinerant mender of pots, the Travellers. By the 16th century it became a slur for Travellers.

              The verb to tinker doesn’t appear until the mid-17th century, first meaning to work as a tinker and only later coming to mean what you're familiar with.

              So while the root word’s sound-shape is debated, the order of senses is clear: the Traveller sense comes first, the modern “casual repair” sense comes later and was derived from it. This is the etymological order given in all sources, eg https://www.merriam-webster.com/dictionary/tinker

              • gs17 an hour ago

                > eg https://www.merriam-webster.com/dictionary/tinker

                Does this page show something different in your region? For me it doesn't say anything about what you're claiming it does outside of one "chiefly Ireland, sometimes offensive" definition. The etymology only says "Middle English tinkere", and the history explicitly states its first use as being the not-"chiefly Ireland, sometimes offensive" definition. The etymologies I was seeing show it going from "this is a word that describes a job" and branching to "this group of people does this job a lot, let's call them this word" and "fiddling with things to do anything is close enough".

                I'm genuinely interested in this, I work in what's a relatively "woke" domain (education) and I've never heard a complaint about something being called "tinkerable".

    • JumpCrisscross 3 hours ago

      It is. But honestly, fuck that. It has a colloquial meaning that carries none of that baggage. Instead of retiring the word, why not make the racist definition archaic?

      • overscore 3 hours ago

        The colloquial meaning carries all of that baggage. You just weren't aware.

        • JumpCrisscross 3 hours ago

          > colloquial meaning carries all of that baggage. You just weren't aware

          The baggage—hell, all meaning in language—is carried by awareness. We don’t consider the word hostile racist because we’re not ancient Romans facing the hostis.

          Maybe there is a cause to censor the word tinker in British English. What there isn’t is censoring it in American or international English.

    • jazzyjackson 3 hours ago

      How much of the Anglosphere?

    • aeon_ai 3 hours ago

      Good thing it's been forgotten enough that almost nobody knows that, or cares it's the name of this company.

      I think if anyone is offended by a word that is not used by anyone in that context, they're probably due for some self-reflection on what offends their sensibilities.

      • overscore 3 hours ago

        It's definitely not forgotten? What makes you think that? Commonly used in Ireland, the UK, Australia, Canada, parts of the US.

        > they're probably due for some self-reflection on what offends their sensibilities.

        Or maybe what they're willing to accept?

        • sentientslug 3 hours ago

          You are going on a very weird crusade in this thread. Literally have never heard this in my life used as any kind of slur and here you are arguing with everyone about it.