Like if I type “I have two appl…” for example, often it will suggest “apple” singular instead of plural. Just a small example, but it is really bad at predicting which variant of a word should come after the previous

  • sir_reginald@lemmy.world
    link
    fedilink
    arrow-up
    24
    ·
    edit-2
    11 months ago

    LLMs are orders of magnitude more sophisticated and expensive to run. But don’t worry, I’m sure not so far in the future we will see smaller LLMs being run on device to be used as autocorrect.

    • pacoboyd@lemm.ee
      link
      fedilink
      arrow-up
      5
      ·
      11 months ago

      It would have to be pretty specific and small to work on a phone and I think a side effect would be everyone’s conversations start to sound a lot more homogeneous.

      • sir_reginald@lemmy.world
        link
        fedilink
        arrow-up
        3
        ·
        11 months ago

        you’re not wrong. Google just announced Gemini Nano that will run directly on the Pixel 8. Of course, it’s the first of it’s kind and will probably be slow and it’s not used as autocorrect yet. But just give it one year or two and it will probably be more common.

      • neptune@dmv.social
        link
        fedilink
        English
        arrow-up
        2
        ·
        11 months ago

        Even give years ago, Google had a keyboard that skimmed your emails and texts to start a bank of words you use to supplement it’s dictionary for autocorrect. Like if you are a chemist and send an email that includes the word “tetrahydrafuran” every couple month, it would be nice for your phone keyboard to just have it in the dictionary.

    • Mr_Blott@lemmy.worldOP
      link
      fedilink
      arrow-up
      4
      arrow-down
      1
      ·
      11 months ago

      Can we have Scottish ones that know what a bawbag is, and when to put an “e” on the end of “shit”?

      Thanks!

      • OpenStars@kbin.social
        link
        fedilink
        arrow-up
        1
        ·
        11 months ago

        Think of it from the LLM’s perspective - in the general pool you have common English, you have less common variations such as this, and then you have whatever the heck people like Kid Rock are doing…

        Bawitdaba, da bang, da dang diggy diggy
        Diggy, said the boogie, said up jump the boogie