• DavidGarcia@feddit.nl
    link
    fedilink
    English
    arrow-up
    24
    arrow-down
    1
    ·
    14 days ago

    local AI is cool and all, but neither the hardware nor the models are really ready for your average consumer

    • merthyr1831@lemmy.ml
      link
      fedilink
      English
      arrow-up
      2
      ·
      13 days ago

      Who actually uses “local AI” beyond developers and a handful of end users? These NPUs are wasted silicon - akin to sticking a gaming GPU in your CPU that only works for games that are either in development or 99% of people don’t give a shit about

      • DavidGarcia@feddit.nl
        link
        fedilink
        English
        arrow-up
        3
        ·
        13 days ago

        The only real advantage of local AI is privacy and that it’s much cheaper if you use it a lot.

        The only consumer use case I see in the wild with some real momentum behind it is role play.

        All the local AI communities I browse are 50% people trying to find usecases for it at their job (like me; unsuccessfully I might add) and 50% people interested in role play.

        People will apparently spend thousands to jerk off to a soulless machine demon simulacrum shell of a human.

        To be fair, I can see the appeal of local AI for video games, like RPGs. There is this really fun game called “Suck Up”, where you are a vampire trying to convince AI to let you inside their house. That is the one real “killer” application I see atm.

        I personally see a lot of other useful usecases for local AI, but from my experience at work, I would estimste it will take another 5 years until any of it is anywhere near consumer ready.