If you were running a LLM locally on android through llama.cpp for use as a private personal assistant. What model would you use?

Thanks for any recommendations in advance.

  • haui@lemmy.giftedmc.com
    link
    fedilink
    arrow-up
    0
    ·
    4 days ago

    Running an llm on a phone will absolutely destroy your battery life. It also is imperative that you understand that the comfort of ai is bought with killing of innocents (through expediency of climate catastrophe, exploitation of the planet and the poorest on it).

    I think using ai to experiment on a home server which already exists wouldnt be problematic IN A VACUUM but you would still normalize using the tech which is morally corrupt.

        • Fisch@discuss.tchncs.de
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 days ago

          I’m not even trying to argue against you, I’m arguing for veganism. The same arguments that you used for why the use of AI is bad can be used for why not being vegan is bad. The production of animal products even has a way bigger impact.

            • haui@lemmy.giftedmc.com
              link
              fedilink
              arrow-up
              0
              ·
              4 days ago

              It is not. Eating meat is actually a torture and murder industry and people who eat meat are actually eating pieces of corpses.

              Even when I still ate meat, I could understand that morally there is no difference to eating humans.

              • N0x0n@lemmy.ml
                link
                fedilink
                arrow-up
                0
                ·
                4 days ago

                Not only that… The meat industry is poisoning the animals with antibiotics, GMO cereals… they live in 1m2 of space/cow, and living in hell 24/24, feel anger, hate, sadness and treated like shit and pure pain while beaten by humans… It’s horrible !!

                And all these things are digested by our body… Ugh ! It’s similar to a concentration camp but for animals…

                • selokichtli@lemmy.ml
                  link
                  fedilink
                  arrow-up
                  0
                  arrow-down
                  1
                  ·
                  4 days ago

                  I could see an argument against industry standards on meat production, but the base argument of veganism is flawed when all these things you list do not occur. And yes, veganism is frequently a cult in my experience. They tend to surround of themselves, assure themselves to each other and avoid discussion of their mindset. AAMOF I was turned off to discuss here, but as I randomly got to know I’m being downvoted, I will engage.