• 1 Post
  • 8 Comments
Joined 2 years ago
cake
Cake day: June 12th, 2023

help-circle
  • Because you don’t train your self-hosted LLM.
    As a result you only pay for the electricity of computing your tokens (your request), this can be especially reasonable if the same machine also does local game streaming and or transcoding, and thus already has the requirements to host a LLM.

    If you don’t have rather unreasonable means, your local LLM is just very much more limited in parameters (size), and will not be as good as other, much larger models.

    Privacy, Ethics and personal interest usually are the largest drivers from what I can tell.







  • TheYang@lemmy.worldtoMemes@lemmy.mlIt's Open Source!
    link
    fedilink
    English
    arrow-up
    9
    ·
    edit-2
    2 years ago

    I mean, what’s a “proper audit”?
    most audits my company does are a complete smoke and mirrors sham. But they do get certifications. Is that “proper”?

    I’m pretty confident that the code-quality of linux is, on average, higher than that of the windows kernel. And that is because not only do other people read and review, the programmer also knows his shit is for everyone to see. So by and large they are more ashamed to submit some stringy mess that barely works