- 1 Post
- 8 Comments
herseycokguzelolacak@lemmy.mlto Selfhosted@lemmy.world•What is a self-hosted small LLM actually good for (<= 3B)English1·12 hours agoNot on top of my head, but there must be something. llama.cpp and vllm have basically solved the inference problem for LLMs. What you need is a RAG solution on top that also combines it with web search.
herseycokguzelolacak@lemmy.mlto Privacy@lemmy.ml•New US visa rules will force foreign students to unlock social media profiles181·12 hours agoWasn’t this always the case? I remember flying into the US during the Biden era as a tourist and had to declare my social media accounts.
herseycokguzelolacak@lemmy.mlto Selfhosted@lemmy.world•What is a self-hosted small LLM actually good for (<= 3B)English51·2 days agofor coding tasks you need web search and RAG. It’s not the size of the model that matters, since even the largest models find solutions online.
herseycokguzelolacak@lemmy.mlto Not The Onion@lemmy.world•Marjorie Taylor Greene Says Americans 'Have Been Brainwashed' By Fox News, New York Post As She Opposes U.S. Entering Israel-Iran WarEnglish89·2 days agoThis is a ‘‘The worst person you know just made a great point.’’ moment, isn’t it?
herseycokguzelolacak@lemmy.mlto LocalLLaMA@sh.itjust.works•LLMs and their efficiency, can they really replace humans?English1·2 days agoLLMs are great at automating tasks where we know the solution. And there are a lot of workflows that fall in this category. They are horrible at solving new problems, but that is not where the opportunity for LLMs is anyway.
herseycokguzelolacak@lemmy.mlto LocalLLaMA@sh.itjust.works•Current best local models for tool use?English1·2 days agoFor VLMs I love Moondream2. It’s a tiny model that packs a punch way above its size. Llama.cpp supports it.
herseycokguzelolacak@lemmy.mlto Palestine@lemmy.ml•Massive fire reported in Tel Aviv after Iron Dome missiles misfired and landed on nearby buildings setting them on fire.17·2 days agoIran has a right to defend itself from Israeli terrorism.
Swearing in source code points to a healthy and organic development.