stabby_cicada@slrpnk.net to solarpunk memes@slrpnk.net · 1 day agoone more shitty techbrofad downslrpnk.netimagemessage-square137fedilinkarrow-up1453arrow-down154file-text
arrow-up1399arrow-down1imageone more shitty techbrofad downslrpnk.netstabby_cicada@slrpnk.net to solarpunk memes@slrpnk.net · 1 day agomessage-square137fedilinkfile-text
minus-squarePriorityMotif@lemmy.worldlinkfedilinkarrow-up7·9 hours agoYou can run it on your own machine. It won’t work on a phone right now, but I guarantee chip manufacturers are working on a custom SOC right now which will be able to run a rudimentary local model.
minus-squareTherapyGary@lemmy.blahaj.zonelinkfedilinkarrow-up5·9 hours agoYou can already run 3B llms on cheap phones using MLCChat, it’s just hella slow
You can run it on your own machine. It won’t work on a phone right now, but I guarantee chip manufacturers are working on a custom SOC right now which will be able to run a rudimentary local model.
You can already run 3B llms on cheap phones using MLCChat, it’s just hella slow