turkishdelight@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 8 months agoOllama now supports AMD graphics cardsollama.comexternal-linkmessage-square4fedilinkarrow-up177arrow-down10file-text
arrow-up177arrow-down1external-linkOllama now supports AMD graphics cardsollama.comturkishdelight@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 8 months agomessage-square4fedilinkfile-text
But in all fairness, it’s really llama.cpp that supports AMD. Now looking forward to the Vulkan support!
minus-squareAlex@lemmy.mllinkfedilinkEnglisharrow-up4·8 months agoThat’s cool. I’ve just recently gotten hold of an interesting Ampere system and it’s got an AMD card in it. I must give it a spin.
minus-squareAlex@lemmy.mllinkfedilinkEnglisharrow-up1·8 months agoI was sadly stymied by the fact the rocm driver install is very much x86 only.
minus-squareturkishdelight@lemmy.mlOPlinkfedilinkEnglisharrow-up2·8 months agoIt’s improving very fast. Give it a little time.
That’s cool. I’ve just recently gotten hold of an interesting Ampere system and it’s got an AMD card in it. I must give it a spin.
I was sadly stymied by the fact the rocm driver install is very much x86 only.
It’s improving very fast. Give it a little time.