Hacker News

points by alfiopuglisi 3 days ago | 0 comments

Honest question, couldn't one just ask Claude to make a better driver for it? And reimplement pytorch on top of that or something?

[–] pachouli-please 3 days ago

The community is basically doing this now with the kickflips in driver/rocm/etc "stuff". It's gotten so good and well-embraced that even AMD is backing some of these community efforts.

[–] mpreda 3 days ago

Do you have some pointers to these efforts, please?

[–] aclmakes 3 days ago

halogen. made by a user, one of the early, best model serving things for a strixhalo. amd community engaging person saw it was well liked, and sent that developer 2 strix halos to help them develop it further.

ive seen that same amd community manager engage on reddit and actively pull in changes into lemonade server, for better ways to serve up models best on the strixhalo hardware. so they're accepting community help where it helps.

[–] f6v 3 days ago

Is there something wrong with PyTorch? I’ve heard people complain a lot about their GPUs. I’ve only used MI250x in an HPC, but PyTorch worked fine.

[–] p_l 3 days ago

It's due to ROCm, think equivalent of CUDA lower level drivers, which is well problematic.

There's huge upswing in using Vulkan Compute which works across NVIDIA, AMD, and Intel (and even others), and which is apparently much easier and stable to run on AMD