Hacker News
points by alansaber 19 hours ago | 0 comments
There has been a relatively strong local model community since the days of llama-3. IMO, the number of non-technical people interested in qlora, adapters, parameter fine tuning etc is remarkable.
[–] htsh 18 hours ago
that was when RAM and GPUs were cheap. Now that is dying, too.
[–] cykros 17 hours ago
Only people who have no concerns about privacy would give up on it entirely.

But yes, it has been a test of just how few tokens you can get by on.