▲
Hacker News
new
|
best
|
ask
|
show
|
jobs
points by
alansaber
19 hours ago | 0 comments
There has been a relatively strong local model community since the days of llama-3. IMO, the number of non-technical people interested in qlora, adapters, parameter fine tuning etc is remarkable.
[–]
htsh
18 hours ago
that was when RAM and GPUs were cheap. Now that is dying, too.
[–]
cykros
17 hours ago
Only people who have no concerns about privacy would give up on it entirely.
But yes, it has been a test of just how few tokens you can get by on.
[–] htsh 18 hours ago
[–] cykros 17 hours ago
But yes, it has been a test of just how few tokens you can get by on.