Even 8GB cards might start going up. I recently bought a cheap one so I can auxiliary models on it (think smaller LLMs for memory consolidation / decision models etc). Locally, multi-gpu is pretty cool. You can essentially have one GPU drive the others and do increasingly powerful things when you combine them.