Hacker News
points by dgb23 3 days ago | 0 comments
Phasing out my usage of cloud based LLMs/harnesses.

Focus is pi + self hosted GLM Flash.

Pi is lightweight and easily extensible and creates minimal extra noise. the output I get is very close to what I want to see.

my workflow is focused on clear turns between planning, testing and implementation. Any useful/recurring tasks, like getting/filtering logs, checking statuses etc get regularly folded into a project cli and agent skills that are local to the project.

I spend time interactively iterating on the plan/design and acceptance tests, then let it do its thing. Usually I have multiple interactive sessions at once that I'm steering this way. 1-2 assigned projects, 1-3 side projects (additional automation, experiments/POCs, workflow/process efficiency etc.). I generally don't do sub-agents. When I need throughput I automate first, frontloading the "deterministic" parts.

[–] yewenjie 3 days ago
What are you using to host GLM-Flash?
[–] dgb23 3 days ago
Didn't set it up myself so my info will be meagre, but I think it's litellm and a big enough nvidia card. We use it for development but also for internal applications (where smaller models might escalate a task to it when needed).

Obviously not feasible for (just) personal use, the model is too large for consumer hardware.