points by user43928 3 days ago | 0 comments
I think it's usually not worth it.
If the test suite takes too long, it can easily be cleaned up later rather than spending extra time judging test cases in every new MR.
Maintenance of test cases has also become trivial, even with thousands of them. When the pipeline goes red on master I click the new chat button and run /check-pipeline, where I put some concise instructions, and the failure gets investigated and resolved in short order.
What I think you're saying is that opinions that LLMs produce are good enough and malleable, so why even have an opinion?
Which is debatable - oftentimes their opinions are not good enough, and not malleable at all.
We're all still learning how to distinguish those. But in order to learn this, you have to read and understand the code they produce. LLMs can migrate a codebase to Rust, but they still suggest walking to a car wash. Every day they make decisions that humans would be fired for.
LLMs are definitely not yet capable enough to blindly trust them, and there's a pretty good chance they never will be.