Yes, directly emitting binaries will likely become practical at some point if LLM context lengths continue to increase. We may be there already for small programs, I don't know.

As with eliminating other forms of abstraction, there's not much gain from doing so. Writing source code and then compiling it offers many useful checks, and greatly simplifies making changes. It's just something that may no longer be necessary at some point.