Already built. Check out Sannr. I'm a former Postmanaut and built it as an open source solution.

Sannr is an API platform built for coding agents that builds API context over time.