Once again I have to suggest Project Nomad.

It already puts together an installer, stack, knowledge base, and local LLM support

Edit: copied up https://www.projectnomad.us/