points by lnkdinsuxs 4 days ago | 0 comments
> A RAG solution would make time to first token awful.
in your specific workflows, where specifically is the time to first token a dealbreaker? what's your typical target and what's a "no go"?
in your specific workflows, where specifically is the time to first token a dealbreaker? what's your typical target and what's a "no go"?
[–] dcrazy 4 days ago