Hacker News

points by lukethorham 1 day ago | 0 comments

I wonder if something like this is the undisclosed new approach from Anthropic that presumably has massive improvements by combining multiple models. Leveraging decision models as much as possible seems logical for extra speed and token efficiency.

[–] couldaidothis 1 day ago

I think OpenAI and Anthropic have both been doing similar "routing" approaches for a while. Wasn't OpenAI one of the first to have a small model start responding to you for the first several tokens so that you got an instant response while the big model became available?

Similarly, Grok has been routing to Opus internally for a little while now I think.

[–] 2001zhaozhao 1 day ago

> undisclosed new approach from Anthropic

Any source on that?

[–] lukethorham 1 day ago

There’s a METR audit document which apparently describes various unreleased models. This is discussed in a YT video by Wes Roth. I have no firsthand knowledge about it.

[–] pearcoder 1 day ago

they do have the 'advisor' model setting now which also plays well with this