Hacker News
points by Starlevel004 3 days ago | 0 comments
> OpenAI researchers first noticed Astra adding unnecessary prerequisites, abandoning working solutions, and reporting blockers that either did not exist or that it had caused itself on safety and alignment tasks.

I'm sorry, did they only just notice this? Have they not been looking at the output of their models?

[–] nullstyle 3 days ago
They are so negligent about the data they use in their reinforcement learning processes that they RL’d the model that hacked huggingface with traces discovering the artifactory exploit. Its clear they aren’t watching or behaving diligently.
Hacker News