Researchers introduced the PAU benchmark for unsupervised tool understanding, assessing models with black-box API access...

Researchers introduced the PAU benchmark for unsupervised tool understanding, assessing models with black-box API access. Frontier models struggle, and Claude-4-Opus failed to understand over 45 percent of the test set.Source: arXivhttps://arxiv.org/abs/2609.32081#MachineLearning #Claude

Read Original

Related