946 articles tagged with Benchmark
AI glasses present a compelling platform for AI agents to serve as personalized memory assistants. To be genuinely useful, such systems must move beyond short-term video comprehens...
How ready are frontier models for real coding work? AutoCodeBench builds a 3,920-problem benchmark across 20 languages by working backwards: start from running code, generate the t...
Microsoft's own numbers show AI is pricier than hiring humans. A startup got sued for trashing Airbnbs with test robots. Amazon ...
What Happened Last month, the UK Government's AI Safety Institute merged AgentThreatBench...
Why most AI demos never make it to production: 1. Built for a benchmark not a user. 2. No error handling when the LLM hallucinates. 3. No latency budget. 4. No cost model. I have s...
Anthropic shipped Claude Opus 4.8 today. The benchmark numbers went up, as they always do. But that's...
"Amazon has shut down an internal leaderboard that tracked employees’ use of AI tools after workers tried to boost their scores with unnecessary activity that increased the company...
【VAKRAの内部構造：エージェントの推論、ツールの使用、および障害モード】https://huggingface.co/blog/ibm-research/vakra-benchmark-analysis※AI生成の自動投稿（見出し＋リンク）#AI #生成AI #LLM #AIGenerated
https://winbuzzer.com/2026/05/28/deepswe-puts-gpt-55-ahead-in-ai-coding-tests-xcxwbn/Datacurve's new DeepSWE benchmark puts GPT-5.5 ahead of Claude and challenges older AI coding r...
【Open ASRリーダーボード：新しい多言語トラックと長尺トラックによるトレンドとインサイト】https://huggingface.co/blog/open-asr-leaderboard※AI生成の自動投稿（見出し＋リンク）#AI #生成AI #LLM #AIGenerated
Critical Starlette bug BadHost threatens AI infrastructure including FastAPI and vLLM, Claude faces benchmark cheating claims, and Robinhood eyes LLM-powered brokerage accounts as ...
🚀 Fastest-growing AI projects today1. The standout project PaperGuru-AI's "PaperGuru-Benchmark," which has garnered significa...2. The most notable tool thweek justxor's MachineLea...
Glad to see #AI benchmark tests evolve#softwaredevelopment #softwareengineeringhttps://venturebeat.com/technology/deepswe-blows-up-the-ai-coding-leaderboard-crowns-gpt-5-5-and-find...
We present ChildVox, a novel benchmark for characterizing the diverse acoustic signals through which children communicate. Specifically, ChildVox follows the full developmental tra...
AI coding agents are increasingly used for scientific work, but their end-to-end autonomous research capability remains difficult to verify. We present ResearchClawBench, a benchma...
Alibaba's new Qwen3.7-Max AI model has claimed fourth place on Code Arena's global programming leaderboard with a score of 1,541, beating both OpenAI and Google's latest models. Th...
https://winbuzzer.com/2026/05/27/nvidia-vera-benchmarks-top-epyc-xeon-in-early-test-xcxwbn/Early public Vera benchmark results put Nvidia's in-house server CPU ahead of compared AM...
DeepSWE blows up the AI coding leaderboard, crowns GPT-5.5, and finds Claude Opus exploiting a benchmark loophole. Via @venturebeat #AI #ArtificialIntelligence 💻 🤖 🧠DeepSWE blows u...
OMCBench is a benchmark suite for evaluating malicious-code detection capabilities. The benchmark consists of a labeled set of 800 Python and JavaScript packages: 400 benign and 40...
Fresh research on religious bias in AI models is a reminder that faith and worldview are product-quality concerns, not edge cases. Here is how builders can evaluate for context-sen...
If you’re building AI-assisted 3D or CAD-like workflows, benchmark scores only get you so far. The real work is designing evals around your product contract and catching geometry f...
Large language model (LLM) agents are increasingly used to assist with operations research (OR) modeling, yet existing OR-oriented benchmarks often reduce evaluation to one-shot tr...
The rapid growth in submissions to machine learning venues has strained the scientific peer-review system and intensified interest in LLM-based automated peer reviewers. However, h...