Meta Pulls AI Employee Tracking Leaderboard Days After Rollout
For a limited time, Meta implemented an internal leaderboard to monitor staff usage of AI products. But it goes down within days when worries about the external sharing of sensitiv...
#Benchmark
1698 articles tagged with Benchmark
📰 Wan2.7 Beats Sora with 1334 Elo Rating: Alibaba AI Tops DesignArena Leaderboard 2026Wan2.7, Alibaba's latest video gen...
📰 Wan2.7 Beats Sora with 1334 Elo Rating: Alibaba AI Tops DesignArena Leaderboard 2026Wan2.7, Alibaba's latest video generation model, has surged to the top of DesignArena’s global...
Proposal: A Real Benchmark for Long-Term AI Memory Systems
The Problem Nearly every AI memory system is publishing scores on benchmarks that don't...
MasterToycode/MastiDiff: 南京农业大学记忆——毕业设计—— 扩散模型算法研究——Diffusion Models for Bovine Mastitis Image Generation and Augmentation（Benchmark DDPM /LDM/DDPM_VARIANCE) model checkpoint.pth download on this website
南京农业大学记忆——毕业设计—— 扩散模型算法研究——Diffusion Models for Bovine Mastitis Image Generation and Augmentation（Benchmark DDPM /LDM/DDPM_VARIANCE) model checkpoint.pth download on this website
Claude vs GPT vs Gemini: A Systems-Level Benchmark for Engineering Workflows
Why This Comparison Actually Matters Over the past year, large language models have...
Inaugural State of AI in Gaming Report Establishes Benchmark for AI Practice and Policy Across the Global Gambling Industry
The UNLV International Gaming Institute's (IGI) AI Research Hub (AiR Hub) in collaboration with KPMG LLP, the U.S. audit, tax and advisory firm, today released The State of AI in G...
I expanded the #Vera benchmark to six models across three providers (Anthropic, OpenAI, Moonshot). Kimi K2.5 got every V...
I expanded the #Vera benchmark to six models across three providers (Anthropic, OpenAI, Moonshot). Kimi K2.5 got every Vera problem right while only managing 86% in Python and 91% ...
PokeGym: A Visually-Driven Long-Horizon Benchmark for Vision-Language Models
While Vision-Language Models (VLMs) have achieved remarkable progress in static visual understanding, their deployment in complex 3D embodied environments remains severely limited....
AVGen-Bench: A Task-Driven Benchmark for Multi-Granular Evaluation of Text-to-Audio-Video Generation
Text-to-Audio-Video (T2AV) generation is rapidly becoming a core interface for media creation, yet its evaluation remains fragmented. Existing benchmarks largely assess audio and v...
Organizational dynamics at Meta yielded a leaderboard for AI usage because it is a legible compromise for leadership. It...
Organizational dynamics at Meta yielded a leaderboard for AI usage because it is a legible compromise for leadership. It turns the work into a tokenized game to force an "agentic" ...
A Postmortem on Autonomous LLM-as-Judge: How My Eval Agent Got Two Verdicts Wrong Before I Found a Sandbox Bug
I run an autonomous eval agent against new coding-agent stacks before trusting their numbers. The...
📰 GLM-5.1 on Huawei Cloud: The 2026 AI Benchmark with Open-Weight PerformanceGLM-5.1 has launched on Huawei Cloud, offer...
📰 GLM-5.1 on Huawei Cloud: The 2026 AI Benchmark with Open-Weight PerformanceGLM-5.1 has launched on Huawei Cloud, offering users access through multiple integrated products. The m...
📰 GLM-5.1 Outperforms Opus4.6: Open Source AI Breakthrough Sets New Benchmark (2026)The open source model GLM-5.1 has un...
📰 GLM-5.1 Outperforms Opus4.6: Open Source AI Breakthrough Sets New Benchmark (2026)The open source model GLM-5.1 has unexpectedly surpassed Opus4.6 in performance benchmarks, trig...
Appear2Meaning: A Cross-Cultural Benchmark for Structured Cultural Metadata Inference from Images
Recent advances in vision-language models (VLMs) have improved image captioning for cultural heritage. However, inferring structured cultural metadata (e.g., creator, origin, perio...
What Gemma 4's multi-token prediction head actually means for your eval pipeline
Gemma 4 dropped with a multi-token prediction (MTP) head and immediately every benchmark thread on...
moatifbutt/gen-color-bench: Benchmark for evaluating color understanding in text-to-image models | CVPR 2026
Benchmark for evaluating color understanding in text-to-image models | CVPR 2026
I published my benchmark scores. Your turn.
Back in March I released agent-egress-bench, a test corpus for evaluating security tools that sit...
I just read that Meta has an internal leaderboard for LLM token usage, and I really can't imagine a less thoughtful, les...
I just read that Meta has an internal leaderboard for LLM token usage, and I really can't imagine a less thoughtful, less useful status metric. Even assuming that the tokens are be...
A 600-run benchmark by Yusuke Endoh tested #ClaudeCode across 13 #ProgrammingLanguages by implementing a simplified Git....
A 600-run benchmark by Yusuke Endoh tested #ClaudeCode across 13 #ProgrammingLanguages by implementing a simplified Git.Key takeaways:⇨ Ruby, Python & JavaScript were the fastest, ...
Claw-Eval: Toward Trustworthy Evaluation of Autonomous Agents
Large language models are increasingly deployed as autonomous agents executing multi-step workflows in real-world software environments. However, existing agent benchmarks suffer f...
MedConclusion: A Benchmark for Biomedical Conclusion Generation from Structured Abstracts
Large language models (LLMs) are widely explored for reasoning-intensive research tasks, yet resources for testing whether they can infer scientific conclusions from structured bio...
Microsoft udostępnia trzy autorskie modele MAI w ramach platformy Foundry. Wśród nowości znalazł się lider benchmarków t...
Microsoft udostępnia trzy autorskie modele MAI w ramach platformy Foundry. Wśród nowości znalazł się lider benchmarków transkrypcji oraz narzędzia do błyskawicznej syntezy mowy i f...
📰 LTX-Video 2.3 Benchmark: 11 Models Tested for AI Video GenerationLTX-Video 2.3 emerges as a leading AI video generatio...
📰 LTX-Video 2.3 Benchmark: 11 Models Tested for AI Video GenerationLTX-Video 2.3 emerges as a leading AI video generation framework, with 11 distinct models tested across hardware ...