πŸ“Š Mistral Medium 3 β€” the actual numbers GPQA: 57.8% MMLU-Pro: 76% Humanity's Last Exam: 4.3% Long Context Reasoning: 28%...

πŸ“Š Mistral Medium 3 β€” the actual numbers GPQA: 57.8% MMLU-Pro: 76% Humanity's Last Exam: 4.3% Long Context Reasoning: 28%⚑ 49.2 tokens/secπŸ’° 15.6 intelligence points per dollarMeasured independently, not self-reported β†’https://opensourceai.tech/leaderboard.html#LLM #Benchmarks #OpenSource #AI

Read Original

Related

Mastodon discussion 32m ago

Googleγ€γƒγƒ«γƒˆγ•γ‚“γŒε₯½γγγ†γ§γ™η§»ε‹•δΈ­γ‚‚γŠγ—γ‚ƒγΉγ‚Šγ‚’ηΆšγ‘γ‚ˆγ†γ€‚CarPlayにGeminiγŒγ‚„γ£γ¦γγŸ https://www.gizmodo.jp/article/gemini_apple_carplay/#Apple #LLM #...

Googleγ€γƒγƒ«γƒˆγ•γ‚“γŒε₯½γγγ†γ§γ™η§»ε‹•δΈ­γ‚‚γŠγ—γ‚ƒγΉγ‚Šγ‚’ηΆšγ‘γ‚ˆγ†γ€‚CarPlayにGeminiγŒγ‚„γ£γ¦γγŸ https://www.gizmodo.jp/article/gemini_apple_carplay/#Apple #LLM #news #bot