AllenAI releases olmo-eval, an open-source evaluation workbench that tests 7B LLMs across 18 benchmarks in under two hours using a single GPU.
Models & Hardware DeskNVIDIA and Hugging Face release over 1.5 million agent trajectories and 10 trillion tokens to help developers build inspectable, tool-using AI models.
Models & Hardware DeskCohere has released North Mini Code, a 30B MoE model with 3B active parameters optimized for agentic software engineering and terminal execution.
Models & Hardware DeskA developer analysis finds rsync bug reports nearly doubled after Claude 3 Sonnet's release, suggesting AI-generated commands may be behind a wave of user-error reports.
Models & Hardware DeskServiceNow has released EVA-Bench 2.0, an open-source evaluation suite featuring 121 tools and 213 multi-step scenarios to test LLM voice agent performance.
Models & Hardware DeskA Hugging Face hackathon entry uses five small models from OpenAI, NVIDIA, OpenBMB, and Qwen to build an unscripted multi-agent financial simulation game.
Models & Hardware DeskHugging Face Jobs now lets developers launch private, OpenAI-compatible vLLM inference servers using a single CLI command with pay-per-second billing.
Models & Hardware DeskOpen-source reliability layer Forge uses rescue parsing and retry loops to boost self-hosted 8B model tool-calling success rates to 84% in benchmarks.
Models & Hardware DeskPaddlePaddle releases PP-OCRv6 on Hugging Face, offering up to 86.2% detection Hmean across 50 languages with lightweight sizes starting at 1.5M parameters.
Models & Hardware DeskMicrosoft debuts MAI-Code-1-Flash, a 7B model beating Claude Haiku 4.5 on coding benchmarks with 60% fewer tokens for Visual Studio Code users.
Models & Hardware DeskA GitHub issue alleges Brazilian firm Nex-AGI's 'homegrown' Nex-N2-7B model is actually a merge of two existing open-source models, not an original build.
Models & Hardware DeskArchestra blocked automated GitHub spam by combining a CAPTCHA onboarding flow with Git's author flag to whitelist real contributors.
Models & Hardware Desk