A 7B model just embarrassed everyone

Small models are winning. A 7-billion-parameter model just scored 88.1% on AIME 2024—matching Llama 3.3 70B and crushing systems 47 times its size. TII Abu Dhabi built a hybrid Transformer-Mamba2 architecture that processes 256k tokens like it’s nothing. This is what the post-scaling era looks like: architectural creativity beating brute-force compute. The billion-parameter arms race? Starting to look like the wrong war.

Meanwhile, the healthcare AI race just got interesting. Anthropic launched Claude for Healthcare days after OpenAI unveiled ChatGPT Health—but with one critical difference: it’s actually HIPAA-ready. Claude can now connect to Apple Health and medical records through a HealthEx partnership, letting you ask questions about your own data. Novo Nordisk claims they cut clinical documentation from 12 weeks to 10 minutes. That’s not a typo.

On the money side: Andreessen Horowitz closed $15 billion—the largest VC raise in Silicon Valley history, representing 18% of all US venture dollars allocated last year. Where’s it going? AI, defense tech, and their “American Dynamism” thesis that the next decade belongs to companies building hard things. And OpenAI and SoftBank poured another $1 billion into Texas data center infrastructure—part of the $500B Stargate commitment. The AI buildout isn’t a pitch deck anymore. It’s concrete being poured.