AI infrastructure heats up as models get more efficient

Today's tech news paints a picture of two counteracting forces in the developer world. On one hand, the AI industry is accelerating, with more efficient models and more accessible tools appearing constantly. On the other hand, security threats grow exponentially as more people and systems depend on these same tools.

AI is getting faster and more efficient

Microsoft unveiled MAI-Base-2, a mixture-of-experts model that is 4 to 12 times more efficient than DeepSeek-V4-Pro in training. That sounds technical, but the meaning is concrete: for developers, this means you can train larger models for less money and in less time. Greater efficiency in AI infrastructure trickles down to everyone building AI features.

Nvidia is pushing the same trend with Nemotron-Bolt, a 74-billion-parameter model that now fits on a standard 24GB laptop. This completely changes what's possible to build locally without relying on API calls. On-device inference stops being a futuristic vision and becomes a practical reality for developers who want low latency and better privacy.

Meta also released an open-weight AI model optimized for Apple Silicon, meaning modern AI models can now run efficiently on consumer hardware. The shared trend here is unmistakable: AI is becoming less dependent on cloud infrastructure and more distributed to the edges.

Platforms are democratizing development

Bluesky expanded Attie, its AI-powered tool for building websites and games without knowing code. It's a sign that artificial intelligence is starting to make it possible for non-developers to ship things that previously required specialized knowledge. For those of us building at a professional level, this means competition from no-code solutions is only growing.

Vercel introduced always-on workers, letting you run persistent backend compute without traditional serverless scaling. It's subtle but important, because it removes one of the biggest friction points in serverless architectures: everything constantly spinning up and down. This lets developers focus on real problems instead of infrastructure orchestration.

RapidCanvas raised 29 million dollars for its platform that lets non-ML-experts build custom AI tools. This is a symptom that AI tooling is rapidly normalizing and abstracting away from pure machine learning toward becoming a business problem that gets solved quickly.

Security holes are growing at the same pace as success

But this isn't just a success story. GitHub was targeted in a coordinated attack where hackers compromised around 1900 accounts and targeted 30000 repositories. It's a reminder that developer infrastructure is something attackers prioritize heavily, because a compromised GitHub account is a gateway into thousands of projects.

Even worse was the LiteLLM CVE-2026-35029, a critical vulnerability that exposed API keys at scale. LiteLLM sits between your applications and multiple LLM providers, so a vulnerability here can potentially compromise your entire integration chain. This is classic supply-chain risk that developers need to take seriously.

OpenAI also announced deprecation of the GPT-4o API with only three months notice instead of the promised six months. This says something about the dynamics in the AI market: vendors move fast and can change terms on short notice. For developers, it means you should build abstractions around your AI API calls so you don't get locked into a single vendor.

Responsibility and transparency on the rise

Anthropic gave METR researchers employee-level access to evaluate Claude, signaling a willingness toward transparent security assessment. This is the opposite pole from the security holes we saw earlier. This type of open scrutiny could become industry standard as AI systems become more critical.

What ties today together is a simple truth: the more powerful AI infrastructure becomes, the more important security, transparency, and long-term architecture become. Speed shouldn't mean building houses on sand.

This is part of Revolter's daily developer brief series.