A field report on running Google's Gemma-4 on AWS Inferentia2: mixed attention heads, the vLLM / optimum-neuron / NxD dead-ends, and the neuronx-cc compiler limits.
Porting Gemma-4 (2B / 4B / 12B) to AWS Inferentia2
Related
Audit an AI Coding CLI Before It Uploads Your Home Directory
A practical outbound-data threat model and test procedure for coding agents with filesystem and network access.
PromptLedger v0.7 — Turning prompt evaluation into local regression gates
Devlog — Part 6 PromptLedger v0.7 is out. The previous release made prompt history easier...
MCP for TypeScript Developers: What It Actually Solves Beyond the Hype
MCP is one of the most talked-about ideas in AI right now. If you read enough posts, it starts to...