Engineering the Future of Infrastructure
Senior Writer, AI Infrastructure
Marcus covers GPU infrastructure, LLM serving and MLOps. He has built inference platforms for teams shipping models to production.
3 stories
GPUs changed the unit economics of the cloud, and the architecture is following. Inside the ground-up rebuild of the production stack for AI workloads.
What actually happens between an API call and a token. A tour of the serving stack — batching, KV cache, autoscaling and the cost of every millisecond.
Latency and errors are not enough. Tracking quality, cost-per-request and hallucination signals for systems whose output is probabilistic.
Practical DevOps, cloud, AI infrastructure and engineering insights — delivered weekly. Read by engineers and engineering leaders.
