Next 100x in AI: Inference, Networking, & Self-Optimizing Models — Philip Kiely & Ali Taha, Baseten
From routing a 200,000-token prompt across GPUs to having GLM-5.2 profile, rewrite, and optimize the kernels serving itself, inference engineering is becoming one of the most important layers of AI. In this episode, Base