Browse by format or topic. To see where I’ve delivered them, visit my speaking page and my events. Want one of these at your event? Get in touch.
📌 ⭐️ Tracing an LLM API request to GPU and back
What happens when you send a chat request to an LLM? We trace a single request to GPU and back. We will also look at all systems that make up inference pipeline and optimizations