You will design and develop runtime and cross-stack optimizations to improve CPU and GPU efficiency for AI models. Additionally, you will collaborate with cross-functional teams to port the runtime stack to new hardware and ensure state-of-the-art performance.
Lead the team building the optimization platform for LLM inference on Modular Cloud to achieve state-of-the-art performance. Partner with GTM and Engineering teams to translate customer workloads into a technical roadmap for full-stack optimizations.
Build and scale an optimization platform to drive state-of-the-art LLM inference performance across GPU and ASIC architectures. Collaborate with GTM and engineering teams to tune inference for specific customer use cases and publish industry best practices.
