Senior Software Engineer, AI Inference Systems
Design and optimize high-performance AI inference systems for large-scale models using cutting-edge GPU hardware. Develop and enhance inference frameworks like vLLM, implement advanced parallelism techniques, and contribute to compiler and kernel optimization. Collaborate across teams to improve performance across multi-GPU and multi-cloud environments, with opportunities to publish research and influence industry benchmarks.