GPU Compiler Intern

As GPU Compiler Intern, you will develop compiler infrastructure for Python-based GPU programming, including CUTLASS CuTeDSL. You will work on DSL design, MLIR IR design, and compiler optimizations that translate expressive Python programs into high-performance NVIDIA GPU kernels.

What you will be doing:

• Design and implement Python DSL features for GPU kernel authoring, including metaprogramming and IR generation.
• Develop MLIR dialects, transformation passes, and lowering pipelines that preserve the information needed for effective GPU optimization.
• Design and optimize GPU kernels, exploring how IR design and compiler transformations affect generated code and performance.
  Profile, benchmark, and validate compiler and kernel improvements across representative workloads.

What we need to see:

• Currently pursuing or holding a Bachelor’s, Master’s, or Ph.D. degree in Computer Science, Computer Engineering, or a related technical discipline, or equivalent practical experience.
• Proficiency in Python and C++, with strong debugging and software development skills.
• Understanding of how Python DSLs work, including metaprogramming, staged execution, and translation into compiler IR.
• Experience with MLIR, including IR construction, transformation passes, or lowering.
• Practical experience with GPU programming, preferably CUDA, and knowledge of GPU execution and memory models.
• Familiarity with performance analysis and optimization, including profiling, memory access patterns, and parallel execution.
• Experience with CUTLASS, CuTeDSL, Triton, LLVM, or other GPU compiler and kernel development tools is a plus.