MakoGenerate: AI-Powered GPU Kernel Generation in Under 60 Seconds (opens in new tab)

(mako.dev)

13 pointsmitchwainer9mo ago3 comments

3 comments

This was fun to work on. LLMs for writing kernels still has a long way to go. Its honestly a little surprising how decent they are now. I guess I've been pretty consistently "surprised" by codegen for a while now (meaning the last two years)

mohsaied9mo ago

This is the first step towards fully automated GPU performance optimization. The idea is to automatically generate GPU kernels, then automatically integrate them in vLLM/SGLang/PyTorch.

essamwisam9mo ago

Quite cool. It's interesting that the LLM is able to optimize code based on the target hardware itself.

j / k navigate · click thread line to collapse

3 comments

atallahw9mo ago

mohsaied9mo ago

This is the first step towards fully automated GPU performance optimization. The idea is to automatically generate GPU kernels, then automatically integrate them in vLLM/SGLang/PyTorch.

essamwisam9mo ago

Quite cool. It's interesting that the LLM is able to optimize code based on the target hardware itself.

j / k navigate · click thread line to collapse