← Back to stories
AI Labs

Cohere's North Mini Code Megakernel Serving Engine

Cohere presents the first production-ready LLM serving system built around a decode megakernel, achieving 1.58× speedup over vLLM.

You're reading a preview. The full article is published by Cohere on their website.

Read the full story on Cohere