cuda-kernels

An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.

Samples for CUDA Developers which demonstrates features in CUDA Toolkit

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.

LLM speculative inference server for heterogeneous hardware & consumer GPUs

CUDA Core Compute Libraries

Deep learning in Rust, with shape checked tensors and neural networks

Safe rust wrapper around CUDA toolkit

A machine learning library with a TypeScript API and Rust backend. CUDA and WebGPU compatibility. Built to understand how ML frameworks and models work internally.

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

CUDA Kernel Benchmarking Library

An Axum-based Rust web framework for building and verifying web apps with Lean 4, featuring optional GPU acceleration and integrated development infrastructure for red-teaming and CI/CD.

FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is production VLA control for Pi0, Pi0.5, GROOT N1.6, and Pi0-FAST. Also support llm e.g, qwen3.6-27B

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning

Kernel Tuner

Simple utilities to enable code reuse and portability between CUDA C/C++ and standard C/C++.

Comprehensive CUDA tutorials for Maths & ML with examples

This is an archive of materials produced for an introductory class on CUDA programming at Stanford University in 2010

Amplifier allows .NET developers to easily run complex applications with intensive mathematical computation on Intel CPU/GPU, NVIDIA, AMD without writing any additional C kernel code. Write your function in .NET and Amplifier will take care of running it on your favorite hardware.