FlashRT

Popular repositories Loading

1. FlashRT FlashRT Public

   FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is production VLA control for Pi0, Pi0.5, GROOT N1.6, and Pi0-FAST.…

   C++ 768 100

2. FlashRT-HF-kernels FlashRT-HF-kernels Public

   FlashRT-HF-kernels contains standalone FlashRT CUDA/CUTLASS kernels prepared for the Hugging Face kernels community, focusing on small-batch, low-latency inference paths for LLM, VLA, and physical …

   Python 26 7

3. FlashRT-Structures FlashRT-Structures Public

   Attach FlashRT's verified acceleration structures to an unmodified PyTorch host (lerobot, Isaac-GR00T, openpi, transformers, diffusers, vLLM, SGLang) with no fork and no edit to the host. Kernels a…

   Python 3 2

4. kernels kernels Public

   Forked from huggingface/kernels

   Build compute kernels and load them from the Hub.

   Python 2 1

5. FlashRT-llama.cpp FlashRT-llama.cpp Public

   Native CUDA acceleration for llama.cpp and ggml-based hosts, powered by FlashRT.

   Cuda 2

6. FlashRT-assets FlashRT-assets Public

   FlashRT-assets

   1