Secure, Fast, and Extensible Sandbox runtime for AI agents.
-
Updated
Apr 12, 2026 - Python
#
ai-infra
Here are 66 public repositories matching this topic...
🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻 Video Tutorials.
-
Updated
Jul 25, 2025
⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.
visualization python training tracking data-science machine-learning deep-learning tensorflow logging transformers pytorch tensorboard model-versioning mlops ai-infra llm
-
Updated
Apr 11, 2026 - Python
TurboDiffusion: 100–200× Acceleration for Video Diffusion Models
rcm distillation video-generation mlsystem diffusion-models inference-acceleration ai-infra consistency-model sageattention sparse-linear-attention
-
Updated
Apr 8, 2026 - Python
A full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.
agent security scanner vulnerability ai-security ai-infra mcp-scan llm prompt-injection llm-security llm-evaluation prompt-security agent-security ai-red-teaming openclaw-security skill-scanner llm-jailbreak skills-security
-
Updated
Apr 10, 2026 - Python
The context development platform. Store, enrich, and retrieve structured knowledge with graph-native infrastructure, semantic retrieval, and portable context cores.
agent open-source graph sparql rdf ontology context knowledge-graph developer-tools graph-database semantic-search ontology-engineering ai-infra ai-tools neuro-symbolic-ai context-graph agent-memory trustgraph context-engineering context-os
-
Updated
Apr 11, 2026 - Python
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
attention vit quantization video-generation mlsys inference-acceleration ai-infra vision-transformer sparse-attention llm sageattention
-
Updated
Feb 25, 2026 - Cuda
High-performance distributed multi-tier cache system. Built in Rust.
rust ai s3 fluid high-performance-computing cloud-native model-deployment model-training lance inference-acceleration ai-infra opendal lancedb
-
Updated
Apr 10, 2026 - Rust
hpc 教程，包含集合通信(mpi、nccl)、cuda 编程、向量化 SIMD、RDMA 通信等
-
Updated
Apr 7, 2026 - Cuda
Official Repo of Moss
-
Updated
Apr 11, 2026 - TypeScript
SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention
transformer video-generation mlsys inference-acceleration ai-infra linear-attention sparse-attention diffusion-transformer train-acceleration sparse-linear-attention
-
Updated
Feb 24, 2026 - Python
Implement a Pytorch-like DL library in C++ from scratch, step by step
-
Updated
Apr 7, 2026 - C++
Transform your pythonic research to an artifact that engineers can deploy easily.
kubernetes data-science machine-learning production ml data-engineering feature-extraction dataops feature-engineering raptor model-deployment kubeflow mlops ai-infra featurestore raptor-ml feature-platform reactive-ml
-
Updated
Jan 31, 2026 - Go
This is a landscape of the infrastructure that powers the generative AI ecosystem
-
Updated
Oct 16, 2024 - HTML
Cloud Native ML/DL Platform
-
Updated
Sep 9, 2020
A High-Performance LLM Inference Engine with vLLM-Style Continuous Batching
-
Updated
Jan 2, 2026 - C++
Agent Sandbox is an E2B compatible, enterprise-grade ai-first, cloud-native runtime environment for AI Agents. Allows Agents to securely run untrusted LLM-generated Code, Browser use, Computer use, and Shell commands etc. with stateful, long-running, multi-session and multi-tenant.
agent mcp sandbox container code-executor ai-infra agent-sandbox computer-use browser-use ai-sandbox
-
Updated
Apr 10, 2026 - Go
Improve this page
Add a description, image, and links to the ai-infra topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ai-infra topic, visit your repo's landing page and select "manage topics."