Founder @Infinirc
Co-maintainer @vllm-project/vllm-metal
Maintainer @llmmanorg/llmman
- 🌐 Infinirc: https://infinirc.com
- 💬 CodgenX (LLM Platform): https://codgenx.infinirc.com
- 🤗 Hugging Face: https://huggingface.co/Infinirc
Founder @Infinirc
Co-maintainer @vllm-project/vllm-metal
Maintainer @llmmanorg/llmman
Community maintained hardware plugin for vLLM on Apple Silicon
A high-throughput and memory-efficient inference and serving engine for LLMs
Community maintained macOS desktop app for vLLM Metal
NVFD — NVIDIA GPU fan control daemon for Linux. Custom curves, fixed speed, auto mode. Works on X11, Wayland & headless via NVML. No nvidia-settings required.
Run any agent on any model, models stored as OCI images