starling
Local AI in .NET, with no Python sidecar and no API key: embeddings, entity extraction, image and video search and chat on ONNX Runtime (CPU/CUDA), through Microsoft.Extensions.AI.
Open the source (opens github.com) https://github.com/starlinghq/starling
What it is
AI repositories from starlinghq.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/starlinghq/starling.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
TensorSharp
AI repositoriesA native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability
git clone https://github.com/zhongkaifu/TensorSharp.git -
LangChain
AI repositoriesC# implementation of LangChain. We try to be as close to the original as possible in terms of abstractions, but are open to new entities.
git clone https://github.com/tryAGI/LangChain.git -
MaIN.NET
AI repositoriesNuGet package designed to make LLMs, RAG, and Agents first-class citizens in .NET
git clone https://github.com/mobitouchOS/MaIN.NET.git -
LMCache
AI repositoriesLMCache: Supercharge Your LLM with the Fastest KV Cache Layer
git clone https://github.com/LMCache/LMCache.git -
pegainfer
AI repositoriesPure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
git clone https://github.com/pegainfer-project/pegainfer.git -
vllm
AI repositoriesA high-throughput and memory-efficient inference and serving engine for LLMs
git clone https://github.com/vllm-project/vllm.git