InnerVault

TensorSharp

Stale GitHub, zhongkaifu

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

Open the source (opens github.com) https://github.com/zhongkaifu/tensorsharp

What it is

AI repositories from zhongkaifu.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/zhongkaifu/TensorSharp.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. starling

    AI repositories

    Local AI in .NET, with no Python sidecar and no API key: embeddings, entity extraction, image and video search and chat on ONNX Runtime (CPU/CUDA), through Microsoft.Extensions.AI.

    Indexed GitHub, starlinghq 102 ★Apache-2.0Updated yesterday

    git clone https://github.com/starlinghq/starling.git
  2. vllm

    AI repositories

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Indexed GitHub, vllm-project 97.0k ★Apache-2.0Updated yesterday

    git clone https://github.com/vllm-project/vllm.git
  3. pegainfer

    AI repositories

    Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    Stale GitHub, pegainfer-project 729 ★Apache-2.0Updated 19 days ago

    git clone https://github.com/pegainfer-project/pegainfer.git
  4. sglang

    AI repositories

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Indexed GitHub, sgl-project 38.9k ★Apache-2.0Updated yesterday

    git clone https://github.com/sgl-project/sglang.git
  5. tt-metal

    AI repositories

    :metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

    Stale GitHub, tenstorrent 1,747 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/tenstorrent/tt-metal.git
  6. gpustack

    AI repositories

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    Indexed GitHub, gpustack 6,039 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/gpustack/gpustack.git