InnerVault

llama-cpp-agent

Stale GitHub, Maximilian-Winter

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

Open the source (opens github.com) https://github.com/maximilian-winter/llama-cpp-agent

What it is

Agents & frameworks from Maximilian-Winter.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/Maximilian-Winter/llama-cpp-agent.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. hass_local_openai_llm

    Agents & frameworks

    Home Assistant LLM integration for local OpenAI-compatible services (llamacpp, vllm, etc)

    Stale GitHub, skye-harris 305 ★Apache-2.0Updated 15 days ago

    git clone https://github.com/skye-harris/hass_local_openai_llm.git
  2. LLMCompiler

    Agents & frameworks

    [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

    Stale GitHub, SqueezeAILab 1,896 ★MITUpdated 2 years ago

    git clone https://github.com/SqueezeAILab/LLMCompiler.git
  3. ai-agents-from-scratch

    Agents & frameworks

    Demystify AI agents by building them yourself. Local LLMs, no black boxes, real understanding of function calling, memory, and ReAct patterns.

    Stale GitHub, pguso 4,848 ★MITUpdated 3 months ago

    git clone https://github.com/pguso/ai-agents-from-scratch.git
  4. langroid

    Agents & frameworks

    Harness LLMs with Multi-Agent Programming

    Indexed GitHub, langroid 4,152 ★MITUpdated 2 days ago

    git clone https://github.com/langroid/langroid.git
  5. functionary

    Agents & frameworks

    Chat language model that can use tools and interpret the results

    Stale GitHub, MeetKai 1,593 ★MITUpdated 4 months ago

    git clone https://github.com/MeetKai/functionary.git
  6. data-analysis-llm-agent

    Agents & frameworks

    A Data analysis agent powered by llm for querying database and visualizing results

    Stale GitHub, crazycloud 85 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/crazycloud/data-analysis-llm-agent.git