Local-First · Fair-Code · You Own Every Hop

New in 1.0AI Gateway for Claude Code →

Build AI Agents on a Canvas.
Run Them Where You Point.

A no-code, local-first studio for building and running AI agents. Inference runs on your machine — llama.cpp, MLX, or vLLM — or any OpenAI-compatible API you register, chosen per agent and per call by a logical ID like triage-fast. TheYgent never routes your prompts, payloads, or weights through anyone else’s servers.

  • llama.cpp
  • MLX
  • vLLM
  • openai-compatible
~/TheYgent — make up

Sovereignty, Not Surveillance

You Own Every Hop.

TheYgent is never a middleman you didn’t choose. No prompts routed through anyone else’s servers, no captured weights — every hop runs where you point it.

  • Never a Middleman The vendor is never an involuntary hop between you and your model.
  • No Hidden Hops Prompts, payloads, and weights never pass through a server you didn’t choose.
  • Per-Agent, Per-Call Your choice of engine for every node, every run — swap it without touching an edge.
The Whole Idea Swap the engine, keep the ID — triage-fast → MLX, vLLM, or a hosted API

You can register a hosted API whenever you want one; the promise is sovereignty and anti-lock-in — not “nothing ever leaves your machine.” When something crosses the wire, it does so because you sent it there. See everything TheYgent ever connects to →

The Builder

Compose Agents Visually.

A visual AI agent builder: drag nodes onto a canvas, wire them with edges, configure them in the inspector, and run — no code required. The graph is the agent; saving it mints a content-addressed version you can roll back to.

  • input · output
  • llm
  • tool · mcp
  • router · transform · guardrail
  • human · subgraph · loop · map
  • audio · image
Editor · Palette + Inspector

Logical-ID Indirection

One ID per Call. Any Engine Underneath.

Give a model a logical ID once. Swap the engine beneath it — Apple Silicon, an NVIDIA GPU, any machine, or an API you register — and every edge on the canvas stays untouched: no vendor lock-in, no rewiring. Engine choice is per node, not per app: one graph can run local and hosted models side by side. The local engines are built in, not bolted on — TheYgent starts, warms, and unloads them itself, so there is no separate model server to run. On a Mac, that means native MLX →

Bind triage-fast to
logical id binding runs on
triage-fast mlx Apple Silicon
draft-large vllm An NVIDIA GPU
extract-ocr llamacpp Any machine
reason-remote openai-compatible An API you register

MLX serves it on Apple Silicon — GPU and CPU sharing unified memory.

binding ∈ { mlx | vllm | llamacpp | openai-compatible } · source ∈ { hf | local-path | url }

Mix Freely Local + remote in one graph — triage-fast answers on-device, reason-remote escalates to an API you registered

The Runtime

Everything a Real Agent Needs.

Chat, tools, retrieval, models, and automation — one local runtime that orchestrates all of it, no glue code.

chat

Unified Chat

Streaming answers, a collapsible thinking view for reasoning models, and voice and image input — talk to any model or saved agent.

tools

Tools & MCP

Built-in tools, HTTP calls, and any MCP (Model Context Protocol) server over stdio or HTTP — running in your own trust domain.

automation

Triggers

Deploy a saved agent behind a token-authed endpoint, an HMAC-signed webhook, or a cron schedule.

memory

Retrieval Sources

Crawl a site or upload documents, embed them locally into pgvector, and wire RAG retrieval into any graph.

models

Model Registry

Browse the catalog, see what fits your RAM before downloading, and serve chat, vision, audio, and embeddings locally.

the bench

The Bench

Test and benchmark any model or agent: per-turn latency and token metrics, saved and compared side by side.

Production Discipline

Production-Grade by Default.

An agent you can’t replay, trace, or audit is a demo. Every TheYgent run is checkpointed, traced, and kept — and the whole stack deploys the same way everywhere.

  • Durable Runs checkpoint every step. Kill the process mid-run and it resumes from the last completed node — loops, subgraphs, and human approvals included.
  • Observable Every run yields a zoomable span waterfall — per-node inputs, outputs, timing, and token usage — with opt-in OTLP export to your own OpenTelemetry collector.
  • Auditable Runs, sessions, and traces persist in your Postgres. Agents are immutable, content-addressed versions — you can always answer which graph ran, when, and with what.
  • Deployable The same services, self-hosted in every topology: make up on bare metal, Docker Compose, or Kubernetes — never two architectures.

New in 1.0 · The AI Gateway

See What Claude Code Costs. Then Cut It.

The AI Gateway sits between Claude Code and the Anthropic API. It records what every exchange cost and what routing would have saved — then, when you choose, moves work to cheaper models: a cheaper Claude where that’s a drop-in, or models you run yourself.

  • Observe First Every exchange is recorded with its cost and its kind — main conversation, subagent, compaction, or side request — without changing a byte.
  • Route When You Choose Subagents and cold-cache turns move to a cheaper Claude model: Sonnet 5.5 is half the list price of Opus 5.5. A model that refuses hands the request back before Claude Code sees anything.
  • Your Own Models Send a share of each kind of request to models on your inference plane, at no API spend. A trial measures each model on your own traffic first.
  • Honest Reports Spend and savings per day, model, developer, and session, with the reason behind every decision.

Where It Runs

Your Gateway. Your Trust Domain.

The gateway relays Claude Code’s prompts and code, so it runs where you run it: your machine or your cluster, beside Claude Code. It never writes a prompt or a response anywhere.

  • Personal Yours alone, on loopback, with no keys: make up starts one on :8082.
  • Team A gateway key per developer. Each is billed to their own Claude login or API key, or to the organization’s key.
  • Metadata Only The control plane gets timings, models, tokens, costs, and the reasons behind each decision — never prompt or response text.
Runs Everywhere make up · Docker Compose --profile gateway · Kubernetes

The gateway is a hop you add on purpose, and the Anthropic API stays its upstream: whatever a local model doesn’t answer — and some requests it never takes, such as Claude Code’s quota check — goes to Anthropic as before. Local models are verified with llama.cpp.

Walkthroughs

See It Actually Running.

Screen recordings of the real thing on one machine — the whole platform end to end, a voice pipeline, and a single agent driving a local model and a hosted API in the same run.

voice

Voice In, Voice Out

Speech-to-text, a model, and text-to-speech wired on the canvas — a spoken conversation with an agent you built.

All five walkthroughs, with chapters and summaries →

Run It Locally

Up in Three Commands.

Clone the repo, copy the example .env (its defaults work locally), and run make up. The interface, control plane, inference plane, AI Gateway, and Postgres come online locally; engines start lazily when a model is first called.

  • Four local services + your Postgres
  • Bring your own models, or register an API
  • No vendor account — localhost by default
Quickstart
$ git clone https://github.com/al2m4n/TheYgent.git
$ cd TheYgent
$ cp .env.example .env
$ make up
✓ inference-plane   :8081
✓ control-plane     :8080   postgres :5432
✓ interface         :5174
✓ ai-gateway        :8082
# open http://localhost:5174

Questions

Asked and Answered.

What is TheYgent?

TheYgent is a no-code, local-first platform for building and running AI agents on a visual canvas. You drag nodes — LLMs, MCP tools, routers, RAG retrieval, guardrails, human approvals — wire them with edges, and run the graph as an agent. Inference runs on your own machine via llama.cpp, MLX, or vLLM, or on any OpenAI-compatible API you register, chosen per agent and per call.

Is TheYgent open source?

TheYgent is source-available under a fair-code license (the Sustainable Use License), not an OSI-approved open-source license. The full source is on GitHub, and you are free to use, modify, and self-host it for internal business, personal, and non-commercial purposes. Selling it — including offering it as a hosted service — is not permitted.

How does TheYgent compare to other visual AI workflow builders?

Most visual AI workflow builders call a model server you install and run separately. TheYgent runs local models on its own engines, sends no telemetry, and can make every run crash-resumable. The comparison pages set it side by side with four popular builders, with sources and dates — including where each of them is the better pick.

Does TheYgent send my data to the cloud?

TheYgent never routes your prompts, payloads, or model weights through anyone else’s servers — you own every hop. By default everything runs on your machine: local engines, your own Postgres, localhost interfaces. If you register a hosted API for a model, that traffic goes directly from your machine to the provider you chose — it crosses the wire only because you sent it there.

Which local inference engines does TheYgent support?

Three local engines plus a universal escape hatch: llama.cpp (runs on any machine, CPU or GPU), MLX (Apple Silicon), and vLLM (NVIDIA GPUs) — plus any OpenAI-compatible API you register. Models get a logical ID, so you can swap the engine underneath without touching the agent graph, and one graph can mix local and hosted models side by side.

Do I need a separate model server to run local models?

No. TheYgent runs local models on its own engines — llama.cpp, MLX, and vLLM (experimental). Install a model from the in-app Hugging Face catalog, where every variant shows whether it fits your RAM, and the inference plane starts the engine on the first call, keeps it warm, and unloads it when idle. There is no separate model server to install or keep running.

Can TheYgent run offline or air-gapped?

Yes, once it is installed. With models installed from the catalog, or weights copied onto the host and registered by path, the canvas, the engines, Postgres, durable runs, and retrieval with a local embedding model all work with no network. The only automatic request — a public price list fetched at startup — falls back to a bundled copy when offline. Every network touchpoint is listed on the private and offline AI page.

Does TheYgent collect telemetry?

No. TheYgent has no usage analytics, crash reporting, update checks, or license activation, and it needs no vendor account. Traces stay in your own Postgres; OpenTelemetry export is off until you point it at a collector you run.

Can I use MCP (Model Context Protocol) tools in my agents?

Yes. TheYgent connects to any MCP server over stdio or HTTP, and you can browse and install servers from the MCP registry inside the app. MCP tools drop onto the canvas as nodes, so a local model can call the same tools a hosted assistant would — running in your own trust domain.

Do I need to write code to build an agent?

No. The canvas is the whole workflow: drag nodes from the palette, connect them, configure each one in the inspector, and run. Publishing an agent mints an immutable, content-addressed version you can invoke by API, roll back, or wire to a trigger — all without writing code.

Can agents run unattended — on a schedule or from a webhook?

Yes. A published agent can sit behind a token-authenticated endpoint, an HMAC-signed webhook, or a cron schedule. Runs can be durable: every step is checkpointed, so if the process dies mid-run it resumes from the last completed node — loops, subgraphs, and human-approval waits included.

Does TheYgent support human-in-the-loop approvals?

Yes. Drop a human approval node into the graph and the run pauses there until someone approves or rejects it, from the interface or over the API. Approvals run on the durable runtime, so a run can wait minutes or days and still pick up where it left off after a restart.

How do I self-host TheYgent?

Clone the repo, copy .env.example to .env, and run make up for bare metal, or deploy the same services with Docker Compose or Kubernetes — it’s one architecture in every topology. There’s no vendor account and no cloud dependency — the only account is the local admin you create in the first-run wizard; the stack listens on localhost by default and stores everything in your own Postgres.

Does TheYgent support RAG (retrieval-augmented generation)?

Yes. Crawl a site or upload documents, embed them locally into pgvector in your own Postgres, and wire a retrieval node into any graph. Embedding and retrieval both run through engines you choose — keep the embedding model local and your documents never leave your machine; bind a hosted API and they go only where you pointed them.

Can one agent use both local and hosted models?

Yes — engine choice is per node, not per app. A common pattern is a fast local model handling triage on-device while a larger hosted model, reached through an API you registered, takes the escalations. Because nodes reference logical model IDs, swapping any binding later doesn’t touch a single edge.

What is the AI Gateway?

The AI Gateway is a TheYgent service you run between Claude Code and the Anthropic API to cut what Claude Code costs. In observer mode it records every exchange — its cost, its kind of request, and what routing would have saved — without changing it. In router mode it moves work where that is a drop-in: subagents and cold-cache turns to a cheaper Claude model, and a share you choose to models on your own inference plane, each measured on your own traffic first.

Does the AI Gateway see my code and prompts?

Yes — it relays them, so it runs where you run it: your machine or your cluster, in the same trust domain as Claude Code. It never writes a prompt or a response anywhere. What it sends to the control plane is metadata only: timings, model names, token counts, costs, and the reasons behind each routing decision — never prompt or response text.

The License

Source-Available, Fair-Code.

Free to use, modify, and self-host for internal business, personal, and non-commercial use under the Sustainable Use License. What you can’t do: sell it or offer it as a hosted service. No bait-and-switch — the core is the core.

Your Canvas. Your Engines. Your Agents.

No vendor account, no cloud dependency, no lock-in. Clone the repo, run make up, and your first agent is on the canvas in minutes.