← Unovie.AI
Architecture Overview · AgentNexus

AgentNexus: One Rack for a Fleet of Plants

How AgentNexus runs thousands of AI agents across every plant, serves and improves the models they use, and works with the AgentMesh pod at each site — without ever controlling equipment.

Abstract

AgentNexus is a single rack of small servers in a central cabinet. It runs thousands of software agents in sealed sandboxes, serves the language model those agents use, and improves that model over time with small, tested add-ons. It works alongside the AgentMesh pods at each plant, which keep the fast loop next to the machines; AgentNexus works at business speed across all of them and never moves plant equipment. Numbers marked "estimate" have not been measured yet.

1The short version

AgentMesh pods sit next to the machines at each plant and react within milliseconds. Some work doesn't need to be that fast but needs more room: agents that look across several plants, write reports, check work orders, or wait for days for a person to reply. AgentNexus is where that work runs. It answers within about half a second.

CPUs

Run the agents

Every agent runs in its own sealed sandbox. Agents that are idle are saved to disk and put to sleep, then woken when someone needs them. That lets one rack hold far more agents than it could keep running at once.

GPUs

Serve and improve models

One open-weight model, the Unovie Reasoning Model, answers every request. Small add-ons (adapters) specialise it for particular jobs; they're trained on the rack itself, tested, and switched on without restarting anything. A small companion model, the Unovie embedding model, handles search.

Platform

Keep it running

One cluster runs everything. Data is copied so that losing a server, or a whole shelf of four servers, doesn't lose work that was saved. Nothing depends on the internet.

2Where it fits

Plants keep their own AgentMesh pods. AgentNexus sits above them in a central cabinet and talks to them over encrypted links. It sends finished results, such as work orders, to business systems. It never sends commands to plant equipment.

AgentNexus in context Three plants with AgentMesh pods connect over encrypted links to the AgentNexus rack, which has an agents part on CPUs, a models part on GPUs and a shared platform. AgentNexus sends results to IT systems and is used by engineers and pipelines. PLANTS AgentMesh pod Plant A · fast local loop AgentMesh pod Plant B · fast local loop AgentMesh pod Plant C · fast local loop CENTRAL CABINET AgentNexus (one 42U rack) Agents on CPUs sealed sandboxes sleep when idle Models on GPUs router + servers training Platform one cluster software cluster · databases · storage · failover encrypted links · answers in ~0.5 s OUTSIDE IT systems SAP, Maximo, reports People and pipelines engineers, CI, operators results
Figure 1. AgentNexus between the plants and the business systems. Results go out; plant control stays at the plant.

3How it's organised

The rack is split by kind of chip. The processors (CPUs) run agents. The graphics processors (GPUs) do model work. Every server has both, so every server takes part in both. A shared platform underneath keeps them running.

AgentNexus layers Six layers from top to bottom: callers; agents on CPUs with the Unovie Agent Runtime; models on GPUs with the router, model servers, embeddings and the Kiln training; platform services; cluster software; hardware. Who calls it AgentMesh pods at the plants · engineers and pipelines · training scripts Agents (CPUs, all 48 servers) Agent tasks describes and manages agent work Unovie Agent Runtime sealed sandboxes · sleep and wake · controlled way in and out Models (one GPU per server) Model router + Decision Models Model servers Reasoning Model + adapters Embeddings the Unovie embedding model Kiln trains adapters Shared services database · file storage for saved agents and adapters · image store · failover service · monitoring Cluster one cluster for the whole rack; each shelf of four servers is treated as one failure zone Hardware 48 identical servers in 12 shelves · two network switches · fast cables inside each shelf
Figure 2. The layers. Agents never use the GPUs directly; they call the models through the router.

The main parts in plain terms

PartWhat it doesWhere it comes from
Agent tasksLets people describe an agent task in a short file (what to run, what code to fetch, how much memory) and start, pause or stop it.Unovie Agent Runtime
Unovie Agent RuntimeRuns each agent in a sealed sandbox. Saves idle agents to storage and wakes them on demand. Controls what each agent can reach on the network and keeps passwords out of the agents' hands.Unovie platform, built on open source
Unovie Model RouterLooks at each request and decides which model, and which adapter, should answer it.Unovie platform, built on open source
Unovie Decision ModelsSmall models that answer typed questions (pick one of these options, yes or no, score from 1 to 5) with a probability for each answer, without writing text. The smallest helps the router choose; larger ones grade training attempts and check new adapters.Open weights; the smallest already runs in AgentMesh
Unovie RuntimeRuns the language models on the graphics processors and answers requests.Already used in AgentMesh
KilnTrains small adapters that change how the model behaves for a task, using examples and scored attempts. Training runs as a job on one server at a time.Unovie, extended from AgentMesh's nightly Kiln
Unovie embedding modelTurns text into numbers so that similar meanings can be found: used by the router and by agents searching their notes and documents.Open weights
Mesh ArbiterOur own failover service. Notices when a server or shelf stops and moves its work.Unovie, extended from AgentMesh

Which models it uses

The rack standardises on two open models from Google, plus the router project's decision models, so that everything is trained, tested and served the same way. Using another model is a deliberate, recorded decision.

One base model with adapters, plus an embedding model Several agents send requests to the router. The router sends them to the Unovie Reasoning Model, which runs as a compressed copy on 24 GPUs and as a full copy with adapters on 12 GPUs. Adapters such as maintenance, quality and reports are loaded into the full copy while it runs. The Kiln trains new adapters. A separate the Unovie embedding model service turns text into vectors for search and for the router. Small Unovie Decision Models help the router choose and grade training attempts. Maintenance agent Quality agent Report agent Routerpicks model + adapter Unovie Decision Modelsthe smallest helps the router choose · larger ones grade training Unovie Reasoning Model · one model for all answers Compressed copy24 GPUs · fastest Full copy12 GPUs · takes adapters maintenance quality reports swapped in while it runs Kilntrains new adapters Unovie embedding modelturns text into vectors · used for search and by the router
Figure 3. One base model answers everything, in two copies. The full copy can take small adapters, which are tested first and then swapped in without a restart. A separate small model turns text into vectors for search, and small decision models help the router choose.
JobModelHow it's used
Answering requests (agents, chat, tools)Unovie Reasoning Model (open weights)A compressed copy on 24 GPUs for speed; the full-precision copy on 12 GPUs, where adapters can be applied. Already proven on the AgentMesh servers.
Specialised behaviour for a taskAdapters on the Unovie Reasoning Model, trained by the KilnEach request can name its adapter. Up to 8 are active per server at once and 64 kept ready. New ones are switched on without restarting anything.
Search and similarityUnovie embedding model (open weights)Turns text into vectors (lists of numbers) so that similar meaning can be found. Used by the router and by agents searching their notes and documents.
Typed decisions (routing, grading, checks)Unovie Decision Models (open weights)The smallest helps the router choose on every request. Larger ones grade training attempts and test new adapters. The largest (26B) is too big for one server and isn't used.

4What happens, step by step

Three main flows Flow A: an agent asks a question, the router picks a model, the model answers. Flow B: a plant calls an agent, the agent is woken from storage and answers. Flow C: a training run produces an adapter, which is tested, tried on live traffic and then switched on. A · AN AGENT ASKS A MODEL Agentneeds an answer Exit gatechecks it's allowed Routerpicks the model Model server+ adapter if chosen Answerback to the agent B · A PLANT TALKS TO AN AGENT AgentMesh podsends a request Entry gatechecks identity Wake the agentfrom storage if asleep Agent worksmay use flow A Replyagent sleeps later C · A MODEL GETS BETTER Training runtries and scores Kilntrains an adapter Teston held-back cases Trialon a slice of real traffic Switch ononly if it did better results from real use feed the next training run
Figure 4. The three flows that matter most. Flow C is deliberately slow and cautious: an adapter is switched on only after it beats the current one in testing and again on live traffic.

A. An agent asks a model. The agent sends its request to one address. The router reads it, asks a small decision model which option fits, and sends it to the Unovie Reasoning Model: the compressed copy for general work, or the full copy with a specialised adapter. The router's own work is meant to take under a tenth of a second.

B. A plant talks to an agent. Most agents are asleep most of the time, saved to storage. When a request arrives, the agent is loaded onto any free server and woken. The target for waking is under half a second; we haven't measured it on our hardware yet.

C. A model gets better. Once a week for each adapter, if enough new results have come in, a training job starts on one of the 12 training servers. The Kiln asks the model to attempt tasks, has the attempts scored by test environments and larger decision models, and adjusts the adapter. The new adapter is then tested on cases it has never seen, tried quietly on a small share of real requests, and switched on only if it does better than the current one. The scoring code runs in the same sealed sandboxes as the agents.

5The hardware

Every server is the same small machine already used in AgentMesh. Four of them sit on one shelf (three rack units). Twelve shelves fill the rack. Using one model of server everywhere means one spare-parts kit and one software image, and any server can take over from any other.

Rack and shelf Left: the 42U rack with two switches at the top, twelve shelves of four servers, and spare space. Right: one shelf with four servers wired to each other in a full mesh with fast cables, each also connected to both switches. THE RACK (42U) Network switch A Network switch B Shelf 1 · 4 servers Shelf 2 Shelf 3 (shown on the right) Shelf 4 Shelf 5 Shelf 6 Shelf 7 Shelf 8 Shelf 9 Shelf 10 Shelf 11 Shelf 12 ONE SHELF: FOUR SERVERS Server 1reasoning Server 2reasoning Server 4training Server 3model + adapters fast cable diagonals Every server also runs agents on its CPU. Each server has two network cables, one to each switch. The cables inside the shelf carry copies of data between the four servers, so the switches stay free for other traffic.
Figure 5. Left: the rack. Right: one shelf. The GPU jobs shown (two answering with the compressed model, one answering with adapters, one training) are set by a label and can be changed without reinstalling.

One server

ItemWhat it isWhat it's used for
ProcessorAMD Ryzen AI Max+ 395, 16 coresAgents, plus the system itself
Graphics processorRadeon 8060S, built into the same chipOne model server or one training job
Memory64 GB, shared by the processor and graphicsAbout 30 GB for models, about 10 GB for agents, the rest for the system
AI accelerator (NPU)XDNA 2, about 50 TOPS (measured 51)Working, but idle for now: our models can't yet be converted to run on it. We'll test small helper models on it.
StorageSix 2 TB solid-state drives (four on an add-in card)System, fast scratch space, and copies of agent data
NetworkTwo 10 Gb/s ports, plus fast cables to the other three servers on the shelfOne port to each switch, so a switch can fail without loss
Why the decision models don't use the AI accelerator (NPU). Every server has one, and it passes AMD's own test at 51 TOPS. But a model only runs on it after being converted with AMD's tools, and those tools can't yet handle the design of our decision models or the reasoning model. The tools that do run language models on this NPU on Linux only offer a fixed list of models, which doesn't include the base the decision models are built on. Smaller, simpler helper models (the kind that sort alarm texts or classify requests) look like a good fit, so we'll test one on the NPU and move them there if it's as fast and accurate as the graphics chip. That would free graphics time for the main model.
The memory is shared between the processor and the graphics chip. A large model loaded on the GPU leaves less room for agents on the same server, so memory is the resource we plan around most carefully.

6Keeping data safe

How each kind of data is protected depends on how much it would hurt to lose it.

Kind of dataHow it's protectedWhat can be lost
Records of all agents and tasks (the database)Every change is written on two servers in the same shelf, and also copied straight away to a standby in another shelfNothing
Saved (sleeping) agents, trained adaptersSplit into pieces and spread across all 12 shelves, so any 4 shelves can be lostNothing
An agent's work while it's awakeSaved when the agent goes to sleepWork since it last slept, if its server fails. Agents should send results out as they go.
Search indexes (embeddings)Stored with the agents' data; each records which embedding model made itNothing; if the embedding model changes, indexes are rebuilt
Training progressSaved to shared storage every few stepsA few steps of training
Settings and configurationKept in version controlNothing

7When something breaks

What failsWhat happensWho handles it
A driveIts copy is rebuilt on another drive. Nothing stops.Storage software
A network switchEvery server moves to the other switch in about a second.Each server, automatically
A serverModel requests go to the other servers in the same pool. Sleeping agents wake elsewhere. Awake agents on that server restart from their last save.Router, Unovie Agent Runtime, Mesh Arbiter
A whole shelf (four servers)As above, for four servers. The rack loses one twelfth of its capacity until the shelf is back.Same
A training serverIts training job restarts on another training server from the last save.Training job runner
The database serverThe standby in another shelf takes over.Mesh Arbiter
Up to two shelves holding cluster controlThe cluster keeps working; control is spread over five shelves.Cluster software

None of this affects the plants' own fast loop. AgentMesh pods keep running if AgentNexus is unreachable; only the slower, cross-plant work waits.

8How much it can do

These figures are estimates built from measurements on single AgentMesh servers and from the open-source projects' own claims. They'll be replaced with measured numbers after the bench tests.

48
servers in 12 shelves
~860
agents awake at once (estimate)
9k–26k
agents in total, mostly asleep (project's claim)
7–12 kW
power draw (estimate, not measured)
ResourcePer shelfPer rack
Processor cores64768
Memory256 GB3 TB
GPUs serving the reasoning model (compressed copy)224 (about 2,250 tokens (word pieces) per second in total, estimate)
GPUs serving the same model at full precision, with adapters112
GPUs training adapters (the Kiln, one job each)112
Embedding service—3 copies, on processors first
Raw storage40 TB480 TB
The limit is model speed, not agent count. If every awake agent asked the large model a question at the same moment, each would get its answer slowly. In practice agents spend most of their time waiting on tools, people and other systems, and the router sends general requests to the compressed, faster copy of the model. The real number of agents the rack can support depends on how busy they are, and we'll measure it with real workloads.

9What's reused and what's new

Reused from AgentMeshNew for AgentNexus
The server, its drives and the add-in storage card · network switches and fast shelf cables · the operating system image · the cluster software · local storage software · the model server (Unovie Runtime) · the Unovie Reasoning Model · the decision server and Unovie Decision Models · the Mesh Arbiter failover service the Unovie Agent Runtime (agents) · the model router · the Kiln (training) · the embedding model · a database · shared file storage across shelves · a local image store · replicated storage for the most important data

Apart from three small pieces of our own (the job that switches adapters on, the service that starts training jobs, and the link between the router and the decision model), everything new is open source. The rack runs without internet access: software, models and updates are brought in and checked before use.

10Glossary

Agent
A program that works on a task on its own, using models and tools, sometimes over hours or days.
Adapter (LoRA)
A small add-on to a language model that changes its behaviour for a specific job, without retraining the whole model.
AgentMesh
Unovie's pod at each plant. It reacts to equipment signals within milliseconds.
CPU / GPU
The general-purpose processor, and the graphics processor used for model work.
Decision model
A model that answers fixed, typed questions with a probability for each possible answer, instead of writing free text. Fast and easy to check.
Embedding
A list of numbers that stands for the meaning of a piece of text, so that similar texts can be found quickly.
Unovie Reasoning Model
The language model behind every answer: an open-weight model small enough to run on one of our servers.
Cluster
Software that runs and restarts programs across many servers as if they were one system.
NPU
A separate AI accelerator built into the processor. Efficient for small, fixed models, but each model has to be converted for it first.
Sandbox
A sealed space an agent runs in, so it can't reach anything it hasn't been allowed to.
Shelf (pod)
Four servers in three rack units, wired to each other. The unit we build, replace and plan failures around.
Training (reinforcement learning)
Improving a model by letting it try tasks, scoring the results, and nudging it toward the better attempts.