01Input layer
Audio, text and system signals — three formats, one stream.
The audio of a meeting, a customer’s WhatsApp message and a marketplace price feed look nothing alike. The input layer converts them into a shared representation: audio becomes text, free text gets structured, system signals queue up with a timestamp. The layers that follow do not need to know where any of it came from.
02Routing and orchestration
Which task goes to which model — the system decides.
Sending every task to the strongest model is expensive; sending every task to the cheapest one produces wrong answers. The routing layer looks at the type and the requirements of the task and decides which model runs. A small model is enough for a short classification, while a more capable one steps in for multi-step reasoning. That decision is not fixed; it changes with measurement results.
03Processing and verification
Model output is never used raw; it passes a check first.
The model produces a result, but that result does not reach the user raw. Does the output match the expected format, is it consistent with its source, is it above the confidence threshold — all of this is checked. Output below the threshold is either regenerated or sent for human approval. The real defence against hallucination sits in this layer.
04Output layer
A summary, a score, a match — and the source of each.
The output depends on the product: a meeting summary, a profitability score, a driver match. What does not change is that every output is tied to its source. Which sentence a summary came from, which data a score derives from — all of it is recorded. Without that link neither audit nor appeal is possible.