State of the art model architecture
link copiedWe’ve come a long way since GPT-3 introduced LLMs to the world. The core of Avoriana Labs is a principled system for building out recursively self-improving LLMs with the latest model architecture innovations, for maximum bang-per-parameter.
Small to medium parameter count
link copiedFrontier models need expensive, exotic server hardware to run. More modestly sized models — 5 to 500bn parameters — are runnable on ordinary computers today, and we believe will lag the largest frontier models in usefulness by no more than six months.
Intelligence density
link copiedSuccess at Avoriana Labs is defined by increasing the intelligence delivered in an equal-compute-minute. We build our models to deliver outcomes without leaning on excessive time and compute in thinking loops.