Skip to content
Reinforcement learning

Push model accuracy past imitation with verifiable rewards.

Go beyond supervised examples when correctness is checkable. The model samples multiple candidate answers, a built-in metric or sandboxed Python function scores each from 0 to 1, and GRPO reinforces what wins.

  • GRPO
  • Python or built-in rewards
  • Best round kept
DATASET V3BASE MODELADAPTER · UPDATEDREWARD · TOKEN F1RL · GRPO8 ROLLOUTS / PROMPTBEST ROUND KEPT

Why reinforcement learning raises the ceiling

Imitation learning plateaus when gold answers are hard to author or multiple valid paths exist. Reward-driven training optimizes the actual grader.

Direct alignment

Optimize the metric you actually care about

Align model weights directly toward valid JSON schemas, exact numeric tolerances, classification accuracy, or custom Python checks.

Safe extensibility

Bring custom Python logic without infra work

Write a clean score(answer, reference) function; Tensorant runs it inside an isolated WASI/sandbox environment with zero credentials exposed.

Zero regression

Automatically keep the highest-scoring checkpoint

Every round evaluates on a fixed validation sample so late-run drift or time limits never overwrite your strongest adapter.

What RL is good for

RL fits answers a rule can check: a number, a label from a list, JSON that follows a schema, or anything a short Python function can score. The reference can be just the part the reward checks.

Only the best round graduates to production.

Each round scores the same sample of up to 128 validation prompts, and the run keeps the adapter of the best round. Even if a run reaches its time limit, it stops early cleanly and preserves its peak checkpoint while holding out your test split.

Tensorant compute or your GPUs
Train on Tensorant compute with credits, or in a GPU account your organization connected with the Own compute subscription.
On every organization
RL is available on every organization with clear preview estimates before launch.
A portable adapter
Test, deploy, benchmark with Inference Autoresearch, publish, or download like any LoRA adapter.

Next step

Train against your first verifiable reward.