Data & ML Talk

Small models, big latency budgets

Not every problem needs a frontier model. Wren compares small, locally run models against large hosted ones on three real tasks, measuring latency, cost and the failure modes nobody puts in a benchmark.

Learn a decision tree for choosing model size and where to cache.

  • ML
  • Latency

Speaker