We Put Full-Text Search in PostgreSQL, Then ClickHouse. Both Were the Wrong Place.
The logs table stored trace IDs, users, token counts, latency, prompt input, model output, metadata, and variables. We used the same table to show one trace, graph cost by day, filter a feature’s recent spans, and find text a user remembered typing three weeks ago.