← Advanced Concurrency Engineering

In progress

Part 24 - Singleflight: One LLM Call for Many Identical Requests

When twenty workers ask for the embedding of the same breaking story in the same second, one LLM call should serve them all. Part 24 builds singleflight from the standard library, then fixes the three traps in the textbook version: the first caller's deadline cancelling everyone, a panic hanging every waiter, and waiters that cannot give up.

This post is still being written. The title and outline are published so you can follow along with the series — the full article will replace this page when it ships.