feat: one Poll Lane per Site, replacing the shared pace (#100)

Browse Source

Each Site runs its own poll goroutine, paced by Rest and Gap from the
registry (sites.go) instead of the shared cooldown/interval/stagger/batch
config. Rest is enforced by the due query's WHERE clause; the Lane sleeps
its effective gap between fetches (hour/eligible, floored at 1s).

Lane-local failures: two refusals stop that Site for 15m, a lost browser
stops only the round's remaining browser Lanes, and cover heals moved to
background goroutines so a slow CDN cannot consume a Lane's gap. The five
LATEST_CHAPTER_POLL_* pace env vars are gone; only the kill switch
remains.

...

This commit is contained in:

Sulthan Zaki

2026-08-16 12:51:01 +07:00

parent ddbd57070d

commit 90ce14aec6

22 changed files with 3645 additions and 1884 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

graphify-out/graph.html

+4 -4

File diff suppressed because one or more lines are too long