Refactor Federation Destination Queues (#2807)

Browse source

This is a refactor of the federation destination queues.
It fixes a few things, namely:
- actually retry outgoing events with backoff behaviour
- obtain enough events from the database to fill messages as much as
possible
- minimize the amount of running goroutines
  - use pure timers for backoff
  - don't restart queue unless necessary
  - close the background task when backing off
- increase max edus in a transaction to match the spec
- cleanup timers more aggresively to reduce memory usage
- add jitter to backoff timers to reduce resource spikes
- add a bunch of tests (with real and fake databases) to ensure
everything is working

...

This commit is contained in:

devonh 2022-10-19 10:03:16 +00:00 • committed by GitHub

parent 3aa92efaa3

commit 241d5c47df

No known key found for this signature in database

GPG key ID: 4AEE18F83AFDEB23

8 changed files with 1410 additions and 202 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

1047

federationapi/queue/queue_test.go Normal file

View file

File diff suppressed because it is too large Load diff