Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parallel synchronization #78

Merged
merged 98 commits into from
Oct 19, 2023
Merged

Parallel synchronization #78

merged 98 commits into from
Oct 19, 2023

Conversation

jeromegn
Copy link
Member

Changes:

  • Sync protocol is now driven by the client. This allows syncing in parallel with multiple nodes and optimizing throughput.
  • Adds OpenTelemetry instrumentation (optional)
  • Many more metrics
  • Uses a patches quinn that does not pre-allocate streams, saving hundreds of MBs of memory
  • Fixes deadlocks when accessing the in-memory bookkeeping
  • Batches "cleared" versions inserts to get at actual "current" versions faster
  • Reduced max foca packet size. TODO: This should be configurable in the future.
  • Fix connection pool locking madness

@jeromegn jeromegn merged commit 622c343 into main Oct 19, 2023
3 of 4 checks passed
@jeromegn jeromegn deleted the sync-mem-tweaks branch October 19, 2023 14:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant