worker-orchestration

Star

Here are 3 public repositories matching this topic...

vgpastor / batchactions

Sponsor

Star

Backend-agnostic bulk data import library with schema validation, batch processing, and state management

nodejs distributed-systems typescript csv etl batch-processing data-pipeline bulk-import worker-orchestration

Updated May 16, 2026
TypeScript

mory-dev / hexdigest-crawl-sharding

Star

Deterministic crawler sharding, lease-aware SQLite state, and safe multi-worker launches.

python open-source crawler sqlite web-scraping scrapy sharding hexdigest distributed-crawling parallel-crawling worker-orchestration crawl-queue hexdigest-crawl-sharding

Updated Aug 28, 2026
Python

A distributed asynchronous job processing system designed to handle concurrent workloads reliably using Redis queues, worker orchestration, retry mechanisms, dead-letter queues, and failure recovery workflows.

reliability-engineering rate-limiting structured-logging retry-strategies dead-letter-queues operational-monitoring async-processing worker-orchestration distributed-queues concurrent-job-execution queue-reconciliation backpressure-handling

Updated Aug 7, 2026
JavaScript

Add this topic to your repo

To associate your repository with the worker-orchestration topic, visit your repo's landing page and select "manage topics."

Learn more

Navigation Menu

worker-orchestration

Here are 3 public repositories matching this topic...

vgpastor / batchactions

mory-dev / hexdigest-crawl-sharding

wavellen / Job-Queue

Add this topic to your repo