Python Queueing / Workflow

asyncio - async and await …

TaskQueues

Evaluating persistent, replicated message queues

RQ — Redis Queue

arq — Job queues and RPC in python with asyncio and redis

https://github.com/pricingassistant/mrq

Celery
- Celery — Distributed Task Queue
- Always remember to set ignore_result=True for tasks which don't return any consumed value.
- https://github.com/stefantalpalaru/generic_celery_task
- Celery Best Practices
- distributed python blogs on Celery
- DockerCelery
- Celery Director - https://github.com/ovh/celery-director
- Asynchronous Tasks with Django and Celery
- Orchestrating Jobs
- Debugging
  https://gist.github.com/amatellanes/a986f6babb9cf8556e36 snipets
  https://www.endpointdev.com/blog/2012/03/debugging-celery-tasks-in-django/
  https://docs.celeryq.dev/en/stable/userguide/monitoring.html
  # ssh into a pod and run celery -A config.celery_app inspect scheduled

python-rq
- python-rq

Workflow
- In many projects Celery is overkill
- TaskFlow from OpenStack
  Examples
- https://github.com/sartography/SpiffWorkflow
  https://spiffworkflow.readthedocs.io/en/latest/#
- Camunda - The Universal Process Orchestrator
  https://hub.docker.com/r/camunda/camunda-bpm-platform
  https://camunda.com/