Hey guys,
i run many small tasks and want to test the kubernetes executor in the new cloud. Is it wise to use it for this case? It seems to me that starting the tasks takes a long time.
What is the best way to start many short tasks?
best Johannes (merry christmas 
)
For now, Celery is best for many small tasks. We’re working on Knative implementation w/ KubernetesExecutor which should close that gap, and also scale dynamically. You can add more extra space to allow more pods to launch - we do have some very large deployments running lots of tasks w/ KubernetesExecutor on new cloud - but I can’t wait to see the performance impact that Knative will give us