Tasks running a PythonOperator that run some java code?

Astronomer Astronomer Nebula
1

Say there exist some tasks running a PythonOperator, which behind the scene run some java code.

on Heroku, this can be achieved by adding a java buildpack to the application.

Does Astronomer provide something similar?

2

There are a few ways you can accomplish this:

  1. We run alpine linux as our base image, so you can specify whatever build dependencies you need in packages.txt (in this case, you can add openjdk8 to that file). This will build all java8 dependencies into your image.

  2. You can run this in a docker container and run in the cloud with the KubernetesPodOperator - you’ll just need to package your java code up in an image and host it somewhere (e.g. Dockerhub).