i want to install airflow for my k8s cluster. I tried to use the bitnami repo but i want to know how to load dag files from my local filesystem.
CodePudding user response:
One solution we implement is
- Keep the dags,sqls,utils,plugins in github(or any other repo)
- If you are using k8s using AWS then Use EFS(shared file system).
- you can check https://github.com/kubernetes-retired/external-storage/tree/master/aws/efs
- Then you need to mount the efs volume for your scheduler and webserver as readonly option.
This is our preferred approach.