Actually I've defined a pipeline start date from 12 Dec 2021. This is same as 4 am Singapore time on 13 Dec 2021. As by default the pipeline is in utc, I've set it to 8 pm utc i.e., 4 am sgt The pipeline seems to not trigger at 4 am singapore time,, I don't under stand why the pipeline is not triggered? Below is the dag config
dag = DAG(
'test',
start_date=datetime.datetime(year=2021,month=12,day=12),
schedule_interval='0 20 * * *'
)
CodePudding user response:
Try changing the start date to a few days back, and it will get triggered.
The reason is that the start_date
specifies the first date and time for which you want to have data in a database. Airflow will run a job at start_date interval
, so after the interval has passed (because that’s when data becomes available). You can read more about it here and here.