java.lang.IllegalArgumentException: Input marker does not start with input path-CodePudding

Getting this error in Databricks with the following code. Can anyone explain what the error means?

df.writeStream \
  .format("delta") \
  .option("checkpointLocation", CHECKPOINT_LOCATION) \
  .trigger(once=True) \
  .start(DELTA_FILE_LOCATION)

Error:

java.lang.IllegalArgumentException: Input marker does not start with input path!

CodePudding user response：

I solved this by adding .option("cloudFiles.useIncrementalListing", False)