I have a pipeline that loads multiple csv's and an xlsx file into 4 separate tables. Generally, this pipeline runs fine. However, occasionally one of the tables (always the same table) results in an invalid object. If I re-run the pipeline with no changes, all is fine. I have never had an issue with any of the other tables loaded by the pipeline. The table fields are all nvarchar(max) and the data is relatively simple. It is also a very small table. Well under 100 rows, and the data in the source rarely changes. It is definitely not changing between successful and unsuccessful runs.

I am interested in any ideas on what may be causing this periodic failure. All runs fine more than 95% of the time. When it fails, it kills the rest of the load process.

CodePudding user response：

"separate tables" ? The error message points to the fact the table into which you are trying to insert the data does not exist and hence the error .

Are you dropping and creating the tables everytime the pipeline runs ? If yes is the drop table pre script in each of the copy activity or only one ? I am assuming thats only in one copy activity . If thats the case the activity with the prescript should be the first one and then you can add the all the three after that . I am making assumption , if this feedback was not helpfull , share more info on how the pipeline are authored and that will help .

CodePudding user response：

You could refer to this doc about error 208 for the root cause and solution.

This error can be caused by one of the following problems:

1.The object is not specified correctly.

2.The object does not exist in the current database or in the specified database.

3.The object exists, but could not be exposed to the user. For example, the user might not have permissions on the object or the object is created within an EXECUTE statement but accessed outside the scope of the EXECUTE statement.