I have a data flow source, a delimited text dataset that points to a folder containing many csv files.

So the source reads all the csv files inside the folder2. The files inside folder2 are

abc.csv
someFile.csv
otherFile_2021.csv
predicted_file_1.csv
predicted_file_2.csv
predicted_file_99.csv

The aim is to read data from only the files like predicted_file_*.csv i.e to only read the last three files. Is it possible to add dynamic content in dataset so that it reads specific pattern files?

CodePudding user response：

In source transformation, under source options, you can provide the wildcard path with filename prefix to read the required files.

Example:

(For debug purpose, I have added column to store the filename to verify the files)

Source:

Source preview:

Refer this document for more information.