Home > OS >  how to save Azure Data Factory - Copy Data output to a file in ADLS Gen2
how to save Azure Data Factory - Copy Data output to a file in ADLS Gen2

Time:08-30

Does anyone know if this is possible and if not, is there another option to save the output data?

Thanks in advance, Kind regards

CodePudding user response:

Copy activity is used to simply copy the data from source to the sink with some basic transformation. You can use the Linked Service and Dataset to copy the data to a file in the sink.

To Store the file in Azure Data Lake Gen2 (ADLS), you need to have ADLS account.

Create a ADLS account be following simple steps in this Microsoft tutorial – enter image description here

Search for Azure Data Lake Storage Gen2 and select the Azure Data Lake Gen2 connector.

enter image description here

Configure the Linked Service by giving a Name, Subscription name and Azure Data lake Storage account name which you have created by following steps in above shared link.

enter image description here

Later, to create a Dataset, go to Author on left Panel, click on Dataset and New Dataset.

enter image description here

Again, select the Azure Data Lake Storage gen2 for dataset and now select dataset format which is the type of file which it will store. Refer below image.

enter image description here

Give dataset a Name, Select the Linked service which you have created above and click OK.

enter image description here

Now, in Copy activity, under Sink tab, select this dataset under Sink dataset option. Give File extension and run the pipeline using Debug option.

enter image description here

CodePudding user response:

Thank you a lot for your explanation but I obviously didn't ask the question correctly. I apologize, I meant this output:

copy data output - rowsRead, rowsWritten

  • Related