Does anyone know if this is possible and if not, is there another option to save the output data?
Thanks in advance, Kind regards
CodePudding user response:
Copy activity is used to simply copy the data from source to the sink with some basic transformation.
You can use the Linked Service
and Dataset
to copy the data to a file in the sink.
To Store the file in Azure Data Lake Gen2 (ADLS), you need to have ADLS account.
Create a ADLS account be following simple steps in this Microsoft tutorial –
Search for Azure Data Lake Storage Gen2
and select the Azure Data Lake Gen2 connector.
Configure the Linked Service by giving a Name, Subscription name and Azure Data lake Storage account name which you have created by following steps in above shared link.
Later, to create a Dataset, go to Author
on left Panel, click on Dataset and New Dataset.
Again, select the Azure Data Lake Storage gen2
for dataset and now select dataset format which is the type of file which it will store. Refer below image.
Give dataset a Name
, Select the Linked service
which you have created above and click OK.
Now, in Copy activity
, under Sink
tab, select this dataset under Sink dataset
option. Give File extension
and run the pipeline using Debug
option.
CodePudding user response:
Thank you a lot for your explanation but I obviously didn't ask the question correctly. I apologize, I meant this output: