I have a 20 GB .CSV file with 300 columns, but I don't want all those 300 columns, I just need 30 of those columns. How can I restrict the unwanted columns to ADF?
Or can I re-frame my question: how to import only specific columns of a .CSV file
Thanks, Pavan
CodePudding user response：
In the copy activity, click on the mapping tab and then click on import schemas. You should be able to see all the columns from your source csv. You can then select the ones you don't need and click on delete.
On doing this, only the columns which left in the mapping will get copied over. See attached screen shot.
CodePudding user response：
This is not my answer just adding more details to my question
Picture Showing we have 274 col's in sourcefile 1 and 2 and lookup has 548
In on-line I want , only 28 Col's in source , I don't want azure to read those un-necessary col to Look up transformation
