Home > OS >  Load the latest folder from azure blob storage to azure data factory
Load the latest folder from azure blob storage to azure data factory

Time:10-06

I have a scenario where I have to fetch the latest folder from the blob storage container and then process all files under that folder through Azure data factory, currently, all folder name based on timestamp and as we know CloudBlobDirectory don't hold LastModified Date so there is no way to extract metadata from Azure data factory activity like last modified time so that I can iterate with the timestamp and process the content.

enter image description here

Is there any other way to perform something like sort on the folder name and then pick it based on string sort (on folder name )?

CodePudding user response:

I tried something similar using Azure functions.

Please have a look and tell if its of use.

https://www.youtube.com/watch?v=eUMjghIEsjw

  • Related