Home > OS >  How to move data from azure data lake to cosmosdb on a schedule?
How to move data from azure data lake to cosmosdb on a schedule?

Time:11-19

I have data that needs to be moved from azure data lake to cosmosdb. The data is small, maybe < 1000 records per day. Each record is maybe < 5kb. I need this data to be exported from azure data lake and imported to cosmosdb as a timed job. The data should be moved 1 time per day. Ideally this would be configurable to many times a day. Right now I am considering using a function app to spin up on a schedule and make this export/import. However this feels wrong. I feel like there must be a better way to do this. What is the correct way to solve this problem?

CodePudding user response:

You can use copy data tool, with schedule task for source: Azure Data Lake and sink: CosmosDB

See: enter image description here

enter image description here

  • Related