I have data that needs to be moved from azure data lake to cosmosdb. The data is small, maybe < 1000 records per day. Each record is maybe < 5kb. I need this data to be exported from azure data lake and imported to cosmosdb as a timed job. The data should be moved 1 time per day. Ideally this would be configurable to many times a day. Right now I am considering using a function app to spin up on a schedule and make this export/import. However this feels wrong. I feel like there must be a better way to do this. What is the correct way to solve this problem?
CodePudding user response:
You can use copy data tool, with schedule task for source
: Azure Data Lake and sink
: CosmosDB