Azure Data Factory - REST API Call Pagination-CodePudding

I'm making a call for data in Data Factory and struggling to call the url in the "next_page" item.

This is an example of what the first API call returns:

{
"items": [
    {
        "title_one": "TTL-55924",
        "id": "CPT-TTL-64577_TTL-55924",
        "title_id": "TTL-64577"
    },
    {
        "title_one": "TTL-69015",
        "id": "CPT-TTL-79755_TTL-69015",
        "title_id": "TTL-79755"
    }
],
"next_page": "http://api.com/api/info?offset=5000&key=XXXxxxXXXxxx"

}

I'm not sure which options to use in the Pagination Rules of my Copy activity.

Currently I'm trying the option "AbsoluteURL" with the value "$['next_page']" but this just returns an error.

CodePudding user response：

If your API response contains the next page URL property, then the “AbsoluteUrl“ pagination rule is the correct option to load the next page in the Azure data factory.

The supported values for pagination rules are mentioned in this

In your API, the pagination should look like