How to push data from Amazon Connect (e.g. Historical Metrics) to Amazon Redshift?-CodePudding

Is there any API i can use or write a lambda function! (GetMetricData)
what steps to follow?
What i am willing to do is push the Amazon Connect Data (like Historical reports) to redshift.
What could be the possible scenarios to accomplish this? Data can be pushed on regular intervals. in other words i want to retrieve data of amazon connect instance in redshift.

CodePudding user response：

copy Agent1 from 's3://my-bucket/connect/oblab2/Reports/Historical Metrics Report (1).csv'
iam_role 'arn:aws:iam::my-rule:role/RedshiftRoleForS3'
csv
null as '\000'
IGNOREHEADER 1;

I am using this (above) to pull the data from s3 to redshift table. its working fine but there is one problem as when data is pulled/copied very first time it inserted into table but when the data get updated in s3 bucket file and we run the same query what it does is add the whole new rows of data instead of overwriting the already created rows.

CodePudding user response：

Solutions Architects at AWS created an opinionated solution for this a few years ago, which is available via a Quick Start (CloudFormation template) here. It may not be fully up to date, as it was created some time ago, but it will likely give you a functional model to follow and the example lambda code you would need to build a solution that works for you.