I have the following question and would like to receive suggestions on how to solve a certain task. I have a table stored in BigQuery and I would like to create a copy of this table data, within the PostgresSQL database. This Postgres is in CloudSQL.

This export will occur daily, that is, the same table will be exported daily to Postgres, so the ideal is that the solution can be automated in order to be repeated. It cannot be a manual solution

How could I solve this problem?

Thank you

CodePudding user response：

You can use the BigQuery and CloudSQL APIs to do that, exporting the BQ table as CSV to cloud storage and then importing the file as table in CloudSQL. Then you can automate this process using Cloud Functions Cloud Scheduler (or even Cloud DataFlow for more complex pipelines).