GoogleCloudPlatform / GoogleCloudPlatform/deploymentmanager-samples

creating bigquery views take too much space in the google deployment manager yaml, resulting that our deployment-manager.yaml file exceeds 1MB

Open
#523 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jinja
Stars
951
Forks
700
PR merge metrics
No merged PRs in 30d

Description

Problem:
creating bigquery views take too much space in the google deployment manager yaml, resulting that our deployment-manager.yaml file exceeds 1MB:
https://cloud.google.com/deployment-manager/quotas
Question:
Is there a way to insert sql files into the string field in the deployment manager from a bucket or git repository?
https://github.com/GoogleCloudPlatform/deploymentmanager-samples/blob/1c594e5c195427a57016484a0e6b374e32207101/community/cloud-foundation/templates/bigquery/bigquery_table.py.schema#L90

view:
type: object
description: The view definition.
properties:
query:
type: string
description: |
The query that BigQuery executes when the view is referenced.

Or any other ideas to use the deployment manager for a lot of views with long sql statements?
We currently are exploring these options:
1: adapt the deployment manager yaml to use sql files
2: take out the bigquery views from the deployment manager and create custom CI/CD build scripts

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.