Skip to content

ci: add automated GCP sandbox integration test workflow triggered daily and on releases#143

Open
yiyche wants to merge 1 commit into
mainfrom
feature/gcp-integration-test-workflow
Open

ci: add automated GCP sandbox integration test workflow triggered daily and on releases#143
yiyche wants to merge 1 commit into
mainfrom
feature/gcp-integration-test-workflow

Conversation

@yiyche

@yiyche yiyche commented Jun 23, 2026

Copy link
Copy Markdown
Member
  • Daily Cron Trigger (gcp_integration_test.yaml): Runs every day at 02:00 UTC, executing tests against the :latest pre-built container images (datacommons-services:latest, datacommons-ingestion-helper:latest, and datacommons-data:latest) to catch daily integration regressions on head.
  • Release Quality Gate (auto_draft_release.yaml): Refactors the Auto-Draft Release workflow to enforce that the E2E GCP sandbox integration test passes successfully before the GitHub draft release and tag (e.g. v1.1.1) are created. If the test fails, the workflow fails, preventing version tagging of buggy code.
  • Manual Trigger (workflow_dispatch): Allows manual execution from the GitHub Actions UI with an optional version tag input override (defaults to latest).
  • WIF Authentication: Authenticates securely to the GCP sandbox environment using Workload Identity Federation (WIF) and service account impersonation.

@gemini-code-assist

Copy link
Copy Markdown
Contributor

Note

Gemini is unable to generate a review for this pull request due to the file types involved not being currently supported.

@yiyche yiyche force-pushed the feature/gcp-integration-test-workflow branch 5 times, most recently from df45270 to 06efafc Compare June 24, 2026 22:47
@yiyche yiyche marked this pull request as ready for review June 24, 2026 22:57
@yiyche yiyche force-pushed the feature/gcp-integration-test-workflow branch from 06efafc to 5dd8ad3 Compare June 24, 2026 23:00
@yiyche yiyche requested a review from dwnoble June 24, 2026 23:01
@yiyche yiyche force-pushed the feature/gcp-integration-test-workflow branch from 5dd8ad3 to 82f7a9a Compare June 24, 2026 23:02
Pulls the latest templates, provisions a completely new isolated sandbox stack in GCP via Terraform (Spanner DB, GCS bucket, Cloud Workflows, and Cloud Run service), performs ingestion, runs the tests, and destroys the sandbox on completion (unless `--keep-sandbox` is specified).
* **Usage:**
```bash
python3 tests/datacommons-integration-tests/gcp_test_runner.py \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use uv to run these so the dependencies are pulled automatically

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants