Skip to content

Update NL goldens#6424

Closed
ajaits wants to merge 5 commits into
datacommonsorg:masterfrom
ajaits:master
Closed

Update NL goldens#6424
ajaits wants to merge 5 commits into
datacommonsorg:masterfrom
ajaits:master

Merge branch 'master' into master

62c2082
Select commit
Loading
Failed to load commit list.
Google Cloud Build / website-pull-request-nl (datcom-ci) failed Jul 3, 2026 in 4m 1s

Summary

Build Information

Trigger website-pull-request-nl
Build fe1a5540-639d-442e-b0d2-27b98a2947e9
Start 2026-07-02T21:19:54-07:00
Duration 3m5.678s
Status FAILURE

Steps

Step Status Duration
explore_tests FAILURE 2m41.615s
nl_tests QUEUED 0s

Details

starting build "fe1a5540-639d-442e-b0d2-27b98a2947e9"

FETCHSOURCE
From https://github.com/datacommonsorg/website
 * branch            62c208201e0aa53c245b5ccaa7bcb105748bf98b -> FETCH_HEAD
Updating files:  98% (2277/2303)
Updating files:  99% (2280/2303)
Updating files: 100% (2303/2303)
Updating files: 100% (2303/2303), done.
HEAD is now at 62c2082 Merge branch 'master' into master
GitCommit:
62c208201e0aa53c245b5ccaa7bcb105748bf98b
BUILD
Starting Step #0 - "explore_tests"
Step #0 - "explore_tests": Pulling image: python:3.11.3
Step #0 - "explore_tests": 3.11.3: Pulling from library/python
Step #0 - "explore_tests": bd73737482dd: Pulling fs layer
Step #0 - "explore_tests": 6710592d62aa: Pulling fs layer
Step #0 - "explore_tests": 75256935197e: Pulling fs layer
Step #0 - "explore_tests": c1e5026c6457: Pulling fs layer
Step #0 - "explore_tests": f0016544b8b9: Pulling fs layer
Step #0 - "explore_tests": 1d58eee51ff2: Pulling fs layer
Step #0 - "explore_tests": 93dc7b704cd1: Pulling fs layer
Step #0 - "explore_tests": caefdefa531e: Pulling fs layer
Step #0 - "explore_tests": 93dc7b704cd1: Waiting
Step #0 - "explore_tests": caefdefa531e: Waiting
Step #0 - "explore_tests": f0016544b8b9: Verifying Checksum
Step #0 - "explore_tests": f0016544b8b9: Download complete
Step #0 - "explore_tests": 6710592d62aa: Verifying Checksum
Step #0 - "explore_tests": 6710592d62aa: Download complete
Step #0 - "explore_tests": 1d58eee51ff2: Verifying Checksum
Step #0 - "explore_tests": 1d58eee51ff2: Download complete
Step #0 - "explore_tests": 93dc7b704cd1: Download complete
Step #0 - "explore_tests": caefdefa531e: Verifying Checksum
Step #0 - "explore_tests": caefdefa531e: Download complete
Step #0 - "explore_tests": bd73737482dd: Verifying Checksum
Step #0 - "explore_tests": bd73737482dd: Download complete
Step #0 - "explore_tests": 75256935197e: Verifying Checksum
Step #0 - "explore_tests": 75256935197e: Download complete
Step #0 - "explore_tests": bd73737482dd: Pull complete
Step #0 - "explore_tests": c1e5026c6457: Verifying Checksum
Step #0 - "explore_tests": c1e5026c6457: Download complete
Step #0 - "explore_tests": 6710592d62aa: Pull complete
Step #0 - "explore_tests": 75256935197e: Pull complete
Step #0 - "explore_tests": c1e5026c6457: Pull complete
Step #0 - "explore_tests": f0016544b8b9: Pull complete
Step #0 - "explore_tests": 1d58eee51ff2: Pull complete
Step #0 - "explore_tests": 93dc7b704cd1: Pull complete
Step #0 - "explore_tests": caefdefa531e: Pull complete
Step #0 - "explore_tests": Digest: sha256:3a619e3c96fd4c5fc5e1998fd4dcb1f1403eb90c4c6409c70d7e80b9468df7df
Step #0 - "explore_tests": Status: Downloaded newer image for python:3.11.3
Step #0 - "explore_tests": docker.io/library/python:3.11.3
Step #0 - "explore_tests": Collecting uv
Step #0 - "explore_tests":   Downloading uv-0.11.26-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (26.3 MB)
Step #0 - "explore_tests":      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26.3/26.3 MB 78.3 MB/s eta 0:00:00
Step #0 - "explore_tests": Installing collected packages: uv
Step #0 - "explore_tests": Successfully installed uv-0.11.26
Step #0 - "explore_tests": WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Step #0 - "explore_tests": 
Step #0 - "explore_tests": [notice] A new release of pip available: 22.3.1 -> 26.1.2
Step #0 - "explore_tests": [notice] To update, run: pip install --upgrade pip
Step #0 - "explore_tests": --explore ### Running explore page integration tests
Step #0 - "explore_tests": Using ENV_PREFIX=Staging
Step #0 - "explore_tests": Starting servers using run_servers.sh...
Step #0 - "explore_tests": FLASK_ENV=integration_test
Step #0 - "explore_tests": GOOGLE_CLOUD_PROJECT=datcom-website-staging
Step #0 - "explore_tests": ENABLE_MODEL=true
Step #0 - "explore_tests": Starting NL Server...
Step #0 - "explore_tests": Starting Website server...
Step #0 - "explore_tests": Using CPython 3.11.3 interpreter at: /usr/local/bin/python3
Step #0 - "explore_tests": Creating virtual environment at: nl_server/.venv
Step #0 - "explore_tests": Using CPython 3.11.3 interpreter at: /usr/local/bin/python3
Step #0 - "explore_tests": Creating virtual environment at: server/.venv
Step #0 - "explore_tests":    Updating https://github.com/datacommonsorg/llm-tools.git (HEAD)
Step #0 - "explore_tests": Downloading pynacl (1.4MiB)
Step #0 - "explore_tests": Downloading babel (9.7MiB)
Step #0 - "explore_tests": Downloading cryptography (4.2MiB)
Step #0 - "explore_tests": Downloading google-cloud-discoveryengine (3.2MiB)
Step #0 - "explore_tests": Downloading aiohttp (1.7MiB)
Step #0 - "explore_tests": Downloading pillow (6.7MiB)
Step #0 - "explore_tests": Downloading pyarrow (45.4MiB)
Step #0 - "explore_tests": Downloading numpy (15.7MiB)
Step #0 - "explore_tests": Downloading selenium (9.0MiB)
Step #0 - "explore_tests": Downloading google-cloud-aiplatform (8.0MiB)
Step #0 - "explore_tests": Downloading grpcio (6.5MiB)
Step #0 - "explore_tests": Downloading google-api-python-client (14.2MiB)
Step #0 - "explore_tests": Downloading pydantic-core (2.0MiB)
Step #0 - "explore_tests": Downloading google-adk (2.6MiB)
Step #0 - "explore_tests": Downloading sqlalchemy (3.2MiB)
Step #0 - "explore_tests":     Updated https://github.com/datacommonsorg/llm-tools.git (910626c119181e5096efb9f3090d7ae9f4310c22)
Step #0 - "explore_tests":    Building data-gemma @ git+https://github.com/datacommonsorg/llm-tools.git@910626c119181e5096efb9f3090d7ae9f4310c22
Step #0 - "explore_tests": Downloading setuptools (1.1MiB)
Step #0 - "explore_tests": Downloading networkx (2.0MiB)
Step #0 - "explore_tests": Downloading sympy (6.0MiB)
Step #0 - "explore_tests": Downloading srsly (1.1MiB)
Step #0 - "explore_tests": Downloading pydantic-core (2.0MiB)
Step #0 - "explore_tests": Downloading google-cloud-aiplatform (7.7MiB)
Step #0 - "explore_tests": Downloading hf-xet (4.0MiB)
Step #0 - "explore_tests": Downloading shapely (3.0MiB)
Step #0 - "explore_tests": Downloading blis (9.7MiB)
Step #0 - "explore_tests": Downloading transformers (10.3MiB)
Step #0 - "explore_tests": Downloading safetensors (1.1MiB)
Step #0 - "explore_tests": Downloading spacy (6.3MiB)
Step #0 - "explore_tests": Downloading numpy (17.4MiB)
Step #0 - "explore_tests": Downloading pyarrow (45.5MiB)
Step #0 - "explore_tests": Downloading scikit-learn (12.7MiB)
Step #0 - "explore_tests": Downloading grpcio (6.3MiB)
Step #0 - "explore_tests": Downloading tokenizers (3.0MiB)
Step #0 - "explore_tests": Downloading aiohttp (1.7MiB)
Step #0 - "explore_tests": Downloading scipy (34.2MiB)
Step #0 - "explore_tests": Downloading pandas (11.7MiB)
Step #0 - "explore_tests": Downloading pillow (6.7MiB)
Step #0 - "explore_tests": Downloading torchvision (1.7MiB)
Step #0 - "explore_tests": Downloading torch (183.3MiB)
Step #0 - "explore_tests":  Downloaded pynacl
Step #0 - "explore_tests":  Downloaded aiohttp
Step #0 - "explore_tests":  Downloaded safetensors
Step #0 - "explore_tests":    Building flask-testing==0.8.1
Step #0 - "explore_tests":  Downloaded pydantic-core
Step #0 - "explore_tests":  Downloaded torchvision
Step #0 - "explore_tests":  Downloaded srsly
Step #0 - "explore_tests":    Building langdetect==1.0.9
Step #0 - "explore_tests":  Downloaded aiohttp
Step #0 - "explore_tests":  Downloaded pydantic-core
Step #0 - "explore_tests":  Downloaded sqlalchemy
Step #0 - "explore_tests":  Downloaded setuptools
Step #0 - "explore_tests":  Downloaded cryptography
Step #0 - "explore_tests":  Downloaded tokenizers
Step #0 - "explore_tests":  Downloaded shapely
Step #0 - "explore_tests":  Downloaded google-adk
Step #0 - "explore_tests":  Downloaded networkx
Step #0 - "explore_tests":  Downloaded hf-xet
Step #0 - "explore_tests":  Downloaded pillow
Step #0 - "explore_tests":  Downloaded google-cloud-discoveryengine
Step #0 - "explore_tests":  Downloaded grpcio
Step #0 - "explore_tests":       Built data-gemma @ git+https://github.com/datacommonsorg/llm-tools.git@910626c119181e5096efb9f3090d7ae9f4310c22
Step #0 - "explore_tests":       Built flask-testing==0.8.1
Step #0 - "explore_tests":       Built langdetect==1.0.9
Step #0 - "explore_tests":  Downloaded babel
Step #0 - "explore_tests":  Downloaded numpy
Step #0 - "explore_tests":  Downloaded grpcio
Step #0 - "explore_tests":  Downloaded pillow
Step #0 - "explore_tests":  Downloaded selenium
Step #0 - "explore_tests":  Downloaded google-api-python-client
Step #0 - "explore_tests":  Downloaded google-cloud-aiplatform
Step #0 - "explore_tests":  Downloaded pyarrow
Step #0 - "explore_tests": warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
Step #0 - "explore_tests":          If the cache and target directories are on different filesystems, hardlinking may not be supported.
Step #0 - "explore_tests":          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
Step #0 - "explore_tests":  Downloaded sympy
Step #0 - "explore_tests":  Downloaded blis
Step #0 - "explore_tests":  Downloaded spacy
Step #0 - "explore_tests":  Downloaded google-cloud-aiplatform
Step #0 - "explore_tests": Installed 165 packages in 481ms
Step #0 - "explore_tests": Downloading pygments (1.2MiB)
Step #0 - "explore_tests": Downloading setuptools (1.2MiB)
Step #0 - "explore_tests":  Downloaded scikit-learn
Step #0 - "explore_tests":  Downloaded pygments
Step #0 - "explore_tests":  Downloaded setuptools
Step #0 - "explore_tests": warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
Step #0 - "explore_tests":          If the cache and target directories are on different filesystems, hardlinking may not be supported.
Step #0 - "explore_tests":          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
Step #0 - "explore_tests":  Downloaded numpy
Step #0 - "explore_tests": Installed 9 packages in 111ms
Step #0 - "explore_tests":  Downloaded transformers
Step #0 - "explore_tests":  Downloaded scipy
Step #0 - "explore_tests":  Downloaded pandas
Step #0 - "explore_tests":  Downloaded pyarrow
Step #0 - "explore_tests":  Downloaded torch
Step #0 - "explore_tests": warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
Step #0 - "explore_tests":          If the cache and target directories are on different filesystems, hardlinking may not be supported.
Step #0 - "explore_tests":          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
Step #0 - "explore_tests": ============================= test session starts ==============================
Step #0 - "explore_tests": platform linux -- Python 3.11.3, pytest-9.0.3, pluggy-1.6.0 -- /workspace/server/.venv/bin/python3
Step #0 - "explore_tests": cachedir: .pytest_cache
Step #0 - "explore_tests": rootdir: /workspace
Step #0 - "explore_tests": configfile: pytest.ini
Step #0 - "explore_tests": plugins: rerunfailures-10.2, flakefinder-1.1.0, anyio-4.13.0, xdist-3.2.1
Step #0 - "explore_tests": gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I
Step #0 - "explore_tests": 
[gw0] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw1] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw2] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw3] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw4] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw5] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw6] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw7] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw8] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw9] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw10] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw11] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw12] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw13] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw14] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw15] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw16] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw17] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw18] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw19] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw20] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw21] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw22] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw23] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw24] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw25] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw26] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw27] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw28] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw29] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw30] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw31] linux Python 3.11.3 cwd: /workspace
Step #0 - "explore_tests": 
[gw0] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw1] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw2] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw3] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw4] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw5] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw6] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw8] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw7] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw10] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw9] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw11] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw12] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw13] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw14] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw15] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw16] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw17] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw18] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw19] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw20] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw21] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw22] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw24] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw23] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw25] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw26] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw27] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw28] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw29] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw31] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": 
[gw30] Python 3.11.3 (main, May 23 2023, 13:25:46) [GCC 10.2.1 20210110]
Step #0 - "explore_tests": gw0 [40] / gw1 [40] / gw2 [40] / gw3 [40] / gw4 [40] / gw5 [40] / gw6 [40] / gw7 [40] / gw8 [40] / gw9 [40] / gw10 [40] / gw11 [40] / gw12 [40] / gw13 [40] / gw14 [40] / gw15 [40] / gw16 [40] / gw17 [40] / gw18 [40] / gw19 [40] / gw20 [40] / gw21 [40] / gw22 [40] / gw23 [40] / gw24 [40] / gw25 [40] / gw26 [40] / gw27 [40] / gw28 [40] / gw29 [40] / gw30 [40] / gw31 [40]
Step #0 - "explore_tests": 
Step #0 - "explore_tests": scheduling tests via LoadScheduling
Step #0 - "explore_tests": 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_multivar 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_correlation_bugs 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_answer_places 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_explore_more 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_date_range 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_electrification_demo 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_comparison 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_superlatives 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_edge_cases 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_india_demo 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_bugs 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_statvars 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_statvars 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_context 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_translate 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_correlation 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE1::test_filter_query_disabled 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_default_place 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_sdg_global 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_nl_size 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_us_demo 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_basic 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_undata 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_basic_uae 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_sdg_specialvars 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_sdg_global_specialvars 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_translate 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_undata 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_basic 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_edge_cases2 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_sdg 
Step #0 - "explore_tests": Installed 116 packages in 2.58s
Step #0 - "explore_tests": [04:20:43][INFO    ][util.py:609] ['http://localhost:6070/healthz'] not ready, waiting for 5 seconds 
Step #0 - "explore_tests": [04:20:48][INFO    ][util.py:609] ['http://localhost:6070/healthz'] not ready, waiting for 5 seconds 
Step #0 - "explore_tests": [04:20:53][INFO    ][util.py:609] ['http://localhost:6070/healthz'] not ready, waiting for 5 seconds 
Step #0 - "explore_tests": [04:20:58][INFO    ][util.py:609] ['http://localhost:6070/healthz'] not ready, waiting for 5 seconds 
Step #0 - "explore_tests": [04:21:03][INFO    ][util.py:609] ['http://localhost:6070/healthz'] not ready, waiting for 5 seconds 
Step #0 - "explore_tests": [04:21:08][INFO    ][config_reader.py:120] Loading index and model catalog from: /workspace/nl_server/../deploy/helm_charts/dc_website/nl/catalog.yaml 
Step #0 - "explore_tests": [04:21:08][INFO    ][config_reader.py:86] server config:
Step #0 - "explore_tests": {
Step #0 - "explore_tests":   "version": "1",
Step #0 - "explore_tests":   "default_indexes": [
Step #0 - "explore_tests":     "base_uae_mem"
Step #0 - "explore_tests":   ],
Step #0 - "explore_tests":   "indexes": {
Step #0 - "explore_tests":     "base_uae_mem": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": "/workspace/tools/nl/embeddings/input/base",
Step #0 - "explore_tests":       "model": "uae-large-v1-model",
Step #0 - "explore_tests":       "healthcheck_query": "Life expectancy",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/base_uae_mem_2025_11_03_07_10_42/embeddings.csv"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "bio_ft": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": "/workspace/tools/nl/embeddings/input/bio",
Step #0 - "explore_tests":       "model": "ft-final-v20230717230459-all-MiniLM-L6-v2",
Step #0 - "explore_tests":       "healthcheck_query": "Gene",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/bio_ft_2024_11_08_19_00_38/embeddings.csv"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "medium_ft": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": null,
Step #0 - "explore_tests":       "model": "ft-final-v20230717230459-all-MiniLM-L6-v2",
Step #0 - "explore_tests":       "healthcheck_query": "Life expectancy",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/embeddings_medium_2024_05_09_18_01_32.ft_final_v20230717230459.all-MiniLM-L6-v2.csv"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "base_mistral_mem": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": "/workspace/tools/nl/embeddings/input/base",
Step #0 - "explore_tests":       "model": "sfr-embedding-mistral-model",
Step #0 - "explore_tests":       "healthcheck_query": "Life expectancy",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/base_mistral_mem_2024_07_01_10_23_43/embeddings.csv"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "sdg_ft": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": "/workspace/tools/nl/embeddings/input/sdg",
Step #0 - "explore_tests":       "model": "ft-final-v20230717230459-all-MiniLM-L6-v2",
Step #0 - "explore_tests":       "healthcheck_query": "Hunger",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/sdg_ft_2024_06_24_23_45_46/embeddings.csv"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "undata_ft": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": "/workspace/tools/nl/embeddings/input/undata",
Step #0 - "explore_tests":       "model": "ft-final-v20230717230459-all-MiniLM-L6-v2",
Step #0 - "explore_tests":       "healthcheck_query": "Hunger",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/undata_ft_2024_06_24_23_47_04/embeddings.csv"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "undata_ilo_ft": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": "/workspace/tools/nl/embeddings/input/undata_ilo",
Step #0 - "explore_tests":       "model": "ft-final-v20230717230459-all-MiniLM-L6-v2",
Step #0 - "explore_tests":       "healthcheck_query": "Employment",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/undata_ilo_ft_2024_10_14_13_45_50/embeddings.csv"
Step #0 - "explore_tests":     }
Step #0 - "explore_tests":   },
Step #0 - "explore_tests":   "models": {
Step #0 - "explore_tests":     "cross-encoder-ms-marco-miniilm-l6-v2": {
Step #0 - "explore_tests":       "type": "VERTEXAI",
Step #0 - "explore_tests":       "usage": "RERANKING",
Step #0 - "explore_tests":       "score_threshold": null,
Step #0 - "explore_tests":       "project_id": "datcom-website-dev",
Step #0 - "explore_tests":       "location": "us-central1",
Step #0 - "explore_tests":       "prediction_endpoint_id": "3977846152316846080"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "cross-encoder-mxbai-rerank-base-v1": {
Step #0 - "explore_tests":       "type": "VERTEXAI",
Step #0 - "explore_tests":       "usage": "RERANKING",
Step #0 - "explore_tests":       "score_threshold": null,
Step #0 - "explore_tests":       "project_id": "datcom-website-dev",
Step #0 - "explore_tests":       "location": "us-central1",
Step #0 - "explore_tests":       "prediction_endpoint_id": "284894457873039360"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "uae-large-v1-model": {
Step #0 - "explore_tests":       "type": "VERTEXAI",
Step #0 - "explore_tests":       "usage": "EMBEDDINGS",
Step #0 - "explore_tests":       "score_threshold": 0.7,
Step #0 - "explore_tests":       "project_id": "datcom-nl",
Step #0 - "explore_tests":       "location": "us-central1",
Step #0 - "explore_tests":       "prediction_endpoint_id": "8110162693219942400"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "ft-final-v20230717230459-all-MiniLM-L6-v2": {
Step #0 - "explore_tests":       "type": "LOCAL",
Step #0 - "explore_tests":       "usage": "EMBEDDINGS",
Step #0 - "explore_tests":       "score_threshold": 0.5,
Step #0 - "explore_tests":       "gcs_folder": "gs://datcom-nl-models/ft_final_v20230717230459.all-MiniLM-L6-v2"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "sfr-embedding-mistral-model": {
Step #0 - "explore_tests":       "type": "VERTEXAI",
Step #0 - "explore_tests":       "usage": "EMBEDDINGS",
Step #0 - "explore_tests":       "score_threshold": 0.5,
Step #0 - "explore_tests":       "project_id": "datcom-website-dev",
Step #0 - "explore_tests":       "location": "us-central1",
Step #0 - "explore_tests":       "prediction_endpoint_id": "224012300019826688"
Step #0 - "explore_tests":     }
Step #0 - "explore_tests":   },
Step #0 - "explore_tests":   "enable_reranking": true
Step #0 - "explore_tests": } 
Step #0 - "explore_tests": [04:21:08][INFO    ][gcs.py:50] Download datcom-nl-models/ft_final_v20230717230459.all-MiniLM-L6-v2 to /tmp/datcom-nl-models/ft_final_v20230717230459.all-MiniLM-L6-v2 
Step #0 - "explore_tests": [04:21:08][INFO    ][util.py:609] ['http://localhost:6070/healthz'] not ready, waiting for 5 seconds 
Step #0 - "explore_tests": [04:21:10][INFO    ][SentenceTransformer.py:113] Load pretrained SentenceTransformer: /tmp/datcom-nl-models/ft_final_v20230717230459.all-MiniLM-L6-v2 
Step #0 - "explore_tests": [04:21:12][INFO    ][SentenceTransformer.py:219] Use pytorch device_name: cpu 
Step #0 - "explore_tests": [04:21:12][INFO    ][gcs.py:50] Download datcom-nl-models/base_uae_mem_2025_11_03_07_10_42/embeddings.csv to /tmp/datcom-nl-models/base_uae_mem_2025_11_03_07_10_42/embeddings.csv 
Step #0 - "explore_tests": [04:21:13][INFO    ][util.py:609] ['http://localhost:6070/healthz'] not ready, waiting for 5 seconds 
Step #0 - "explore_tests": [04:21:14][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/base_uae_mem_2025_11_03_07_10_42/embeddings.csv 
Step #0 - "explore_tests": 
Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 7305 examples [00:02, 3227.56 examples/s]
Generating train split: 7305 examples [00:02, 3218.00 examples/s]
Step #0 - "explore_tests": [04:21:16][INFO    ][gcs.py:50] Download datcom-nl-models/bio_ft_2024_11_08_19_00_38/embeddings.csv to /tmp/datcom-nl-models/bio_ft_2024_11_08_19_00_38/embeddings.csv 
Step #0 - "explore_tests": [04:21:17][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/bio_ft_2024_11_08_19_00_38/embeddings.csv 
Step #0 - "explore_tests": 
Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 92 examples [00:00, 1446.00 examples/s]
Step #0 - "explore_tests": [04:21:17][INFO    ][gcs.py:50] Download datcom-nl-models/embeddings_medium_2024_05_09_18_01_32.ft_final_v20230717230459.all-MiniLM-L6-v2.csv to /tmp/datcom-nl-models/embeddings_medium_2024_05_09_18_01_32.ft_final_v20230717230459.all-MiniLM-L6-v2.csv 
Step #0 - "explore_tests": [04:21:18][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/embeddings_medium_2024_05_09_18_01_32.ft_final_v20230717230459.all-MiniLM-L6-v2.csv 
Step #0 - "explore_tests": 
Generating train split: 0 examples [00:00, ? examples/s][04:21:18][INFO    ][util.py:609] ['http://localhost:6070/healthz'] not ready, waiting for 5 seconds 
Step #0 - "explore_tests": 
Generating train split: 10000 examples [00:00, 11122.59 examples/s]
Generating train split: 20000 examples [00:02, 9498.68 examples/s] 
Generating train split: 30000 examples [00:02, 107
...
[Logs truncated due to log size limitations. For full logs, see https://console.cloud.google.com/cloud-build/builds/fe1a5540-639d-442e-b0d2-27b98a2947e9?project=879489846695.]
...
1_10_23_43/embeddings.csv 
Step #0 - "explore_tests": [04:21:23][INFO    ][util.py:609] ['http://localhost:6070/healthz'] not ready, waiting for 5 seconds 
Step #0 - "explore_tests": [04:21:26][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/base_mistral_mem_2024_07_01_10_23_43/embeddings.csv 
Step #0 - "explore_tests": 
Generating train split: 0 examples [00:00, ? examples/s][04:21:28][INFO    ][util.py:609] ['http://localhost:6070/healthz'] not ready, waiting for 5 seconds 
Step #0 - "explore_tests": [04:21:33][INFO    ][util.py:609] ['http://localhost:6070/healthz'] not ready, waiting for 5 seconds 
Step #0 - "explore_tests": 
Generating train split: 7259 examples [00:09, 729.47 examples/s]
Generating train split: 7259 examples [00:09, 728.59 examples/s]
Step #0 - "explore_tests": [04:21:36][INFO    ][gcs.py:50] Download datcom-nl-models/sdg_ft_2024_06_24_23_45_46/embeddings.csv to /tmp/datcom-nl-models/sdg_ft_2024_06_24_23_45_46/embeddings.csv 
Step #0 - "explore_tests": [04:21:37][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/sdg_ft_2024_06_24_23_45_46/embeddings.csv 
Step #0 - "explore_tests": 
Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 4565 examples [00:00, 10654.39 examples/s]
Generating train split: 4565 examples [00:00, 10608.11 examples/s]
Step #0 - "explore_tests": [04:21:38][INFO    ][gcs.py:50] Download datcom-nl-models/undata_ft_2024_06_24_23_47_04/embeddings.csv to /tmp/datcom-nl-models/undata_ft_2024_06_24_23_47_04/embeddings.csv 
Step #0 - "explore_tests": [04:21:38][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/undata_ft_2024_06_24_23_47_04/embeddings.csv 
Step #0 - "explore_tests": 
Generating train split: 0 examples [00:00, ? examples/s][04:21:38][INFO    ][util.py:609] ['http://localhost:6070/healthz'] not ready, waiting for 5 seconds 
Step #0 - "explore_tests": 
Generating train split: 5474 examples [00:00, 10939.67 examples/s]
Generating train split: 5474 examples [00:00, 10897.11 examples/s]
Step #0 - "explore_tests": [04:21:39][INFO    ][gcs.py:50] Download datcom-nl-models/undata_ilo_ft_2024_10_14_13_45_50/embeddings.csv to /tmp/datcom-nl-models/undata_ilo_ft_2024_10_14_13_45_50/embeddings.csv 
Step #0 - "explore_tests": [04:21:39][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/undata_ilo_ft_2024_10_14_13_45_50/embeddings.csv 
Step #0 - "explore_tests": 
Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 86 examples [00:00, 1318.91 examples/s]
Step #0 - "explore_tests": [04:21:39][INFO    ][flask.py:79] NL Server Flask app initialized 
Step #0 - "explore_tests": [04:21:39][INFO    ][nl_app.py:27] Run nl server in local mode (host=localhost), port=6070 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_correlation_simple_place  * Serving Flask app 'nl_server.flask'
Step #0 - "explore_tests":  * Debug mode: on
Step #0 - "explore_tests": [04:21:48][INFO    ][config_reader.py:120] Loading index and model catalog from: /workspace/nl_server/../deploy/helm_charts/dc_website/nl/catalog.yaml 
Step #0 - "explore_tests": [04:21:48][INFO    ][config_reader.py:86] server config:
Step #0 - "explore_tests": {
Step #0 - "explore_tests":   "version": "1",
Step #0 - "explore_tests":   "default_indexes": [
Step #0 - "explore_tests":     "base_uae_mem"
Step #0 - "explore_tests":   ],
Step #0 - "explore_tests":   "indexes": {
Step #0 - "explore_tests":     "base_uae_mem": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": "/workspace/tools/nl/embeddings/input/base",
Step #0 - "explore_tests":       "model": "uae-large-v1-model",
Step #0 - "explore_tests":       "healthcheck_query": "Life expectancy",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/base_uae_mem_2025_11_03_07_10_42/embeddings.csv"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "bio_ft": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": "/workspace/tools/nl/embeddings/input/bio",
Step #0 - "explore_tests":       "model": "ft-final-v20230717230459-all-MiniLM-L6-v2",
Step #0 - "explore_tests":       "healthcheck_query": "Gene",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/bio_ft_2024_11_08_19_00_38/embeddings.csv"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "medium_ft": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": null,
Step #0 - "explore_tests":       "model": "ft-final-v20230717230459-all-MiniLM-L6-v2",
Step #0 - "explore_tests":       "healthcheck_query": "Life expectancy",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/embeddings_medium_2024_05_09_18_01_32.ft_final_v20230717230459.all-MiniLM-L6-v2.csv"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "base_mistral_mem": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": "/workspace/tools/nl/embeddings/input/base",
Step #0 - "explore_tests":       "model": "sfr-embedding-mistral-model",
Step #0 - "explore_tests":       "healthcheck_query": "Life expectancy",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/base_mistral_mem_2024_07_01_10_23_43/embeddings.csv"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "sdg_ft": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": "/workspace/tools/nl/embeddings/input/sdg",
Step #0 - "explore_tests":       "model": "ft-final-v20230717230459-all-MiniLM-L6-v2",
Step #0 - "explore_tests":       "healthcheck_query": "Hunger",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/sdg_ft_2024_06_24_23_45_46/embeddings.csv"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "undata_ft": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": "/workspace/tools/nl/embeddings/input/undata",
Step #0 - "explore_tests":       "model": "ft-final-v20230717230459-all-MiniLM-L6-v2",
Step #0 - "explore_tests":       "healthcheck_query": "Hunger",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/undata_ft_2024_06_24_23_47_04/embeddings.csv"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "undata_ilo_ft": {
Step #0 - "explore_tests":       "store_type": "MEMORY",
Step #0 - "explore_tests":       "source_path": "/workspace/tools/nl/embeddings/input/undata_ilo",
Step #0 - "explore_tests":       "model": "ft-final-v20230717230459-all-MiniLM-L6-v2",
Step #0 - "explore_tests":       "healthcheck_query": "Employment",
Step #0 - "explore_tests":       "embeddings_path": "gs://datcom-nl-models/undata_ilo_ft_2024_10_14_13_45_50/embeddings.csv"
Step #0 - "explore_tests":     }
Step #0 - "explore_tests":   },
Step #0 - "explore_tests":   "models": {
Step #0 - "explore_tests":     "cross-encoder-ms-marco-miniilm-l6-v2": {
Step #0 - "explore_tests":       "type": "VERTEXAI",
Step #0 - "explore_tests":       "usage": "RERANKING",
Step #0 - "explore_tests":       "score_threshold": null,
Step #0 - "explore_tests":       "project_id": "datcom-website-dev",
Step #0 - "explore_tests":       "location": "us-central1",
Step #0 - "explore_tests":       "prediction_endpoint_id": "3977846152316846080"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "cross-encoder-mxbai-rerank-base-v1": {
Step #0 - "explore_tests":       "type": "VERTEXAI",
Step #0 - "explore_tests":       "usage": "RERANKING",
Step #0 - "explore_tests":       "score_threshold": null,
Step #0 - "explore_tests":       "project_id": "datcom-website-dev",
Step #0 - "explore_tests":       "location": "us-central1",
Step #0 - "explore_tests":       "prediction_endpoint_id": "284894457873039360"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "uae-large-v1-model": {
Step #0 - "explore_tests":       "type": "VERTEXAI",
Step #0 - "explore_tests":       "usage": "EMBEDDINGS",
Step #0 - "explore_tests":       "score_threshold": 0.7,
Step #0 - "explore_tests":       "project_id": "datcom-nl",
Step #0 - "explore_tests":       "location": "us-central1",
Step #0 - "explore_tests":       "prediction_endpoint_id": "8110162693219942400"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "ft-final-v20230717230459-all-MiniLM-L6-v2": {
Step #0 - "explore_tests":       "type": "LOCAL",
Step #0 - "explore_tests":       "usage": "EMBEDDINGS",
Step #0 - "explore_tests":       "score_threshold": 0.5,
Step #0 - "explore_tests":       "gcs_folder": "gs://datcom-nl-models/ft_final_v20230717230459.all-MiniLM-L6-v2"
Step #0 - "explore_tests":     },
Step #0 - "explore_tests":     "sfr-embedding-mistral-model": {
Step #0 - "explore_tests":       "type": "VERTEXAI",
Step #0 - "explore_tests":       "usage": "EMBEDDINGS",
Step #0 - "explore_tests":       "score_threshold": 0.5,
Step #0 - "explore_tests":       "project_id": "datcom-website-dev",
Step #0 - "explore_tests":       "location": "us-central1",
Step #0 - "explore_tests":       "prediction_endpoint_id": "224012300019826688"
Step #0 - "explore_tests":     }
Step #0 - "explore_tests":   },
Step #0 - "explore_tests":   "enable_reranking": true
Step #0 - "explore_tests": } 
Step #0 - "explore_tests": [04:21:48][INFO    ][SentenceTransformer.py:113] Load pretrained SentenceTransformer: /tmp/datcom-nl-models/ft_final_v20230717230459.all-MiniLM-L6-v2 
Step #0 - "explore_tests": [04:21:50][INFO    ][SentenceTransformer.py:219] Use pytorch device_name: cpu 
Step #0 - "explore_tests": [04:21:50][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/base_uae_mem_2025_11_03_07_10_42/embeddings.csv 
Step #0 - "explore_tests": [04:21:50][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/bio_ft_2024_11_08_19_00_38/embeddings.csv 
Step #0 - "explore_tests": [04:21:50][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/embeddings_medium_2024_05_09_18_01_32.ft_final_v20230717230459.all-MiniLM-L6-v2.csv 
Step #0 - "explore_tests": [04:21:51][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/base_mistral_mem_2024_07_01_10_23_43/embeddings.csv 
Step #0 - "explore_tests": [04:21:52][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/sdg_ft_2024_06_24_23_45_46/embeddings.csv 
Step #0 - "explore_tests": [04:21:52][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/undata_ft_2024_06_24_23_47_04/embeddings.csv 
Step #0 - "explore_tests": [04:21:52][INFO    ][memory.py:67] Loading embeddings file: /tmp/datcom-nl-models/undata_ilo_ft_2024_10_14_13_45_50/embeddings.csv 
Step #0 - "explore_tests": [04:21:52][INFO    ][flask.py:79] NL Server Flask app initialized 
Step #0 - "explore_tests": [04:21:52][INFO    ][nl_app.py:27] Run nl server in local mode (host=localhost), port=6070 
Step #0 - "explore_tests": [04:21:52][WARNING ][_internal.py:97]  * Debugger is active! 
Step #0 - "explore_tests": [04:21:52][INFO    ][util.py:595] http://localhost:6070/healthz is up running 
Step #0 - "explore_tests": [04:21:52][INFO    ][gcs.py:50] Download datcom-website-config/nl_bad_words.txt to /tmp/datcom-website-config/nl_bad_words.txt 
Step #0 - "explore_tests": [04:21:53][INFO    ][util.py:595] https://staging.api.datacommons.org/version is up running 
Step #0 - "explore_tests": [04:21:53][INFO    ][web_app.py:28] Run web server in local mode 
Step #0 - "explore_tests":  * Serving Flask app 'server.__init__'
Step #0 - "explore_tests":  * Debug mode: on
Step #0 - "explore_tests": [04:22:00][INFO    ][util.py:595] http://localhost:6070/healthz is up running 
Step #0 - "explore_tests": [04:22:01][INFO    ][util.py:595] https://staging.api.datacommons.org/version is up running 
Step #0 - "explore_tests": [04:22:01][INFO    ][web_app.py:28] Run web server in local mode 
Step #0 - "explore_tests": [04:22:01][WARNING ][_internal.py:97]  * Debugger is active! 
Step #0 - "explore_tests": 
Step #0 - "explore_tests": [gw18] [  2%] SKIPPED server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_answer_places 
Step #0 - "explore_tests": [gw0] [  5%] PASSED server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_basic 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_fallbacks 
Step #0 - "explore_tests": [gw15] [  7%] PASSED server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_sdg_specialvars 
Step #0 - "explore_tests": [gw14] [ 10%] PASSED server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_sdg_global_specialvars 
Step #0 - "explore_tests": [gw12] [ 12%] PASSED server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_sdg 
Step #0 - "explore_tests": [gw8] [ 15%] PASSED server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_basic 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_toolformer_rig_mode 
Step #0 - "explore_tests": [gw13] [ 17%] PASSED server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_sdg_global 
Step #0 - "explore_tests": [04:22:09][INFO    ][llm_api.py:87] Gemini model used for LLM API: gemini-3-flash-preview 
Step #0 - "explore_tests": [04:22:09][INFO    ][models.py:5613] AFC is enabled with max remote calls: 10. 
Step #0 - "explore_tests": [04:22:09][INFO    ][llm_api.py:87] Gemini model used for LLM API: gemini-3-flash-preview 
Step #0 - "explore_tests": [04:22:09][INFO    ][models.py:5613] AFC is enabled with max remote calls: 10. 
Step #0 - "explore_tests": [04:22:09][INFO    ][llm_api.py:87] Gemini model used for LLM API: gemini-3-flash-preview 
Step #0 - "explore_tests": [04:22:09][INFO    ][models.py:5613] AFC is enabled with max remote calls: 10. 
Step #0 - "explore_tests": [04:22:09][INFO    ][llm_api.py:87] Gemini model used for LLM API: gemini-3-flash-preview 
Step #0 - "explore_tests": [04:22:09][INFO    ][models.py:5613] AFC is enabled with max remote calls: 10. 
Step #0 - "explore_tests": [gw17] [ 20%] PASSED server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_undata 
Step #0 - "explore_tests": [gw1] [ 22%] PASSED server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_basic_uae 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_high_sv_threshold 
Step #0 - "explore_tests": [gw16] [ 25%] PASSED server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_statvars 
Step #0 - "explore_tests": [gw9] [ 27%] PASSED server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_explore_more 
Step #0 - "explore_tests": [gw10] [ 30%] PASSED server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_correlation 
Step #0 - "explore_tests": [gw11] [ 32%] PASSED server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_nl_size 
Step #0 - "explore_tests": [gw7] [ 35%] PASSED server/integration_tests/explore_test.py::ExploreTestFulfillment::test_fulfillment_comparison 
Step #0 - "explore_tests": [gw19] [ 37%] PASSED server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_correlation_bugs 
Step #0 - "explore_tests": [gw2] [ 40%] PASSED server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_bugs 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_single_date 
Step #0 - "explore_tests": [04:22:14][INFO    ][_client.py:1025] HTTP Request: POST https://generativelanguage.googleapis.com/v1beta/models/gemini-3-flash-preview:generateContent "HTTP/1.1 200 OK" 
Step #0 - "explore_tests": [gw28] [ 42%] PASSED server/integration_tests/explore_test.py::ExploreTestEE1::test_filter_query_disabled 
Step #0 - "explore_tests": [04:22:16][INFO    ][_client.py:1025] HTTP Request: POST https://generativelanguage.googleapis.com/v1beta/models/gemini-3-flash-preview:generateContent "HTTP/1.1 200 OK" 
Step #0 - "explore_tests": [gw23] [ 45%] PASSED server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_superlatives 
Step #0 - "explore_tests": [gw6] [ 47%] PASSED server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_translate 
Step #0 - "explore_tests": [04:22:17][INFO    ][_client.py:1025] HTTP Request: POST https://generativelanguage.googleapis.com/v1beta/models/gemini-3-flash-preview:generateContent "HTTP/1.1 200 OK" 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_toolformer_rag_mode 
Step #0 - "explore_tests": [gw5] [ 50%] PASSED server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_statvars 
Step #0 - "explore_tests": [04:22:18][INFO    ][_client.py:1025] HTTP Request: POST https://generativelanguage.googleapis.com/v1beta/models/gemini-3-flash-preview:generateContent "HTTP/1.1 200 OK" 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_strict_multi_verb 
Step #0 - "explore_tests": [gw1] [ 52%] PASSED server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_high_sv_threshold 
Step #0 - "explore_tests": [gw3] [ 55%] RERUN server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_context 
Step #0 - "explore_tests": [04:22:18][INFO    ][llm_api.py:87] Gemini model used for LLM API: gemini-3-flash-preview 
Step #0 - "explore_tests": [04:22:18][INFO    ][models.py:5613] AFC is enabled with max remote calls: 10. 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_context 
Step #0 - "explore_tests": [gw26] [ 57%] PASSED server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_undata 
Step #0 - "explore_tests": [04:22:23][INFO    ][llm_api.py:87] Gemini model used for LLM API: gemini-3-flash-preview 
Step #0 - "explore_tests": [04:22:23][INFO    ][models.py:5613] AFC is enabled with max remote calls: 10. 
Step #0 - "explore_tests": [04:22:24][INFO    ][_client.py:1025] HTTP Request: POST https://generativelanguage.googleapis.com/v1beta/models/gemini-3-flash-preview:generateContent "HTTP/1.1 200 OK" 
Step #0 - "explore_tests": [04:22:24][INFO    ][_client.py:1025] HTTP Request: POST https://generativelanguage.googleapis.com/v1beta/models/gemini-3-flash-preview:generateContent "HTTP/1.1 200 OK" 
Step #0 - "explore_tests": [gw29] [ 60%] PASSED server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_correlation_simple_place 
Step #0 - "explore_tests": [gw3] [ 60%] RERUN server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_context 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_context 
Step #0 - "explore_tests": [gw25] [ 62%] RERUN server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_translate 
Step #0 - "explore_tests": [04:22:26][INFO    ][llm_api.py:87] Gemini model used for LLM API: gemini-3-flash-preview 
Step #0 - "explore_tests": [04:22:26][INFO    ][models.py:5613] AFC is enabled with max remote calls: 10. 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_translate 
Step #0 - "explore_tests": [gw5] [ 65%] PASSED server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_strict_multi_verb 
Step #0 - "explore_tests": [gw8] [ 67%] PASSED server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_toolformer_rig_mode 
Step #0 - "explore_tests": [gw0] [ 70%] PASSED server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_fallbacks 
Step #0 - "explore_tests": [04:22:30][INFO    ][llm_api.py:87] Gemini model used for LLM API: gemini-3-flash-preview 
Step #0 - "explore_tests": [04:22:30][INFO    ][models.py:5613] AFC is enabled with max remote calls: 10. 
Step #0 - "explore_tests": [04:22:32][INFO    ][_client.py:1025] HTTP Request: POST https://generativelanguage.googleapis.com/v1beta/models/gemini-3-flash-preview:generateContent "HTTP/1.1 200 OK" 
Step #0 - "explore_tests": [gw20] [ 72%] PASSED server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_edge_cases 
Step #0 - "explore_tests": [gw3] [ 72%] FAILED server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_context 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_strict_default_place 
Step #0 - "explore_tests": [04:22:33][INFO    ][_client.py:1025] HTTP Request: POST https://generativelanguage.googleapis.com/v1beta/models/gemini-3-flash-preview:generateContent "HTTP/1.1 200 OK" 
Step #0 - "explore_tests": [gw22] [ 75%] PASSED server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_electrification_demo 
Step #0 - "explore_tests": [gw30] [ 77%] PASSED server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_default_place 
Step #0 - "explore_tests": [gw25] [ 77%] PASSED server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_translate 
Step #0 - "explore_tests": [gw24] [ 80%] PASSED server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_india_demo 
Step #0 - "explore_tests": [gw4] [ 82%] PASSED server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_multivar 
Step #0 - "explore_tests": server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_strict_multi_sv 
Step #0 - "explore_tests": [gw2] [ 85%] PASSED server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_single_date 
Step #0 - "explore_tests": [gw21] [ 87%] PASSED server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_edge_cases2 
Step #0 - "explore_tests": [gw27] [ 90%] PASSED server/integration_tests/explore_test.py::ExploreTestEE1::test_e2e_us_demo 
Step #0 - "explore_tests": [gw4] [ 92%] PASSED server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_strict_multi_sv 
Step #0 - "explore_tests": [gw6] [ 95%] PASSED server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_toolformer_rag_mode 
Step #0 - "explore_tests": [gw3] [ 97%] PASSED server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_strict_default_place 
Step #0 - "explore_tests": [gw31] [100%] PASSED server/integration_tests/explore_test.py::ExploreTestEE2::test_e2e_date_range 
Step #0 - "explore_tests": 
Step #0 - "explore_tests": =================================== FAILURES ===================================
Step #0 - "explore_tests": _________________ ExploreTestDetection.test_detection_context __________________
Step #0 - "explore_tests": [gw3] linux -- Python 3.11.3 /workspace/server/.venv/bin/python3
Step #0 - "explore_tests": 
Step #0 - "explore_tests": self = <workspace.server.integration_tests.explore_test.ExploreTestDetection testMethod=test_detection_context>
Step #0 - "explore_tests": 
Step #0 - "explore_tests":     def test_detection_context(self):
Step #0 - "explore_tests": >     self.run_detection('detection_api_context', [
Step #0 - "explore_tests":           'States with highest PHDs', 'Commute in tracts of California',
Step #0 - "explore_tests":           'Compare with Nevada', 'Correlate with asthma',
Step #0 - "explore_tests":           'countries with greenhouse gas emissions',
Step #0 - "explore_tests":           'median income in Santa Clara county and Alameda county'
Step #0 - "explore_tests":       ])
Step #0 - "explore_tests": 
Step #0 - "explore_tests": server/integration_tests/explore_test.py:303: 
Step #0 - "explore_tests": _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
Step #0 - "explore_tests": server/integration_tests/explore_test.py:70: in run_detection
Step #0 - "explore_tests":     self.handle_response(q, resp, test_dir, d, failure, check_detection)
Step #0 - "explore_tests": server/integration_tests/explore_test.py:197: in handle_response
Step #0 - "explore_tests":     self.assertEqual(a, b)
Step #0 - "explore_tests": E   AssertionError: '{\n [63 chars]    "quantity": {\n        "idx": 0,\n        [1124 chars]]\n}' != '{\n [63 chars]    "ranking_type": [\n        1\n      ],\n  [946 chars]]\n}'
Step #0 - "explore_tests": E     {
Step #0 - "explore_tests": E       "childEntityType": "State",
Step #0 - "explore_tests": E       "classifications": [
Step #0 - "explore_tests": E   -     {
Step #0 - "explore_tests": E   -       "quantity": {
Step #0 - "explore_tests": E   -         "idx": 0,
Step #0 - "explore_tests": E   -         "qval": {
Step #0 - "explore_tests": E   -           "cmp": "GE",
Step #0 - "explore_tests": E   -           "val": 2.2250738585072014e-308
Step #0 - "explore_tests": E   -         }
Step #0 - "explore_tests": E   -       },
Step #0 - "explore_tests": E   -       "type": 3
Step #0 - "explore_tests": E   -     },
Step #0 - "explore_tests": E         {
Step #0 - "explore_tests": E           "ranking_type": [
Step #0 - "explore_tests": E             1
Step #0 - "explore_tests": E           ],
Step #0 - "explore_tests": E           "type": 2
Step #0 - "explore_tests": E         },
Step #0 - "explore_tests": E         {
Step #0 - "explore_tests": E           "contained_in_place_type": "State",
Step #0 - "explore_tests": E           "had_default_type": false,
Step #0 - "explore_tests": E           "type": 4
Step #0 - "explore_tests": E         }
Step #0 - "explore_tests": E       ],
Step #0 - "explore_tests": E       "client": "test_detect",
Step #0 - "explore_tests": E       "comparisonEntities": [],
Step #0 - "explore_tests": E       "comparisonVariables": [],
Step #0 - "explore_tests": E       "context": {},
Step #0 - "explore_tests": E       "debug": {},
Step #0 - "explore_tests": E       "entities": [
Step #0 - "explore_tests": E         "country/USA"
Step #0 - "explore_tests": E       ],
Step #0 - "explore_tests": E       "nonPlaceEntities": [],
Step #0 - "explore_tests": E       "properties": [],
Step #0 - "explore_tests": E       "sessionId": "007_999999999",
Step #0 - "explore_tests": E       "variables": [
Step #0 - "explore_tests": E         "Count_Person_EducationalAttainmentDoctorateDegree",
Step #0 - "explore_tests": E         "Count_Person_25OrMoreYears_EducationalAttainmentDoctorateDegree_Female",
Step #0 - "explore_tests": E         "Count_Person_25OrMoreYears_EducationalAttainmentDoctorateDegree_Male",
Step #0 - "explore_tests": E         "Count_Person_25OrMoreYears_DoctorateDegree_AsFractionOf_Count_Person_25OrMoreYears",
Step #0 - "explore_tests": E         "Count_Person_25OrMoreYears_Female_DoctorateDegree_AsFractionOf_Count_Person_25OrMoreYears_Female",
Step #0 - "explore_tests": E         "Count_Person_25OrMoreYears_Male_DoctorateDegree_AsFractionOf_Count_Person_25OrMoreYears_Male",
Step #0 - "explore_tests": E         "dc/topic/StudentsInCollege"
Step #0 - "explore_tests": E       ]
Step #0 - "explore_tests": E     }
Step #0 - "explore_tests": =============================== warnings summary ===============================
Step #0 - "explore_tests": server/.venv/lib/python3.11/site-packages/flask_babel/__init__.py:183: 32 warnings
Step #0 - "explore_tests":   /workspace/server/.venv/lib/python3.11/site-packages/flask_babel/__init__.py:183: DeprecationWarning: 'locked_cached_property' is deprecated and will be removed in Flask 2.4. Use a lock inside the decorated function if locking is needed.
Step #0 - "explore_tests":     @locked_cached_property
Step #0 - "explore_tests": 
Step #0 - "explore_tests": -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
Step #0 - "explore_tests": =========================== short test summary info ============================
Step #0 - "explore_tests": FAILED server/integration_tests/explore_test.py::ExploreTestDetection::test_detection_context - AssertionError: '{\n [63 chars]    "quantity": {\n        "idx": 0,\n        [1124 chars]]\n}' != '{\n [63 chars]    "ranking_type": [\n        1\n      ],\n  [946 chars]]\n}'
Step #0 - "explore_tests":   {
Step #0 - "explore_tests":     "childEntityType": "State",
Step #0 - "explore_tests":     "classifications": [
Step #0 - "explore_tests": -     {
Step #0 - "explore_tests": -       "quantity": {
Step #0 - "explore_tests": -         "idx": 0,
Step #0 - "explore_tests": -         "qval": {
Step #0 - "explore_tests": -           "cmp": "GE",
Step #0 - "explore_tests": -           "val": 2.2250738585072014e-308
Step #0 - "explore_tests": -         }
Step #0 - "explore_tests": -       },
Step #0 - "explore_tests": -       "type": 3
Step #0 - "explore_tests": -     },
Step #0 - "explore_tests":       {
Step #0 - "explore_tests":         "ranking_type": [
Step #0 - "explore_tests":           1
Step #0 - "explore_tests":         ],
Step #0 - "explore_tests":         "type": 2
Step #0 - "explore_tests":       },
Step #0 - "explore_tests":       {
Step #0 - "explore_tests":         "contained_in_place_type": "State",
Step #0 - "explore_tests":         "had_default_type": false,
Step #0 - "explore_tests":         "type": 4
Step #0 - "explore_tests":       }
Step #0 - "explore_tests":     ],
Step #0 - "explore_tests":     "client": "test_detect",
Step #0 - "explore_tests":     "comparisonEntities": [],
Step #0 - "explore_tests":     "comparisonVariables": [],
Step #0 - "explore_tests":     "context": {},
Step #0 - "explore_tests":     "debug": {},
Step #0 - "explore_tests":     "entities": [
Step #0 - "explore_tests":       "country/USA"
Step #0 - "explore_tests":     ],
Step #0 - "explore_tests":     "nonPlaceEntities": [],
Step #0 - "explore_tests":     "properties": [],
Step #0 - "explore_tests":     "sessionId": "007_999999999",
Step #0 - "explore_tests":     "variables": [
Step #0 - "explore_tests":       "Count_Person_EducationalAttainmentDoctorateDegree",
Step #0 - "explore_tests":       "Count_Person_25OrMoreYears_EducationalAttainmentDoctorateDegree_Female",
Step #0 - "explore_tests":       "Count_Person_25OrMoreYears_EducationalAttainmentDoctorateDegree_Male",
Step #0 - "explore_tests":       "Count_Person_25OrMoreYears_DoctorateDegree_AsFractionOf_Count_Person_25OrMoreYears",
Step #0 - "explore_tests":       "Count_Person_25OrMoreYears_Female_DoctorateDegree_AsFractionOf_Count_Person_25OrMoreYears_Female",
Step #0 - "explore_tests":       "Count_Person_25OrMoreYears_Male_DoctorateDegree_AsFractionOf_Count_Person_25OrMoreYears_Male",
Step #0 - "explore_tests":       "dc/topic/StudentsInCollege"
Step #0 - "explore_tests":     ]
Step #0 - "explore_tests":   }
Step #0 - "explore_tests": == 1 failed, 38 passed, 1 skipped, 32 warnings, 3 rerun in 136.15s (0:02:16) ===
Finished Step #0 - "explore_tests"
ERROR
ERROR: build step 0 "python:3.11.3" failed: step exited with non-zero status: 1

Build Log: https://console.cloud.google.com/cloud-build/builds/fe1a5540-639d-442e-b0d2-27b98a2947e9?project=879489846695