Add CML Action to run whole workflow #132
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,64 @@ | ||
| name: Generate CML Report | ||
| on: | ||
| pull_request: | ||
| types: [ labeled ] | ||
| branches: | ||
| - master | ||
|
|
||
| jobs: | ||
| generate_cml_report: | ||
| if: ${{ github.event.label.name == ['run-simulation'] }} | ||
| runs-on: ubuntu-latest | ||
| defaults: | ||
| run: | ||
| shell: bash | ||
| container: | ||
| image: ghcr.io/moja-global/rest_api_gcbm:master | ||
| ports: | ||
| - "8080:8080" | ||
| steps: | ||
|
|
||
| - name: Checkout repository | ||
| uses: actions/checkout@v3 | ||
|
|
||
| - uses: actions/setup-node@v3 | ||
| with: | ||
| node-version: 16 | ||
|
|
||
| - name: Run the Simulation | ||
| run: | | ||
| apt-get update && apt-get install unzip -y | ||
| pushd local/rest_api_gcbm/tests/ | ||
| unzip linux-demo.zip | ||
| cd config/ | ||
| /opt/gcbm/moja.cli --config_file gcbm_config.cfg --config_provider provider_config.json | ||
| popd | ||
| cd local/rest_api_gcbm && mkdir GCBM.CompileResults | ||
|
|
||
| - name: Checkout the Repository | ||
|
HarshCasper marked this conversation as resolved.
|
||
| uses: actions/checkout@v3 | ||
| with: | ||
| repository: moja-global/GCBM.CompileResults | ||
| path: local/rest_api_gcbm/GCBM.CompileResults | ||
|
|
||
| - name: Compile the Results | ||
| run: | | ||
| cd local/rest_api_gcbm | ||
| python3 GCBM.CompileResults/compileresults.py sqlite:///tests/output/gcbm_output.db --output_db sqlite:///tests/output/compiled_simulation_output.db | ||
|
|
||
| - name: Install dependencies | ||
|
Contributor
There was a problem hiding this comment. I think these would be fine to add to |
||
| run: pip3 install pandas matplotlib | ||
|
|
||
| - name: Setup CML | ||
| uses: iterative/setup-cml@v1 | ||
|
|
||
| - name: Send the report | ||
| env: | ||
| repo_token: ${{ secrets.GITHUB_TOKEN }} | ||
| run: | | ||
| cd local/rest_api_gcbm | ||
| python3 annual_summaries.py | ||
| echo "# GCBM Model" > report.md | ||
| echo "## Total Biomass Curve" >> report.md | ||
| cml-publish tests/output/total_biomass_mt.png --md >> report.md | ||
| cml-send-comment report.md | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,19 @@ | ||
| import sqlite3 | ||
| import pandas as pd | ||
|
|
||
| conn = sqlite3.connect("tests/output/compiled_simulation_output.db") | ||
|
|
||
| query = f""" | ||
| SELECT years.year, COALESCE(SUM(i.pool_tc), 0) / 1e6 AS total_biomass_mt | ||
| FROM (SELECT DISTINCT year FROM v_age_indicators ORDER BY year) AS years | ||
| LEFT JOIN v_pool_indicators i | ||
| ON years.year = i.year | ||
| WHERE i.indicator = 'Total Biomass' | ||
| AND (years.year BETWEEN 2010 AND 2020) | ||
| GROUP BY years.year | ||
| ORDER BY years.year | ||
| """ | ||
|
|
||
| df = pd.read_sql_query(query, conn) | ||
| ax = df.plot.line("year") | ||
| ax.figure.savefig("tests/output/total_biomass_mt.png", dpi=300) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -10,6 +10,6 @@ flask-cors==3.0.10 | |
| simplejson==3.17.6 | ||
| sqlalchemy==1.4.32 | ||
| psutil==5.9.0 | ||
| pandas | ||
| matplotlib | ||
| rasterio | ||
Binary file not shown.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.