Skip to content

build(airflow): Add python 3.12 support #614

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ankatiyar merged 21 commits into from
Apr 23, 2024
Merged

build(airflow): Add python 3.12 support #614

Show file tree
Hide file tree
Changes from 20 commits
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
34b1c64
Add python 3.12 support for airflow
ankatiyar Mar 18, 2024
56adc81
Merge branch 'main' into python-3.12-support
ankatiyar Mar 20, 2024
72765ba
temp: update gitpod
ankatiyar Mar 20, 2024
700bf58
Update gitpod
ankatiyar Mar 20, 2024
2673d0a
Update gitpod
ankatiyar Mar 20, 2024
2b721ae
Merge branch 'main' into python-3.12-support
ankatiyar Mar 25, 2024
8ffe517
Resolve path
ankatiyar Mar 25, 2024
76f3469
remove pins
ankatiyar Mar 25, 2024
26b56f8
Try bump apache
ankatiyar Mar 25, 2024
39ca2bc
Try bump apache
ankatiyar Mar 25, 2024
129e655
Revert airflow pin
ankatiyar Mar 25, 2024
683136a
Merge branch 'main' into python-3.12-support
ankatiyar Apr 8, 2024
a955fd8
Revert extra changes
ankatiyar Apr 8, 2024
fd21050
update install kedro-datasets step
ankatiyar Apr 8, 2024
41121c6
try remove install kedro-datasets step
ankatiyar Apr 8, 2024
2beaed0
Install kedro from main
ankatiyar Apr 8, 2024
e3d6362
Revert changes
ankatiyar Apr 8, 2024
1a6da99
Merge branch 'main' into python-3.12-support
ankatiyar Apr 15, 2024
434b73c
Use 3.12 gitpod
ankatiyar Apr 15, 2024
129b42e
Merge branch 'main' into python-3.12-support
ankatiyar Apr 18, 2024
36610f6
Update .gitpod.yml
ankatiyar Apr 22, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/kedro-airflow.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ jobs:
strategy:
matrix:
os: [ ubuntu-latest, windows-latest ]
python-version: [ "3.8", "3.9", "3.10", "3.11" ]
python-version: [ "3.8", "3.9", "3.10", "3.11", "3.12" ]
uses: ./.github/workflows/unit-tests.yml
with:
plugin: kedro-airflow
Expand All @@ -40,7 +40,7 @@ jobs:
strategy:
matrix:
os: [ ubuntu-latest ]
python-version: [ "3.8", "3.9", "3.10", "3.11" ]
python-version: [ "3.8", "3.9", "3.10", "3.11", "3.12" ]
uses: ./.github/workflows/e2e-tests.yml
with:
plugin: kedro-airflow
Expand Down
2 changes: 1 addition & 1 deletion .gitpod.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# Learn more from ready-to-use templates: https://www.gitpod.io/docs/introduction/getting-started/quickstart
image: gitpod/workspace-python-3.10:2023-04-20-16-32-37
image: gitpod/workspace-python-3.12:2023-10-16-15-49-40


tasks:
Expand Down
1 change: 1 addition & 0 deletions kedro-airflow/RELEASE.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@
* Sort DAGs to make sure `kedro airflow create` is deterministic.
* Option to group MemoryDatasets in the same Airflow task (breaking change for custom template via `--jinja-file`).
* Include the environment name in the DAG file name when different from the default.
* Added support for Python 3.12

# Release 0.8.0
* Added support for Kedro 0.19.x
Expand Down
2 changes: 0 additions & 2 deletions kedro-airflow/pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,8 +28,6 @@ test = [
"bandit",
"behave",
"black~=22.0",
"connexion<3.0.0", # TODO: Temporary fix, connexion has changed their API, but airflow hasn't caught up yet
"Flask-Session<0.6", # TODO: Temporary pin, 0.6 breaks apache-airflow
"kedro-datasets",
"pre-commit>=2.9.2",
"pytest",
Expand Down