-
Notifications
You must be signed in to change notification settings - Fork 1k
MLflow for Darts implementation #3022
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
jakubchlapek
wants to merge
145
commits into
unit8co:master
Choose a base branch
from
jakubchlapek:feat/mlflow-base
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from 86 commits
Commits
Show all changes
145 commits
Select commit
Hold shift + click to select a range
5789a99
draft MVP
jakubchlapek dc48b97
covariate support
jakubchlapek 0cc488e
pyfunc series info extension
jakubchlapek b6ce538
unit tests
jakubchlapek 605ecbe
add mlflow to dependencies
jakubchlapek 3c2a2e2
changed to sqlite
jakubchlapek 1750b11
kwargs pyfunc extension
jakubchlapek 30456f5
removing pyfunc draft support: tbd if to include in future
jakubchlapek b69de4a
slight refactor by leveraging built-in mflflow validation util methods
jakubchlapek c488cd7
restructuring module
jakubchlapek 7fe3cf3
autologging refactor w/ mlflow decorator
jakubchlapek ada47b7
refactoring log_model to leverage Model.log
jakubchlapek 9fbe42a
unit test improvenemnts
jakubchlapek a0e663f
ForecastingModel subclasses handling for autolog
jakubchlapek 93ca22a
save models with clean=True
jakubchlapek ac4b0c6
logging update
jakubchlapek a35a834
unused var, tfmodel.load handles .ckpt internally
jakubchlapek 2695cc9
documentation
jakubchlapek 662b8e3
added autolog logging default/provided metrics for all models
jakubchlapek f19d6bf
autolog metric unit tests
jakubchlapek bd932a9
removed redundant tests
jakubchlapek 3b0ecb2
changed callback inject to true by default
jakubchlapek 2d6158d
feat: ensure contiguous tensors in metric updates
jakubchlapek f684041
example quickstart for mlflow
jakubchlapek 4495115
Merge branch 'master' into feat/mlflow-base
jakubchlapek 894779b
unit test mps fix for torch
jakubchlapek c9a1301
typehinting fix
jakubchlapek a65612d
CI hotfix
jakubchlapek 2123742
temporary fix for catboost, to be removed later
jakubchlapek 2b41feb
scrap backtesting in favor of metric patching
jakubchlapek b119e7b
metric patching unit tests
jakubchlapek f561438
pytorch autolog
jakubchlapek df7e097
unit tests for pytorch autolog
jakubchlapek a7e4646
Merge branch 'master' into feat/mlflow-base
daidahao 99f161c
Revert catboost cap
daidahao 1c7b073
Replace raise_if and raise_if_not
daidahao e885b64
Use abs path
daidahao b46cf95
Use direct path for saving model
daidahao 51a47f2
Update #2
daidahao 28c11ed
Use mlflow class utils to replace insepctlib
daidahao ddae08a
Fix tests
daidahao 91f6660
Get all forecasting models ith inspect
daidahao ce56906
Rename `log_torch_metrics`
daidahao 3dcceac
Change `save_model` param order
daidahao 1b7fa89
Update `log_model` params
daidahao b8a4f8d
Remove `log_params` from `log_model()`
daidahao 331c4c3
Update unit tests
daidahao 2396f16
Simplify `_is_torch_model`
daidahao 7646dde
Move `_patched_fit` inside `_autolog()`
daidahao 948ab56
Handle single series in metric patching
daidahao 6ad82f7
Update covariate logging logic
daidahao abf24f5
Update tests and wait for completion
daidahao 774a222
Remove `PL_AVAILABLE` flag
daidahao 3c9296f
Add post-fitting metric TODO note
daidahao a7bca2e
chore: rename mlflow jupyter from 26 to 27
mizeller eb8f8cd
chore: fix jupyter for mlflow; work in progress
mizeller ab59196
Update .gitignore
mizeller 0194744
chore: local test files; remove later
mizeller 1c1b3d0
fix: use MLFlow>=3.0
mizeller e4b6823
Update mlflow_test_v2.py
mizeller 4c239a8
Update pyproject.toml
mizeller 3ce5475
Update mlflow_test_v2.py
mizeller 2d1cd65
feat: support backtest/historical forecasts
mizeller 5acd8de
fix: mlflow test script
mizeller c0b1c6e
fix: remove obsolte file
mizeller d5977c8
fix: formatting
mizeller bbe0bf9
fix: deprecate manage_run
mizeller 09ad117
Update mlflow_test_v2.py
mizeller 5a9f493
feat: metric kwarg support for autolog
jakubchlapek 9113c41
chore: remove redundant metric check
jakubchlapek 845dcd6
fix: check for active run in fit patch
jakubchlapek b9a7b62
feat: infer backtest output dim based on metric/backtests kwargs
jakubchlapek bf497e6
feat: backtest metric testing suite
jakubchlapek 9e4934d
fix: update failing tests due to manage_run deprecation
jakubchlapek 83bf76c
Merge branch 'master' into feat/mlflow-base
jakubchlapek 7b8dbcd
chore: remove temporary test file
jakubchlapek 502db71
feat: update mlflow notebook
jakubchlapek 6dda789
fix: add MLFLOW_AVAILABLE flag
jakubchlapek c3f1df6
feat: align direct metric logging shape to backtesting (based on metr…
jakubchlapek 8b8157b
feat: add missing autolog shape unit test
jakubchlapek 3deccb1
feat: save per-series metrics to csv and the aggregate to mlflow
jakubchlapek 277153f
feat: autolog per-series csv saving tests
jakubchlapek f746d7b
feat: add metric shape and per-series csv saving explanation section …
jakubchlapek a486b25
feat: handle name param for metrics
jakubchlapek e2c6758
chore: changelog
jakubchlapek 248770f
Merge branch 'master' into feat/mlflow-base
dennisbader de8e149
docs: documentation clarifications
jakubchlapek 94eaafe
chore: small code review improvements
jakubchlapek defe8aa
chore: update gitignore
jakubchlapek b5ba0bc
chore: change log_model=False by default and formatting
jakubchlapek 44ca8da
feat: change on error from logs to raise
jakubchlapek 965d802
chore: raise on failure instead of log
jakubchlapek eff9014
chore: remove quantile_num from _infer_metric_axes return tuple
jakubchlapek 5e6a718
feat: remove dataset_name from logged metric pattern
jakubchlapek ce8fd01
fix: align tests to code review changes
jakubchlapek a93ad19
chore: remove classificaition metrics check
jakubchlapek 554e02f
feat: change model import approach
jakubchlapek e36b551
chore: remove redundant dependencies
jakubchlapek 9f93440
feat: add new import logic tests
jakubchlapek d1e80d2
feat: improve metric logging approach and fix import-order issue
jakubchlapek 0d51dc4
feat: new metric logging approach tests
jakubchlapek ae8a072
feat: change per-series saving logic to append
jakubchlapek b3f3031
feat: append on save logic tests
jakubchlapek 529c58f
feat: infer forecast horizon from backtest args
jakubchlapek 069c28a
feat: fc_hzn inference unit test
jakubchlapek 2d513a7
fix: handle multi series covariate logging
jakubchlapek aac668d
feat: covariate tracking unit tests
jakubchlapek 66a0b10
docs: clarify explanation for pytorch autolog approach
jakubchlapek 9570990
feat: remove extra explicit mlflow gorup
jakubchlapek 381cc15
chore: hide log_model mlflow params, expose model and kwargs only
jakubchlapek 9954928
chore: change default pip to core darts
jakubchlapek 16c881f
chore: clean up unreachable code
jakubchlapek 9081dff
feat: align backtesting windows on aggregation to end
jakubchlapek c1abac2
feat: windows alignment on backtest aggregation tests
jakubchlapek ce7e0a2
chore: change quantile formatting to :3f
jakubchlapek 6f30c90
chore: align quantile label tests to :3f format
jakubchlapek fc6ce68
chore: rename quantile/interval/labels labels to axis labels
jakubchlapek 109adc7
chore: align test to new axis naming convention
jakubchlapek 19b2a8b
docs: clean up backtest docstrinjg
jakubchlapek 603eb8e
feat: add agg_func option to autolog() and unit tests
jakubchlapek 69b9ca5
feat: log model creation params as json + tests
jakubchlapek 4c3d014
docs: cleanup
jakubchlapek c9e56e1
feat: ensure same amount of components for logging
jakubchlapek 644374c
docs: align changelog
jakubchlapek a3dde9c
feat: align notebook to code review changes
jakubchlapek 10cf6a6
fix: restrict component count only when not comp reduction
jakubchlapek 9c547aa
fix: log model params fix
jakubchlapek b9e6488
minor updates to docs
dennisbader de3d9ee
Merge branch 'master' into feat/mlflow-base
dennisbader cf4aa3e
Merge branch 'master' into feat/mlflow-base
dennisbader 9568b3d
feat: docs cleanup
jakubchlapek 1b3ac1e
docs: active run clarification
jakubchlapek efb6b9d
feat: log target series info and encoder covs
jakubchlapek f4840c5
chore: remove redudnant comment
jakubchlapek e415957
feat: support logging for historical forecasts retrain=True without p…
jakubchlapek 4424a0d
fix: remove the redundant inconsintent axis logic
jakubchlapek 8067aad
chore: simplify block after hfc logic changes in #3165
jakubchlapek bb44876
chore: extract shared code into helpers from _log_{backtest/metric}
jakubchlapek 805a471
docs: doc clarification
jakubchlapek c40a106
feat: agg timestep metrics
jakubchlapek e059938
chore: align notebook to current solution
jakubchlapek dd1e2c6
chore: simplify changelog entry
jakubchlapek 811e16c
feat: negative x-axis to indicate most recent values
jakubchlapek f9eb3f8
fix: use 0-based step for predictions
jakubchlapek 6f73130
fix: docs fix for CI
jakubchlapek File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.