EDA workflow#804
Open
metdyn wants to merge 30 commits into
Open
Conversation
…r_central_block(None))
+ self.jedi_rendering.add_key('saber_outer_block', self.config.saber_outer_block(None))
ens_mean_var read output from obs perturbed 3d-Var
{% for i in range( 1, models[model_component]['ensemble_num_members'] + 1 ) %}
{% for i in range(1, 5) %}
it is only 50% working
ensemble_block.py two_states.py state_ensemble.py IP.
- select minimal state variables / field_io_names - add `if state == ensemble` selection - correct typo filenames -> filename
…ding input/output dirnames in yaml
metdyn
requested review from
Dooruk,
gmao-wgu,
jeromebarre,
mer-a-o,
mranst and
rtodling
2. qd.window_length("PT6H"),
3. geos_atmosphere
background_time_offset:
default_value: PT9H
1. remove localensembleda from tier-1 test 2. disable localensembleda from code test
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This is a first step to make EDA workflow run within SWELL framework. These 32 ensemble members from @rtodling run independently on each node. Both GSI B and all observation type from 3dvar-atmos are used here. The single node run for each member is made possible with the current setting: C90 resolution using thinned observations (rejecting 80% of obs at random).
The memory usage on each node is roughly 72% (There are still details to work out and improve).
To run this code:
swell create eda -o override.yaml -p nccs_discover_sles15
swell launch ...
[override.yaml contains experiment_root and experiment_id]
Example output: T mean increment at 500 hPa :
The work is advised by @rtodling.
@mranst makes the flow.cylc loop work for ensemble members.
Dependencies
None
Impact