Skip to content

feat!: Implement coupling of two or more models #76

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 125 commits into from
Mar 17, 2025
Merged

Conversation

b8raoult
Copy link
Collaborator

@b8raoult b8raoult commented Dec 7, 2024

The new command anemoi-inference couple config.yaml will run two or more models that requires forcing variables from each others. The models can run in different threads, different processes or different MPI ranks. They can use the same GPU (if the fit) or different GPUs.

Below is a sample configuration file, that runs an atmosphere model and an ocean model:

# How to run the model:
transport: processes

# The list of tasks to run
tasks:
  atmos:
    runner:
      config: atmos.yaml
      overrides:
        device: cuda:0
  ocean:
    runner:
      config: ocean.yaml
      overrides:
        device: cuda:1

# List of variables to exchange
couplings:
- atmos -> ocean:
  - lsm
  - 10u
  - 10v
  - 2t
  - 2d
  - ssrd
  - strd
  - tp
  - msl

- ocean -> atmos:
  - avg_tos
  - avg_siconc

@mchantry
Copy link
Member

mchantry commented Dec 7, 2024

Would be good to develop this multi-GPU with the expected multi-GPU inference for a single model in mind. Perhaps @cathalobrien and/or @japols can have a look at this?

@github-actions github-actions bot added the documentation Improvements or additions to documentation label Mar 9, 2025
@b8raoult b8raoult changed the title Implement coupling of two or more models feat!: Implement coupling of two or more models Mar 9, 2025
@JPXKQX
Copy link
Member

JPXKQX commented Mar 11, 2025

I see the PR has breaking changes. I think it would be helpful for the users if you include a list of the breaking changes in the PR description

HCookie
HCookie previously approved these changes Mar 17, 2025
@b8raoult b8raoult merged commit 94e6a7c into main Mar 17, 2025
64 checks passed
@b8raoult b8raoult deleted the feature/coupling branch March 17, 2025 10:22
@github-project-automation github-project-automation bot moved this from ATS to Done in Anemoi-dev Mar 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI/CD config dependencies Pull requests that update a dependency file documentation Improvements or additions to documentation tests
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

7 participants