Skip to content

K8s test: Fix scheduler crash when using LocalExecutor #49677

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

jason810496
Copy link
Member

@jason810496 jason810496 commented Apr 24, 2025

closes: #47518
related: #49101

Why

The root cause of scheduler crash when using LocalExecutor has been resolved, but not sure which PR really addressed the error. Now we can unblock the k8s test for LocalExecutor !

What

We need to sightly refactor ensure_deployment_health to ensure_resource_health, since LocalExecutor use statefulset instead of deployment as k8s resource to run with.

@jason810496 jason810496 added area:dev-env CI, pre-commit, pylint and other changes that do not change the behavior of the final code area:CI Airflow's tests and continious integration full tests needed We need to run full set of tests for this PR to merge labels Apr 24, 2025
@jason810496 jason810496 changed the title [WIP] k8s test: Fix scheduler crash when using LocalExecutor K8s test: Fix scheduler crash when using LocalExecutor Apr 24, 2025
@jason810496 jason810496 marked this pull request as ready for review April 24, 2025 05:35
@jason810496 jason810496 self-assigned this Apr 24, 2025
@potiuk potiuk added this to the Airflow 3.0.1 milestone Apr 24, 2025
@potiuk potiuk added the backport-to-v3-0-test Mark PR with this label to backport to v3-0-test branch label Apr 24, 2025
@potiuk
Copy link
Member

potiuk commented Apr 24, 2025

NICE!

@potiuk potiuk merged commit 2372dcd into apache:main Apr 24, 2025
97 checks passed
github-actions bot pushed a commit that referenced this pull request Apr 24, 2025
Copy link

Backport successfully created: v3-0-test

Status Branch Result
v3-0-test PR Link

github-actions bot pushed a commit to aws-mwaa/upstream-to-airflow that referenced this pull request Apr 24, 2025
potiuk pushed a commit that referenced this pull request Apr 24, 2025
kaxil pushed a commit that referenced this pull request Apr 24, 2025
@jscheffl
Copy link
Contributor

Cool! Thanks for the fix! (I was looking into this a couple of weeks ago and could not find the root cause...)

prabhusneha pushed a commit to astronomer/airflow that referenced this pull request Apr 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:CI Airflow's tests and continious integration area:dev-env CI, pre-commit, pylint and other changes that do not change the behavior of the final code area:kubernetes-tests backport-to-v3-0-test Mark PR with this label to backport to v3-0-test branch full tests needed We need to run full set of tests for this PR to merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

LocalExecutor crashes in KinD Deployment with some Dags
3 participants