[Feature] Integrate RayService with Kueue to support gang scheduling

[kevin85421]

Search before asking

• I had searched in the issues and found no similar feature requirement.

Description

Currently, only RayCluster and RayJob support Kueue. Users request to support gang scheduling of RayService with Kueue.

Use case

No response

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

[kevin85421]

@andrewsykim I recall that @weizhaowz was planning to work on this item. Is that correct?

[weizhaowz]

@andrewsykim I recall that @weizhaowz was planning to work on this item. Is that correct?

Hi Kai-Hsun, I have tried adding a label to RayService and it works on KubeRay 1.3 onwards, here is the pr for the doc on Kueue, and the manual test is added in the comment as well. Can you please review it for me? Thanks.

[kevin85421]

@weizhaowz Could you add documentation to the Ray repository? You can either write a detailed doc and include a YAML file in the KubeRay repo, or write a brief doc that links to the relevant Kueue documentation.

[andrewsykim]

ref: kubernetes-sigs/kueue#5429

Docs in the Kueue website were added in this PR kubernetes-sigs/kueue#5822

[andrewsykim]

Note that autoscaling is still not supported, but there's an open proposal here: kubernetes-sigs/kueue#5648

[weizhaowz]

@weizhaowz Could you add documentation to the Ray repository? You can either write a detailed doc and include a YAML file in the KubeRay repo, or write a brief doc that links to the relevant Kueue documentation.

Yes, I can do it.