Skip to content

[Feature] Support unified paging in multi-lora serving #3647

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
2 tasks done
Sunt-ing opened this issue Feb 17, 2025 · 4 comments
Open
2 tasks done

[Feature] Support unified paging in multi-lora serving #3647

Sunt-ing opened this issue Feb 17, 2025 · 4 comments
Assignees
Labels

Comments

@Sunt-ing
Copy link

Sunt-ing commented Feb 17, 2025

Checklist

Motivation

Currently, SGL doesn't support the unified paging feature proposed by S-LoRA. However, this feature is important for memory management in multi-LoRA serving.

Related resources

No response

@Sunt-ing
Copy link
Author

We will try to implement it soon.

Link: #2929

@jhinpan
Copy link
Collaborator

jhinpan commented Feb 17, 2025

Sure! Thank you for your help~ cc @Fridge003

@Fridge003
Copy link
Collaborator

@Sunt-ing Thanks! Looking forward to your contribution!

Copy link

This issue has been automatically closed due to inactivity. Please feel free to reopen it if needed.

@Fridge003 Fridge003 reopened this Apr 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants