Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding reference guide for storage optimization for inference with GCSFuse #126

Merged
merged 2 commits into from
Apr 1, 2025
Merged

Adding reference guide for storage optimization for inference with GCSFuse #126

merged 2 commits into from
Apr 1, 2025

Conversation

gushob21
Copy link
Collaborator

@gushob21 gushob21 commented Mar 26, 2025 •
edited by arueth
Loading

No description provided.

@gushob21
Adding guide for storage benchmarking with GCSFuse
edf5fc0 
Add sotrage benchmarking

adding storage benchmark for GCSFuse

adding sotrage benchmark

Adding storage benchmarking

adding storage benchmarking

Adding storage benchmarking

adding storage benchmarking

adding storage benchmarking

add storage benchmarking

Adding storage benchmarking

Add storage benchmarking

Adding storage benchmarking

Adding storage benchmarking

Adding storage benchmarking

Adding storage benchmarking

Adding storage benchmarking

Adding storage benchmarking

Adding storage benchmarking guide

Adding storage benchmarking guide

Adding storage benchmarking guide

Adding storage benchmarking guide

Adding storage benchmarking guide

Adding storage benchmarking guide

Adding storage benchmarking guide

Adding reference guide for storage optimization for inference
arueth
arueth requested changes Mar 26, 2025
View reviewed changes
Copy link
Collaborator

@arueth arueth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Initial quick review, will do some additional testing and in-depth review.

@gushob21 gushob21 requested a review from arueth March 27, 2025 13:20
fernandorubbo
fernandorubbo reviewed Mar 28, 2025
View reviewed changes
Copy link
Member

@fernandorubbo fernandorubbo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I didn't manage to conclude the execution because I got stuck in copying model from hf to gcs due to lack of GPU availability. So, I've added a few suggestions to this part of the tutorial to simplify user experience

@gushob21 gushob21 force-pushed the gushob-storage-guidance branch from 10da4be to 4b0b27e Compare March 28, 2025 17:32
@gushob21 gushob21 requested a review from fernandorubbo March 28, 2025 17:32
arueth
arueth requested changes Mar 31, 2025
View reviewed changes
Copy link
Collaborator

@arueth arueth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The READMEs can use a little bit more polishing, but I'll submit my recommendations as a follow up PR.

arueth
arueth requested changes Mar 31, 2025
View reviewed changes
@gushob21
Adding reference guide for storage optimization for inference with GC…
41ff9ae 
…SFuse

Adding reference guide for storage optimization for inference with GCSFuse

Adding reference guide for storage optimization for inference with GCSFuse

Combining llama transfer to two GCS buckets in on job

Combining llama transfer to two GCS buckets in on job

Combining llama transfer to two GCS buckets in on job
Adding reference guide for storage optimization for inference with GCSFuse

Adding reference guide for storage optimization for inference with GCSFuse

Adding reference guide for storage optimization for inference with GCSFuse

Adding reference guide for storage optimization for inference with GCSFuse

Adding reference guide for storage optimization for inference with GCSFuse
@gushob21 gushob21 force-pushed the gushob-storage-guidance branch from b4a915e to 41ff9ae Compare March 31, 2025 20:41
@arueth arueth merged commit 588965c into int-storage-guidance Apr 1, 2025
21 checks passed
@arueth arueth deleted the gushob-storage-guidance branch April 1, 2025 18:02
arueth pushed a commit that referenced this pull request Apr 1, 2025
@gushob21 @arueth
Adding reference guide for storage optimization for inference with GC…
fcc7ce4 
…SFuse (#126)
arueth pushed a commit that referenced this pull request Apr 1, 2025
@gushob21 @arueth
Adding reference guide for storage optimization for inference with GC…
cb424e8 
…SFuse (#126)
arueth pushed a commit that referenced this pull request Apr 1, 2025
@gushob21 @arueth
Adding reference guide for storage optimization for inference with GC…
c76cb48 
…SFuse (#126)
arueth pushed a commit that referenced this pull request Apr 2, 2025
@gushob21 @arueth
Adding reference guide for storage optimization for inference with GC…
0e21542 
…SFuse (#126)
arueth pushed a commit that referenced this pull request Apr 8, 2025
@gushob21 @arueth
Adding reference guide for storage optimization for inference with GC…
b0898c5 
…SFuse (#126)
arueth added a commit that referenced this pull request Apr 8, 2025
@arueth @gushob21
Added storage guidance (#131)
edb0a9d 
* Adding reference guide for storage optimization for inference with GCSFuse (#126)

---------

Co-authored-by: Shobhit Gupta <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@arueth arueth arueth approved these changes

@karajendran karajendran Awaiting requested review from karajendran

@fernandorubbo fernandorubbo Awaiting requested review from fernandorubbo

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@gushob21 @fernandorubbo @arueth