Skip to content

feature: CpuOffload pre_forward don't attempt to move if already on device#3695

Open
JoeGaffney wants to merge 2 commits intohuggingface:mainfrom
JoeGaffney:cpu-offload-optimizations
Open

feature: CpuOffload pre_forward don't attempt to move if already on device#3695
JoeGaffney wants to merge 2 commits intohuggingface:mainfrom
JoeGaffney:cpu-offload-optimizations

Commits