Skip to content

Commit 8178c43

Browse files
authored
when delaying optimizer creation only prepare the model (#39152)
1 parent 91221da commit 8178c43

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/transformers/trainer.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2357,7 +2357,7 @@ def _inner_training_loop(
23572357
model = self.accelerator.prepare(self.model)
23582358
else:
23592359
if delay_optimizer_creation:
2360-
self.optimizer = self.accelerator.prepare(self.optimizer)
2360+
model = self.accelerator.prepare(self.model)
23612361
else:
23622362
model, self.optimizer = self.accelerator.prepare(self.model, self.optimizer)
23632363
else:

0 commit comments

Comments
 (0)