** Question: **
I am not sure if this is a bug or just a something I am doing wrong, but when I save the model as a file and then reload it as a layer, it does not have a similar loss to the saved version of the model, and it also trains much slower. Is there a setting needed to tell it how to continue? Do I need to save additional data to resume properly?
Project can be found here
Lines 231-238, 296-299 are the significant parts to this question. If I train it from scratch the loss will go down into the 80s after 20,000 iterations, but when I reload it it will start in the 130s and not decrease significantly in 20,000 iterations.