Skip to content

Problem loading the data.vocab.pt #24

Open
@SilvesterYu

Description

@SilvesterYu

Hi! I'm having trouble loading the data checkpoints.

The specific output and error are:

WebNLG
Pre-process training data
Training Set
corpus Read Corpus 0:00:00.000065
graphify RDF to Graph 0:00:00.000024
spelling Fix Spelling 0:00:00.000018
entities Describe entities 0:00:00.000025
match-ents Match Entities 0:00:00.000042
match-plans Match Plans 0:00:00.000020
tokenize Tokenize Plans & Sentences 0:00:00.000017
to-json Export in a readable format 0:00:00.000022
Dev Set
corpus Read Corpus 0:00:00.000042
graphify RDF to Graph 0:00:00.000019
spelling Fix Spelling 0:00:00.000019
entities Describe entities 0:00:00.000020
match-ents Match Entities 0:00:00.000020
match-plans Match Plans 0:00:00.000019
tokenize Tokenize Plans & Sentences 0:00:00.000018
to-json Export in a readable format 0:00:00.000016
Train Planner
planner Learn planner 0:00:00.000036
Train Model
model Initialize OpenNMT 0:00:00.000034
expose Expose Train Data 0:00:00.000017
pre-process Pre-process Train and Dev 0:00:00.000018
train Train model EXEC /home/ubuntu/miniconda3/envs/env_pytorch/bin/python /home/ubuntu/chimera/model/../libs/OpenNMT/train.py -train_steps 30000 -save_checkpoint_steps 1000 -batch_size 16 -word_vec_size 300 -feat_vec_size 10 -feat_merge concat -layers 3 -copy_attn -position_encoding -data /tmp/tmpz79gzk1g/data -save_model /tmp/tmpo6y8o6dz/ -world_size 1 -gpu_ranks 0

------------------------------------------------ (so the error happened here) -------------------------------------------------------

Traceback (most recent call last):
File "/home/ubuntu/chimera/model/../libs/OpenNMT/train.py", line 109, in
main(opt)
File "/home/ubuntu/chimera/model/../libs/OpenNMT/train.py", line 39, in main
single_main(opt, 0)
File "/home/ubuntu/chimera/libs/OpenNMT/onmt/train_single.py", line 63, in main
vocab = torch.load(opt.data + '.vocab.pt')
File "/home/ubuntu/miniconda3/envs/env_pytorch/lib/python3.6/site-packages/torch/serialization.py", line 367, in load
return _load(f, map_location, pickle_module)
File "/home/ubuntu/miniconda3/envs/env_pytorch/lib/python3.6/site-packages/torch/serialization.py", line 528, in _load
magic_number = pickle_module.load(f)
_pickle.UnpicklingError: A load persistent id instruction was encountered,
but no persistent_load function was specified.

--------------------------------------- (the error is above)-------------------------------------

Could you kindly provide some help? I would be very grateful!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions