Skip to content

Issues: google/sentencepiece

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

45 Open 729 Closed
45 Open 729 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Perftools use seems to cause Attempt to free invalid pointer 0x1ef160aa2f80
#1105 opened Apr 10, 2025 by yurivict
pip install sentencepiece failing on Windows and Python3.13
#1104 opened Apr 6, 2025 by ninofiliu
5
PIP INSTALL failing on OSX
#1103 opened Apr 2, 2025 by tregenza
3
How to do incremental training or merge trained bpe model
#1102 opened Apr 2, 2025 by 2833034152
Error on import on macOS 10.13
#1099 opened Mar 26, 2025 by BLKSerene
2
Using multiple input files for training
#1098 opened Mar 21, 2025 by zorg688
Train SentencePieces on Pre-tokenized Text
#1095 opened Feb 26, 2025 by cyberso
1
Issues with installing
#1091 opened Feb 20, 2025 by PierrunoYT
2
Security Issue with dynamic import in setup.py
#1090 opened Feb 20, 2025 by tcapelle
[Question] Could not install via pip or build from source code as a model of python
#1076 opened Jan 8, 2025 by Mikachu2333
2
BPE Dropout tokenizer generates unk at the beginning of sequence
#1071 opened Dec 1, 2024 by AnnaLebedeva
The pip command to install the SentencePiece Python module fails.
#1070 opened Nov 20, 2024 by tprrt
4
Initialized number of seed sentencepieces too low
#1068 opened Nov 14, 2024 by DmitriiP20
1
Asan detects memory leak in sentencepiece/_sentencepiece.cpython-312-x86_64-linux-gnu.so+0x6f7f4
#1065 opened Nov 4, 2024 by renxida
Compatibility Issue when using v0.2.0 with transformers and tensorflow
#1060 opened Oct 2, 2024 by aws-tianquaw
3
Crashes on out of range inputs depending on other inputs bug
#1051 opened Sep 10, 2024 by colehaus
1
With unigram algorithm, constant piece at end of each sentences does not become a token bug
#1047 opened Aug 29, 2024 by jogardi
Error Attribute Error: type object 'SentencePieceTrainer' has no attribute 'train'. Did you mean: 'Train'?
#1046 opened Aug 23, 2024 by bop578530
1
Zero Width Joiner issue for Sinhala Language
#1031 opened Jun 30, 2024 by Nadil-K
No typings in Python package enhancement
#1030 opened Jun 29, 2024 by marcospgp
1
When I set SPM_PROTOBUF_PROVIDER to "package" in CMakeLists.txt, the compilation fails.
#1029 opened Jun 25, 2024 by hhxdestiny
trainer_interface.cc: Integer value -1 is outside the valid range of values [0, 255] for the enumeration type 'ScriptType' enhancement
#1028 opened Jun 19, 2024 by kcoul
1
Wrong calculation of max_score in unigram_model.cc
#1024 opened Jun 12, 2024 by fairydreaming
How to deal with id
#1023 opened Jun 9, 2024 by 980202006
3
Allow whitespace-only pieces
#984 opened Feb 26, 2024 by bauwenst
ProTip! Adding no:label will show everything without a label.