Skip to content

detect_multiple_languages_of crashes on Arabic #205

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
tbarkai opened this issue Dec 7, 2023 · 1 comment
Closed

detect_multiple_languages_of crashes on Arabic #205

tbarkai opened this issue Dec 7, 2023 · 1 comment
Milestone
Lingua 2.0.2

Comments

@tbarkai
Copy link

tbarkai commented Dec 7, 2023

The following command causes a panic exception:

>>> detector.detect_multiple_languages_of('صباغ الكتريك')
...
pyo3_runtime.PanicException: byte index 12 is not a char boundary; it is inside 'ل' (bytes 11..13) of `صباغ الكتريك`

This works:

>>> detector.detect_language_of('صباغ الكتريك')
Language.ARABIC
@pemistahl
Copy link
Owner

Hi @tbarkai, this bug has already been reported in #203. I've fixed it already and will release it when the other issues of the 2.0.2 milestone have been resolved.

@pemistahl pemistahl added this to the Lingua 2.0.2 milestone Dec 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
Lingua 2.0.2
Development

No branches or pull requests
2 participants
@pemistahl @tbarkai