Skip to content
This repository was archived by the owner on Dec 16, 2022. It is now read-only.

TransformerTextField #5280

Merged
merged 8 commits into from
Jun 24, 2021
Merged

TransformerTextField #5280

merged 8 commits into from
Jun 24, 2021

Conversation

dirkgr
Copy link
Member

@dirkgr dirkgr commented Jun 23, 2021

Another spin-off from Tango. TransformerTextField just pipes through the tensors you get from a hugging face tokenizer.

@dirkgr dirkgr self-assigned this Jun 23, 2021
@dirkgr dirkgr marked this pull request as ready for review June 24, 2021 00:47
@dirkgr dirkgr requested a review from epwalsh June 24, 2021 00:47
Copy link
Member

@epwalsh epwalsh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! human_readable_repr() needs a little tweak though I think.

@dirkgr dirkgr enabled auto-merge (squash) June 24, 2021 21:26
@dirkgr dirkgr merged commit a246e27 into main Jun 24, 2021
@dirkgr dirkgr deleted the TransformerTextField branch June 24, 2021 21:31
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants