Skip to content

Word indexes are None for special tokens#226

Merged
n1t0 merged 1 commit intomasterfrom
fix-words
Apr 9, 2020
Merged

Word indexes are None for special tokens#226
n1t0 merged 1 commit intomasterfrom
fix-words

Conversation

@n1t0
Copy link
Copy Markdown
Contributor

@n1t0 n1t0 commented Apr 9, 2020

Before these changes, the indexes were wrong when there were special tokens.

@n1t0
Copy link
Copy Markdown
Contributor Author

n1t0 commented Apr 9, 2020

cc @Pierrci @mfuntowicz

@n1t0 n1t0 merged commit bd18df0 into master Apr 9, 2020
@n1t0 n1t0 deleted the fix-words branch April 9, 2020 14:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant