Skip to content

Fix handling of end-of-file#60

Merged
McPatate merged 3 commits intohuggingface:mainfrom
HennerM:underflow-empty-line
Feb 5, 2024
Merged

Fix handling of end-of-file#60
McPatate merged 3 commits intohuggingface:mainfrom
HennerM:underflow-empty-line

Conversation

@HennerM
Copy link
Copy Markdown
Contributor

@HennerM HennerM commented Jan 20, 2024

At the end of a document we don't expect any further characters, thus we can just assume the end is the same as a line break

@HennerM HennerM force-pushed the underflow-empty-line branch from 931aa47 to 25e6621 Compare January 20, 2024 20:01
@HennerM HennerM force-pushed the underflow-empty-line branch from 25e6621 to 878f3e4 Compare January 23, 2024 23:53
@HennerM HennerM changed the title Fix underflow on empty line Fix handling of end-of-file Jan 23, 2024
HennerM and others added 2 commits February 4, 2024 19:40
Co-authored-by: Luc Georges <McPatate@users.noreply.github.com>
Co-authored-by: Luc Georges <McPatate@users.noreply.github.com>
@McPatate McPatate merged commit c9a44e5 into huggingface:main Feb 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants