Skip to content

bug: cannot read input content when it's not UTF-8 encoded #1807

@kemingy

Description

@kemingy

To reproduce:

git clone git@github.com:python/cpython.git --depth=2
cd Lib/test/cjkencodings
lychee .

Error:

Error: Cannot read input content from file `./big5.txt`

Caused by:
    stream did not contain valid UTF-8

This happens to some legacy CJK files.

This bug was found by @yihong0618

Expect:

lychee should skip those files if it's not valid UTF-8 encoded.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No fields configured for Bug.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions