What's Changed

Miscellaneous and Others 🔔

• Extract URLs from CSS by @mre in #1956
• feat: implement per-host rate limiting and statistics by @thomas-zahner in #1929
• Add tldr-pages link to README by @sebastiaanspeck in #1963
• Specify that Scoop installation is for Windows by @yeikel in #1969
• Improve wikilink parsing and checking by @JayJayArr in #1799
• feat: per-host caching by @thomas-zahner in #1974
• Combine host stats with response stats by @thomas-zahner in #1975
• Accept ranges by @thomas-zahner in #1989

New Contributors

• @yeikel made their first contribution in #1969

Full Changelog: lychee-v0.22.0...nightly

Added

• support relative --root-dir (#1912)
• propagate input loading/collecting errors to top level (#1864)
• file preprocessing (#1891)

Fixed

• make file matcher respect the hidden option (#1936)
• inverted gitignore behaviour for --dump-inputs (#1882)

Other

• (deps) bump the dependencies group with 5 updates (#1944)
• progress bar (#1914)
• Bump the dependencies group with 3 updates (#1933)
• Fix parsing larger HTML blocks in MDX files (#1924)
• use markdown formatting for files-from help text (#1917)
• Bump the dependencies group across 1 directory with 8 updates (#1916)
• use log::Level's deserialiser, and link example TOML (#1907)
• Config file up to date (#1906)
• check glob validity when parsing input source arguments (#1869)
• Fix typos, and configure the typos tool (#1895)
• Address new clippy lints with version 1.91
• Bump MSRV
• Bump the dependencies group across 1 directory with 7 updates

Added

• add github markdown fragment quirk (#1940)
• support relative --root-dir (#1912)
• propagate input loading/collecting errors to top level (#1864)
• file preprocessing (#1891)

Fixed

• make file matcher respect the hidden option (#1936)
• parsing of srcset URLs after the first URL (#1890)

Other

• (deps) bump the dependencies group with 5 updates (#1944)
• progress bar (#1914)
• Bump the dependencies group with 3 updates (#1933)
• Provide a more helpful error message in case of TLS protocol issues (#1927)
• Fix parsing larger HTML blocks in MDX files (#1924)
• Bump the dependencies group with 3 updates (#1921)
• Fix outdated reference to pre
• Make use of more explicit LazyLock::force
• use markdown formatting for files-from help text (#1917)
• Bump the dependencies group across 1 directory with 8 updates (#1916)
• use InputResolver to implement Input::get_sources (#1880)
• Fix extracting links after <pre><code></code></pre> (#1911)
• check glob validity when parsing input source arguments (#1869)
• remove unimportant public library function (#1893)
• Fix typos, and configure the typos tool (#1895)
• Remove an unneeded clone (#1897)
• Address new clippy lints with version 1.91
• clippy --fix
• Bump MSRV
• Bump the dependencies group across 1 directory with 7 updates

Added

• print warning if input source matches no files (#1865)
• (base-url) [breaking] disallow relative local base to avoid confusion (#1857)
• improve InvalidIndexFile error to mention index file names (#1859)

Fixed

• move log level padding outside brackets (#1871)
• do not reuse excluded status from cache (#1850)
• fields missing from config.toml parsing logic (#1843)

Other

• Bump the dependencies group across 1 directory with 15 updates (#1874)
• Inline formatting arguments for anyhow macros as per new lint
• Man pages (#1858)
• Add --default-extension argument to force file format (#1842)
• Hard wrap help text for options (#1854)
• Bump the dependencies group with 6 updates (#1855)
• Add exhaustivity check for fold_in! macro (#1848)
• Additional redirect reporting (#1853)
• Redirect reporting (#1725)
• Add WinGet installation instructions (#1849)
• [breaking] Use ResolvedInputSource downstream of InputContent (#1840)
• Bump the dependencies group with 5 updates (#1845)
• Implement --files-from Option (#1836)
• Apply fallback extensions if directory links resolve to a dir (#1826)
• Clarify --base-url and --root-dir and their interactions (#1787)
• Add test for making sure URL inputs always get checked (#1824)
• Add conda install to readme (#1822)
• Bump the dependencies group with 3 updates (#1821)
• Refactor error reporting (#1731)

Added

• print warning if input source matches no files (#1865)
• (base-url) [breaking] disallow relative local base to avoid confusion (#1857)
• improve InvalidIndexFile error to mention index file names (#1859)

Fixed

• do not reuse excluded status from cache (#1850)
• fields missing from config.toml parsing logic (#1843)
• add support for name attributes in HTML fragment extraction (#1839)

Other

• Update flag description
• Bump the dependencies group across 1 directory with 15 updates (#1874)
• Man pages (#1858)
• Extract spans (#1870)
• Remove truncate_source logic (#1847)
• Add --default-extension argument to force file format (#1842)
• Hard wrap help text for options (#1854)
• Bump the dependencies group with 6 updates (#1855)
• Additional redirect reporting (#1853)
• Fix extraction of reference links in Markdown (#1841)
• Redirect reporting (#1725)
• Add WinGet installation instructions (#1849)
• [breaking] Use ResolvedInputSource downstream of InputContent (#1840)
• Bump the dependencies group with 5 updates (#1845)
• Implement --files-from Option (#1836)
• Optimize InputSource handling with Cow and add benchmarks (#1832)
• Ignore Links in Markdown Link Text (#1831)
• Separate resolving and checking for easier testing (#1830)
• Refactor Input Handling (#1827)
• Fix links in doc comments (#1828)
• Apply fallback extensions if directory links resolve to a dir (#1826)
• Clarify --base-url and --root-dir and their interactions (#1787)
• Refactor collector and input (#1823)
• Add conda install to readme (#1822)
• Bump the dependencies group with 3 updates (#1821)
• Refactor error reporting (#1731)

Other

• Always check files explicitly if specified by user or matched by user glob (#1816)
• (docs) update TOC
• Bump the dependencies group across 1 directory with 3 updates (#1812)
• Update changelog

Other

• Always check files explicitly if specified by user or matched by user glob (#1816)
• (docs) update TOC
• Bump the dependencies group across 1 directory with 3 updates (#1812)
• Update changelog

Added

• make wikilink extraction and checking opt-in (#1803)
• skip fragment checking for unsupported MIME types (#1744)
• add 'user-content-' prefix to support github markdown fragment (#1750)

Fixed

• do not check the fragment when http response err but accepted (#1763)
• treat a fragment in an empty directory as an error (#1756)
• resolve index file inside a directory (#1752)
• skip fragment check if website URL doesn't contain fragment (#1733)

Other

• Bump dependencies (#1811)
• Skip binary and invalid UTF-8 inputs (#1810)
• Refactor input dumping and path retrieval with extension filtering (#1648)
• Use a HashSet to store inputs and avoid duplicates (#1781)
• add --index-files flag, and turn off index file checking by default (#1777)
• Cleanup input example (#1792)
• Fix missing identifier in snap build action; add snap install to readme (#1793)
• refactor test_fragments to clarify expected successes/fails (#1776)
• Regular expressions for exclude_path (#1766)
• Replace unmaintained human-sort with numeric-sort (#1759)
• Fix basic auth (#1748)
• Update 'Users' section in the README
• Add ProseKit to users
• Migrate to Clippy 1.88 (#1749)
• fix assertion in fragment checks
• Replace unreliable API URL
• display unsupported URLs (#1727)

Added

• make wikilink extraction and checking opt-in (#1803)
• skip fragment checking for unsupported MIME types (#1744)
• add 'user-content-' prefix to support github markdown fragment (#1750)

Fixed

• fix comment for ErrorKind::InvalidFragment (#1775)
• do not check the fragment when http response err but accepted (#1763)
• treat a fragment in an empty directory as an error (#1756)
• resolve index file inside a directory (#1752)
• skip fragment check if website URL doesn't contain fragment (#1733)

Other

• Bump dependencies (#1811)
• Skip binary and invalid UTF-8 inputs (#1810)
• Refactor input dumping and path retrieval with extension filtering (#1648)
• Use a HashSet to store inputs and avoid duplicates (#1781)
• add --index-files flag, and turn off index file checking by default (#1777)
• Cleanup input example (#1792)
• FIx missing identifier in snap build action; add snap install to readme (#1793)
• Fix clippy lints; refactor code slightly
• refactor test_fragments to clarify expected successes/fails (#1776)
• Regular expressions for exclude_path (#1766)
• Fix basic auth (#1748)
• Update 'Users' section in the README
• Add ProseKit to users
• Migrate to Clippy 1.88 (#1749)
• Add xml schema found in xsd files to list of exclusions (#1735)

Other

• Don't echo potentially sensitive header data (#1728)
• Update changelog