Skip to content

core(config): implement llms.txt check for AI agents#16970

Merged
TravenReese merged 1 commit into
mainfrom
agentic-browsing-llmtxt
Apr 20, 2026
Merged

core(config): implement llms.txt check for AI agents#16970
TravenReese merged 1 commit into
mainfrom
agentic-browsing-llmtxt

Conversation

@TravenReese

Copy link
Copy Markdown
Collaborator

Adds a new gatherer and audit to check for a valid llms.txt Markdown file on the site, and integrates it into the agentic browsing config.

Comment thread core/audits/agentic/llms-txt.js Outdated

@paulirish paulirish left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice!

gatherer and audit all in one. looks good.

left a bunch of thoughts on this one. none technical. :)

Comment thread core/audits/agentic/llms-txt.js Outdated
Comment thread core/audits/agentic/llms-txt.js Outdated
Comment thread core/audits/agentic/llms-txt.js Outdated
Comment thread core/audits/agentic/llms-txt.js Outdated

@lusayaa lusayaa left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I didn't realize I never sent this...whoops

also it looks like you're also getting a bunch of localization changes...idk where they come from tbh

edit: so it came from ME. my bad! created a revert. you probbaly need to pull in these two (hopefully now) net-zero change commits first before pushing.

Comment thread core/config/agentic-browsing-config.js
Comment thread core/audits/agentic/llms-txt.js
@TravenReese TravenReese merged commit b328482 into main Apr 20, 2026
33 checks passed
@TravenReese TravenReese deleted the agentic-browsing-llmtxt branch April 20, 2026 15:13
stadia pushed a commit to stadia/ruby-news that referenced this pull request May 27, 2026
Lighthouse 13.3 Agentic Browsing 카테고리의 llms.txt 감사는
Markdown 링크([text](url))를 요구하므로 plain URL을 링크 형식으로 변경.
Excluded from AI Indexing 섹션의 URL도 불필요한 링크 노출을 피하기 위해 제거.

Ref: GoogleChrome/lighthouse#16970
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants