Skip to content

feat: llm ready docs#348

Merged
PaulRBerg merged 4 commits intomainfrom
feat/docs-for-llms
Aug 30, 2025
Merged

feat: llm ready docs#348
PaulRBerg merged 4 commits intomainfrom
feat/docs-for-llms

Conversation

@smol-ninja
Copy link
Copy Markdown
Member

@smol-ninja smol-ninja commented Aug 22, 2025

This PR addresses the following issues:

Introduction

Stripe docs are very likely built on gitbook which provides "LLM-ready docs" as a native feature. All these LLM-ready docs integrations loosely (not yet widely accepted) follow the standard defined by llmstxt.org.

Docusaurus currently lacks this feature, but I came across docusaurus-plugin-llms which is mentioned on llmstxt website. Its not yet fully matured but a good start until this feature is natively provided by Docusaurus, similar to Gitbook.

Links

An expected behaviour is to host /concepts/what-is-sablier on /concepts/what-is-sablier.md. However, the plugin does not expose markdown files through the original URLs and instead host all markdown files directly from the build directly.

So, the above page would be hosted on /what-is-sablier.md.

Similarly, /guides/lockup/examples/local-environment is hosted at /configure-your-local-environment.md and for Flow it will be on /configure-your-local-environment-1.md. This is a terrible UX. As a result, one should refer to llms.txt to find all the valid URLs.

I have opened an issue in the plugin repo requesting this feature.

All links can be found at /llms.txt.

Single markdown files

For the purpose of LLM training and fine tuning, single markdown files are hosted on /llms-training-data.txt. Similarly, protocol specific single files are hosted on /llms-flow.txt and so on.

@PaulRBerg
Copy link
Copy Markdown
Member

After merging #308, there are conflicts

@smol-ninja
Copy link
Copy Markdown
Member Author

Thats not a problem. It was expected. I will fix them today.

refactor: rename and import reusable markdowns using relative path
chore: delete gitignored files from autogen directory
refactor: rename table files in autogen dir as per docusaurus recommendation
refactor: rename HardcodedDemonstration and move to snippets directory
@PaulRBerg
Copy link
Copy Markdown
Member

Great work and thanks for the summary.

The plugin follows

docs.sablieer.com/development.md

WDYM by that?

That document is outdated. I can't find it in version control on this branch or main.

@smol-ninja
Copy link
Copy Markdown
Member Author

The description is now outdated so please don't review the PR right now, its still work in progress. I will update the description later.

I should have marked it as a draft. Sorry about that. I will request a review when its done.

@smol-ninja smol-ninja marked this pull request as draft August 26, 2025 09:20
refactor: fix PluginOptions type
refactor: smol wording changes
Copy link
Copy Markdown
Member

@PaulRBerg PaulRBerg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good work, left some questions below

refactor: replace bash content with CodeBlock in markdown files
build: include patch number in llms plugin version
@smol-ninja
Copy link
Copy Markdown
Member Author

I have updated the description and this PR is ready to be merged. There are a few hiccups in the actual outcome of the implementation, but imo its a good start.

The terrible UX is because of the difference in the URLs on which markdowns are hosted and the URLs on which the HTML pages are hosted. I have opened an issue for that in the plugin repo.

Once the above issue is resolved, we can add a new page similar to https://docs.stripe.com/building-with-llms.md but until then, I will hold onto that.

@PaulRBerg if you can have a quick look and re-approve the PR (or provide your thoughts, if any), that would be great.

@smol-ninja
Copy link
Copy Markdown
Member Author

@PaulRBerg should I merge this PR?

@PaulRBerg
Copy link
Copy Markdown
Member

will review this weekend

Copy link
Copy Markdown
Member

@PaulRBerg PaulRBerg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good to merge!

@PaulRBerg PaulRBerg merged commit fa96ccb into main Aug 30, 2025
1 check passed
@PaulRBerg PaulRBerg deleted the feat/docs-for-llms branch August 30, 2025 16:48
@smol-ninja
Copy link
Copy Markdown
Member Author

After rachfop/docusaurus-plugin-llms#22 is merged, we should be able to access the markdown files by simply adding .md at the end of the URL. And therefore, the problems mentioned in #348 (comment) would be fixed.

@PaulRBerg
Copy link
Copy Markdown
Member

I really need those juicy .md files for my Claude Coding stuff

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

2 participants