Skip to content

docs: position LocalAI as a composable engine, not a bundle#10136

Merged
mudler merged 1 commit into
masterfrom
messaging/composable-positioning
Jun 2, 2026
Merged

docs: position LocalAI as a composable engine, not a bundle#10136
mudler merged 1 commit into
masterfrom
messaging/composable-positioning

Conversation

@localai-bot

Copy link
Copy Markdown
Collaborator

What

Reframes the README hero and docs (homepage, overview, FAQ) around LocalAI's composable architecture instead of language that reads as a monolith.

The README led with "36+ backends" and the docs described LocalAI as "Your All-in-One Complete AI Stack" / "a single binary that gives you everything you need" - phrasing that fuels a "heavy / does-too-much" impression. In reality LocalAI is a small core, and each backend is a dedicated gRPC service built around a best-in-class engine (llama.cpp, vLLM, whisper.cpp, stable-diffusion, MLX...), shipped as a separate OCI image and pulled only when a model needs it.

Changes

  • README hero: leads with "a small core, not a bundle"; adds Composable by design and Open and extensible (bring your own model / backend) bullets; drops the kitchen-sink "36+ backends" lead.
  • _index.md: tagline → "A small, composable AI stack: run any model locally and install only what you use."
  • overview.md: distinguishes the small core from on-demand backends; explains the gRPC/OCI design as benefits (isolation, independent upgrade, run on another machine); adds bring-your-own model/backend + flexibility.
  • faq.md: adds "Do I need to install all the backends?" and "Can I bring my own model or backend?"

Messaging principles applied

  • Lead from strength - state the architecture as a positive; never name the accusation (no "bloated" anywhere, which would only plant it).
  • Altitude - gRPC/OCI mechanics live on evaluator surfaces (overview/FAQ), framed as benefits; the hero stays jargon-free.
  • Consistency - README and docs share one vocabulary and the same backend example set.

A composable-architecture diagram will be added in a follow-up commit once hosted.

Reframe the README hero and docs (homepage, overview, FAQ) around the
composable architecture: a small core, with backends built as dedicated
gRPC services around best-in-class engines, shipped as separate OCI
images and pulled on demand. Lead from strength: drop the "36+ backends"
kitchen-sink framing and the "All-in-One Complete AI Stack" / "single
binary that gives you everything" lines that read as a monolith.

- README: small-core differentiator; composable + open/extensible bullets
- _index.md: composable tagline; install only what you use
- overview.md: core vs on-demand backends; gRPC/OCI mechanics as benefits;
  bring-your-own model and backend
- faq.md: "Do I need to install all the backends?" and
  "Can I bring my own model or backend?"

Assisted-by: Claude:claude-opus-4-8 [Claude Code]
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler merged commit aea954a into master Jun 2, 2026
57 checks passed
@mudler mudler deleted the messaging/composable-positioning branch June 2, 2026 15:34
@localai-bot localai-bot added the kind/documentation Improvements or additions to documentation label Jun 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kind/documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants