272

I hate reST but love Sphinx. Is there a way that Sphinx reads Markdown instead of reStructuredText?

10
  • 1
    I'm not aware of any option available for this. But do note that RST has much more options than markdown in terms of extensibility. So depending on your project it might not be sufficient. Commented Mar 21, 2010 at 13:58
  • 5
    There is a subset of rST that is mostly valid markdown. If you hate Sphinx field lists (:param path: etc), see Napoleon extension. Commented Apr 7, 2014 at 22:21
  • 3
    If you'd like to document your Python project in Markdown with Sphinx, vote for the feature request at bitbucket.org/birkenfeld/sphinx/issue/825/… Commented Sep 14, 2014 at 17:26
  • 1
    Looking at this comment, it seems as though you can mix the two: read-the-docs.readthedocs.org/en/latest/… Commented Jul 24, 2015 at 2:18
  • 3
    Basic Markdown support has finally made it's way into Sphinx: see new answer Commented Mar 19, 2016 at 16:08

12 Answers 12

141

You can use Markdown and reStructuredText in the same Sphinx project. How to do this is succinctly documented in the Sphinx documentation.

Install myst-parser (pip install myst-parser) and then edit conf.py:

# simply add the extension to your list of extensions
extensions = ['myst_parser']

source_suffix = ['.rst', '.md']

I've created a small example project on Github (serra/sphinx-with-markdown) demonstrating how (and that) it works. It uses Sphinx version 3.5.4 and myst-parser version 0.14.0.

In fact, MyST parser allows you to write your entire Sphinx documentation in Markdown. It supports directives and has several extensions you can enable through configuration in conf.py.

MyST parser requires Sphinx 2.1 or later. For earlier versions of Sphinx, you could use Markdown in Sphinx using recommonmark. Checkout earlier revisions of this answer to find out how.

Sign up to request clarification or add additional context in comments.

3 Comments

Beni mentions this approach in his very comprehensive answer above. However, I feel this question deserves this simple answer.
I get ImportError: cannot import name 'DocParser' on Sphinx 1.4.1 under Python 3.4.3.
Pls note that current version of recommonmark doesn't supports tables
111

The "proper" way to do that would be to write a docutils parser for markdown. (Plus a Sphinx option to choose the parser.) The beauty of this would be instant support for all docutils output formats (but you might not care about that, as similar markdown tools already exist for most).
Ways to approach that without developing a parser from scratch:

  1. You could cheat and write a "parser" that uses Pandoc to convert markdown to RST and pass that to the RST parser :-).

  2. You can use an existing markdown->XML parser and transform the result (using XSLT?) to the docutils schema.

  3. You could take some existing python markdown parser that lets you define a custom renderer and make it build docutils node tree.

  4. You could fork the existing RST reader, ripping out everything irrelevant to markdown and changing the different syntaxes (this comparison might help)...
    EDIT: I don't recommend this route unless you're prepared to heavily test it. Markdown already has too many subtly different dialects and this will likely result in yet-another-one...


UPDATE (inactive since 2014): remarkdown was a markdown reader for docutils. No shortcuts, a Parsley PEG grammar inspired by peg-markdown.

UPDATE (deprecated since 2022 for MyST👇): recommonmark was another docutils reader, natively supported on ReadTheDocs. Derived from remarkdown but used the CommonMark-py parser.

  • Can convert specific more-or-less natural Markdown syntaxes to appropriate structures e.g. list of links to a toctree.
  • Doesn't have generic native syntax for roles?
  • Supports embedding any rST content, including directives, with an ```eval_rst fenced block as well as a shorthand for directives DIRECTIVE_NAME:: ....

UPDATE: MyST is yet another docutins/Sphinx reader. Based on markdown-it-py, CommonMark compatible.

  • Has a generic {ROLE_NAME}`...` syntax for roles.
  • Has a generic syntax for directives with ```{DIRECTIVE_NAME} ... fenced blocks.

In all cases, you'll need to invent extensions of Markdown to represent Sphinx directives and roles. While you may not need all of them, some like .. toctree:: are essential.
This I think is the hardest part. reStructuredText before the Sphinx extensions was already richer than markdown. Even heavily extended markdown, such as pandoc's, is mostly a subset of rST feature set. That's a lot of ground to cover!

Implementation-wise, the easiest thing is adding a generic construct to express any docutils role/directive. The obvious candidates for syntax inspiration are:

  • Attribute syntax, which pandoc and some other implementations already allow on many inline and block constructs. For example `foo`{.method} -> `foo`:method:.
  • HTML/XML. From <span class="method">foo</span> to the kludgiest approach of just inserting docutils internal XML!
  • Some kind of YAML for directives?

But such a generic mapping will not be the most markdown-ish solution...

This also means you can't just reuse a markdown parser without extending it somehow. Pandoc again lives up to its reputation as the swiss army knife of document conversion by supporting custom filters. (In fact, if I were to approach this I'd try to build a generic bridge between docutils readers/transformers/writers and pandoc readers/filters/writers. It's more than you need but the payoff would be much wider than just sphinx/markdown.)


Alternative crazy idea: instead of extending markdown to handle Sphinx, extend reStructuredText to support (mostly) a superset of markdown! The beauty is you'll be able to use any Sphinx features as-is, yet be able to write most content in markdown.

There is already considerable syntax overlap; most notably link syntax is incompatible. I think if you add support to RST for markdown links, and ###-style headers, and change default `backticks` role to literal, and maybe change indented blocks to mean literal (RST supports > ... for quotations nowdays), you'll get something usable that supports most markdown.

3 Comments

I conclude from the lack of progress in this area, the ReST may just be good enough and not sufficiently dissimilar so Markdown for such an undertaking to be worth it.
TLDR: Use recommonmark to write Sphinx documentation using Markdown.
Currently this is the most upvoted answer, but it's a difficult to read collection of old alternatives and updates. In particular, recommonmark is deprecated in favor of myst-parser github.com/readthedocs/recommonmark/issues/221
39

Update May 2021: recommonmark is deprecated in favour of myst-parser (thanks astrojuanlu)

Update: this is now officially supported and documented in the sphinx docs.

It looks like a basic implementation has made it's way into Sphinx but word has not gotten round yet. See github issue comment

install dependencies:

pip install commonmark recommonmark

adjust conf.py:

source_parsers = {
    '.md': 'recommonmark.parser.CommonMarkParser',
}
source_suffix = ['.rst', '.md']

4 Comments

If you get cannot import name DocParser, try pip install commonmark==0.5.5.
Link into sphinx docs should be sphinx-doc.org/en/master/usage/markdown.html
recommonmark is deprecated in favor of myst-parser github.com/readthedocs/recommonmark/issues/221 and the Sphinx recommendation changed accordingly
myst-parser also supports tables, which is a great advantage compared to recommonmark.
37

This doesn't use Sphinx, but MkDocs will build your documentation using Markdown. I also hate rst, and have really enjoyed MkDocs so far.

4 Comments

MkDocs have worked really well here too, for end-user documentation. Still looking to use markdown within docstrings..
Hey, thanks — MkDocs is awesome! I loose a lot of power and features compared to Sphinx and RST, that's for sure… but it is awesomely uncomplicated, streamlined and so easy and fast to use. Perfect for almost all of my use cases — like short install instructions and some quick start tutorial with some examples. For the few cases, where I need lots of source code explaining — i.g. class and function call documentation — I stick with Sphinx though.
At the time of writing this, it supports only 2 levels of TOC indentation though.
@wrygiel You're not quite right — the number of TOC levels rendered depends on the theme you're using.
22

Markdown and ReST do different things.

RST provides an object model for working with documents.

Markdown provides a way to engrave bits of text.

It seems reasonable to want to reference your bits of Markdown content from your sphinx project, using RST to stub out the overall information architecture and flow of a larger document. Let markdown do what it does, which is allow writers to focus on writing text.

Is there a way to reference a markdown domain, just to engrave the content as-is? RST/sphinx seems to have taken care of features like toctree without duplicating them in markdown.

2 Comments

"It seems reasonable to want to reference your bits of Markdown content from your sphinx project" — this is actually what I want to do; I want to include some markdown content (my README.md) in my more comprehensive Sphinx documentation. Do you know if this is possible?
Docutils provides an object model for working with documents, not RST. reST is just one language that can be parsed into a Docutils tree. Markdown is another such language, thanks to frontends like reCommonMark and MyST.
20
+100

I recommend using MyST Markdown. This is a flavor of Markdown that was designed to bring in the major features of reStructuredText. MyST stands for Markedly Structured Text, and can be thought of as "rST but with Markdown".

MyST is a superset of the CommonMark standard, and it is defined as a collection of discrete extensions to CommonMark via the markdown-it-py package). This means that CommonMark syntax works out-of-the-box with MyST, but you can also use more syntax features if you wish.

MyST has syntax for virtually every feature in reStructuredText, and it is tested against the full Sphinx test suite to ensure that the same functionality can be re-created. For example:

Here is how you write a directive in MyST:

```{directivename} directive options
:key: value
:key2: value2

Directive content
```

And here is how you write a role in MyST

Here's some text and a {rolename}`role content`

The Sphinx parser for MyST Markdown also has some nice Sphinx-specific features, like using Markdown link syntax ([some text](somelink)) to also handle cross-references in Sphinx. So for example, you can define a label in MyST, and reference it, like so:

(my-label)=
# My header

Some text and a [cross reference](my-label).

For a more complete list of MyST Markdown syntax, a good reference is the Jupyter Book cheatsheet, which has a list of many common document needs and the respective MyST syntax to accomplish it. (MyST was created as a component of Jupyter Book, though it exists as a totally standalone project from a technical perspective).

MyST is now the recommended Markdown tool for Sphinx in the Sphinx docs as well as the ReadTheDocs documentation.

To add the MyST Parser to your Sphinx documentation, simply do the following:

pip install myst-parser

And in conf.py, add:

extensions = [
  ...
  "myst_parser",
  ...
]

Your Sphinx documentation will now be able to parse CommonMark markdown as well as the extended MyST Markdown syntax! Check out the MyST Documentation for more information!

I hope that this helps clarify some things!

4 Comments

This is the answer this question deserves :)
May I use doxygen directive using breathe in markdown file? Source. Suppose in any sample.rst file if I write .. doxygenclass:: A::B::Base, it gives a total doc of this class. But how to write it in markdown if my file name is sample.md?
Indeed, the best answer here.
Thank you for the explanation. The way the Sphinx docs mention Markdown support via MyST sounded like it's barely supported by losing a lot of functionality (no mention of the directives for rST, etc); I almost gave up. Your answer needs to be in the official docs.
16

This is now officially supported: http://www.sphinx-doc.org/en/stable/markdown.html

See also https://myst-parser.readthedocs.io/en/latest/syntax/optional.html for extensions, including linkify to make urls automatic links.

Comments

9

I went with Beni's suggestion of using pandoc for this task. Once installed the following script will convert all markdown files in the source directory to rst files, so that you can just write all your documentation in markdown. Hope this is useful for others.

#!/usr/bin/env python
import os
import subprocess

DOCUMENTATION_SOURCE_DIR = 'documentation/source/'
SOURCE_EXTENSION = '.md'
OUTPUT_EXTENSION = '.rst'

for _, __, filenames in os.walk(DOCUMENTATION_SOURCE_DIR):
    for filename in filenames:
        if filename.endswith('.md'):
            filename_stem = filename.split('.')[0]
            source_file = DOCUMENTATION_SOURCE_DIR + filename_stem + SOURCE_EXTENSION
            output_file = DOCUMENTATION_SOURCE_DIR + filename_stem + OUTPUT_EXTENSION
            command = 'pandoc -s {0} -o {1}'.format(source_file, output_file)
            print(command)
            subprocess.call(command.split(' '))

Comments

8

Here’s a new option. MyST adds some features to Markdown that allow Sphinx to build docs like rst does. https://myst-parser.readthedocs.io/en/latest/

Comments

2

There is a workaround.
The sphinx-quickstart.py script generates a Makefile.
You can easily invoke Pandoc from the Makefile every time you'd like to generate the documentation in order to convert Markdown to reStructuredText.

4 Comments

Unless I'm doing something wrong, it's not that easy to replace ReST with Markdown. If you use instructions like toctree in Markdown source file, then Pandoc will change them into a single line: .. toctree:: :maxdepth: 2 :glob: during transformation and they'll stop working. In other words, it's impossible to use directives this way.
@WiktorWalc I'm not very familiar with pandoc and I haven't really tried it but it made sense I guess. Oh well. I tried. I guess you can file a bug report?
@WiktorWalc: ..toctree is not valid Markdown syntax. You either write the entire document in Markdown (and loose the niceties of ReSt), or you use ReST. You cannot have your cake and eat it too.
just a hint: a solution would be to use pandoc filters to skip those special instructions and leave them as is in the output generation. I'm not a wizard of pandoc filters though, and it adds extra complexity to the scheme.
0

Note that building documentation using maven and embedded Sphinx + MarkDown support is fully supported by following maven plugin :

https://trustin.github.io/sphinx-maven-plugin/index.html

<plugin>
  <groupId>kr.motd.maven</groupId>
  <artifactId>sphinx-maven-plugin</artifactId>
  <version>1.6.1</version>
  <configuration>
    <outputDirectory>${project.build.directory}/docs</outputDirectory>
  </configuration>
  <executions>
    <execution>
      <phase>package</phase>
      <goals>
        <goal>generate</goal>
      </goals>
    </execution>
  </executions>
</plugin>

Comments

0

This is an update to the recommonmark approach.

pip install recommonmark

Personally I use Sphinx 3.5.1, so

# for Sphinx-1.4 or newer
extensions = ['recommonmark']

Check the official doc here.

1 Comment

recommonmark is deprecated in favor of myst-parser github.com/readthedocs/recommonmark/issues/221

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.