Extracting this from #2972.

Right now we only have RTL versions for the stylesheets created by webpack, which is just a small part of all the CSS.

We can also look into using PostCSS for all these stylesheets, which allows us to use things like postcss-themes