We should add note to all Bot.edit_* methods that states the limitation about editing messages from the official docs:

Please note, that it is currently only possible to edit messages without reply_markup or with inline keyboards.

This should be done via the Note: role of sphinx as done e.g. here

A contribution in this direction is very welcome! A PR for this should be made against the doc-fixes branch. Please also check out the contribution guide, especially the part on how to build the documentation locally.