The following command should copy the custom templates into the deployment and ensure datasette serve correctly serves them:

datasette publish now mydb.db --template-dir=custom-templates/