This issue was originally opened by @johnrengelman as hashicorp/terraform#6016. It was migrated here as part of the provider split. The original body of the issue is below.

The Github API has a rate limit than can be easily overcome when managing an organization.
This ticket is simply a spot to start a conversation about how to properly handle the rate limit.

Details: https://developer.github.com/v3/#rate-limiting