@Ragesoss what is the User-Agent you use when making those requests?

@Ragesoss as far as I can tell, the problem is you are not honoring the wikimedia User-Agent policy, and we have recently started to enforce stricter rate limits for bots that dont' respect the policy, hence you are being blocked.

Once you change it to a proper User Agent that identifies you, you should not experience the same problem. If you will still see 429s then, we can create an exception for you.

Hi @Ragesoss: We looked through the logs and it seems like requests originating from your end are not respecting our UA policy, documented at https://foundation.wikimedia.org/wiki/Policy:Wikimedia_Foundation_User-Agent_Policy and further explained in https://phabricator.wikimedia.org/T400119. Once you update that and set a custom UA, please let us know and we can look into it again.

Thanks! Unfortunately, the OAuth library we use doesn't support setting the User Agent, so I'm going to have to figure out how to monkey patch it. :-(

@ssingh I've just deployed an update that should fix it. Now the user agent is Wiki Education Dashboard/1.0 (dashboard.wikiedu.org; sage@wikiedu.org).

@Ragesoss I see you still get blocked from time to time; I will add an exception, per https://wikitech.wikimedia.org/wiki/Robot_policy#What_to_do_if_these_limits_are_too_strict_for_me?, using the IPs that you just provided.

In case you want to be able to automatically update the IPs, you will need to implement the actions outlined here: https://wikitech.wikimedia.org/wiki/Bot_traffic#How_to_ensure_your_bot_is_identified

@Joe checking my Sentry logs, I see we're still getting 429 for some types of queries, including Commons API queries and fetching page content (but not the OAuth login flow). Are there requests we're still making that don't meet the UA policy requirement? (We have several different libraries involved for requests, and I think I addressed these ones, which go through the mediawiki_api Ruby gem, but it's possible that I missed something.)

Hi, I still see a lot of requests from your IPs with user-agent Faraday v2.14.0.

These are calls to //w/api.php, /w/api.php, /w/index.php in most cases. If these requests are not authenticated with OAuth2 or with a proper login session, they will be rate-limited.