Receiving the 429 error eventhough not using github for a while.

[alexjcgdf]

Select Topic Area

Question

Body

Hi folks;

I am ot a developer but I am a just normal user of a PVE machine and the famous "PVE Helper Scripts" to create LXC containers. I am not a heavy user and once a while I use those scripts to create a LXC for a service for my home lab. However since yesterday whan I was trying to create a LXC I started to receive the 429 error and that is still happening, even 16 hours later. What am I doing wrong? I only find on the internet saying that I am "abusing" and should wait for an hour or two but after many hours, I tried again and still get that.

[Dann140709]

Hi. The same thing has been happening to me and many other people for a few days now.

It won't let me view or access a raw file without waiting 4 or 5 minutes between each one. Otherwise, it show this:
"429: Too Many Requests
For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service)."

Is like a bad joke, Something is wrong with GitHub's systems.
Please fix this problem.
Thanks

[sgfreelancer]

Is this solved yet? I will try fix this script and container isuue and revert back.

[RomanVanHalen]

[alexjcgdf]

I rebooted my router, got another IP address and even so the problem persists. :(

[sandenbergmelo]

I rebooted my router, got another IP address and even so the problem persists. :(

Same with me. :(

[muchachagrande]

Microsoft is limiting the raw content delivery in the hard way. Many systems that run nowadays using githubusercontent (not scraping it) will hit this problem just for pulling scripts from the site as they always do.

[Raghav0225]

Yhea what to do now. I wanted to get addon for my video. GitHub should solve it

[Peron4TheWin]

Yeah, I got the same issue. Even people who have literally never used GitHub before are getting the same error when trying to access raw content.
This has been happening for 2 or 3 days now, and I have no idea how it will proceed :/

[Saulildo]

I'm experiencing this issue as well, and I've noticed multiple reports from others encountering the same issue. It appears that github has begun incorrectly flagging users for scraping activity. Changing the IP appears to be the only effective solution

[enzo1110]

Same Here with the Same Error 429 and Not working After rebooting my router.
It Is very sad.
Coule be AI the culprit by scraping GitHub from my ip range?

Edit: By any way, i am NOT SCRAPING, Like all of us here.

[soutiagojose]

I stayed a few days without accessing GitHub and I returned today after receiving a report about a broken link. When I checked it, GitHub returned error 429 even for my account, which is barely used.

[NinetiesPaul]

I've been dealing with this very same issue as well, for some days now. Is there any official statements from Github or Microsoft about this? Have this issue been recognized by them?

[Dann140709]

This has been happening for a few days for many of us who have low activity on HitHub, but for others with similar activity, the same thing isn't happening.
I see that the bot detection system (scraping) is really working very poorly, flagging IPs and limiting access for normal users for no reason.
It's really embarrassing, and we need a solution from HitHub. Not changing IPs or trying to circumvent this, because this is WRONG, I DON'T SCRAP, and my requests on the platform are really very low and not repetitive, like a bot would.

I need a solution, or I'll move my repos to another service like Codeberg.

[Aetherarchio]

Same issue here.
Started around a day or two ago maybe, and I can confirm I wasn't even using GitHub in any frequent way lately, that is very strange.

To test, I can't access https://raw.githubusercontent.com/ScoopInstaller/Extras/refs/heads/master/bucket/koboldcpp.json for example to get the raw manifest file. Not that I was doing it, just an example, but this affects any situations like this, such as fetch a remote backup config file, for example:

Result:

429: Too Many Requests For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service). 

Can someone from the team have a look at this? I haven't performed anything akin to scraping at all, or even intensively quarried the API or resources.

This basically makes me unable to use anything tied to GitHub seriously going forward if it's not solved.

[camira-r]

Same here. I thought was my IP or something else but turns out many people having the same 429 issue.

[Dann140709]

Yes, is your IP, flagded by GitHub without reason, saying youre a scrapper...

[enzo1110]

Still getting Errors. When directly accessed Error 429.

[alexjcgdf]

Still on the same here as well. Just tried again to run a LXC script:
bash -c "$(curl -fsSL https://raw.githubusercontent.com/community-scripts/ProxmoxVE/main/ct/libretranslate.sh)"

Before using that I used a similar script more thana week ago. And from 2 days ago I am still being flagged. Is there any moderator here that have the leverage to open a bug issue regarding this? Or should I bring this subject to a different forum? This is a honest question.

[Mieekaserra]

Seems to be isolated to South America, at least for our users.

[McKoe]

Probably this is true, I'm facing the same issue, I can't get node-red successful installation and all raw GitHub contents are displaying the 429 error.

Solved with a VPN pointing to the USA. Thanks!

[Heliton-Dev]

im in south america and can confirm 🔥

[GuiMilani]

Can confirm, brazilian here

[jp-aa]

bruh I can't even cli - clone a repo, also the same 429 thing when trying to view raw files. It's like github is trying to get replaced

[meerbahadin]

bruh I can't even cli - clone a repo, also the same 429 thing when trying to view raw files. It's like github is trying to get replaced
see https://www.githubstatus.com/ its a outage

[Daevinski]

Same here. Can't use Wabbajack because I can't connect. I don't know what it means to be a "scrapper", but I only use GitHub for Wabbajack.

[Diagonet]

This is seriously troublesome, so much of my selfhosting structure depends on getting raw json files from github, its literally only a few kbs though.

[Syzzle07]

Can confirm it was fixed and then came back in Brazil.

[DenizFeital]

Yep, worked only for a few hours. Oh Dear.

[Dann140709]

GitHub have a new 429 message now... At least it's more realistic

[BlackLastNight]

That's how I feel every time I see that damn 429 error. grrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr!!!

[Laggh]

Guess this is a wakeup call to not using github for hosting anymore

[Dann140709]

Exact

[enzo1110]

This is BS sorry. A big pile of.

[pablopoo]

To the one that is editing the GitHub rate limit varnish config: it's :wq

[neoveil]

To the one that is editing the GitHub rate limit varnish config: it's :wq

well, maybe whoever’s doing it should try ctrl+x ctrl+s instead

[idest]

I disagree, the last thing we need right now is this guy developing emacs pinky and being unable to resolve our issue

[leandrobattochio]

People from Github right now:

It was good while it lasted.

[neoveil]

guess what? here we are again.
i'll have to say this in my language: alegria de pobre dura pouco
i think i'll be dreaming of rate limits tonight.

[ivanbelenky]

same here

[apulise]

Todo lo que sube(user content) tiene que bajar(429)

[Suzakun14]

I don't know if it is just me but i saw a comment few minutes ago suggesting adding this line to /etc/hosts

185.199.110.133 raw.githubusercontent.com

Seems to be the us ip of github. please let me now if it works for all of you, at least for me in chile it worked

[apulise]

Yeah I saw a comment recommending that, tried it and worked just fine

[leandrobattochio]

Lets enjoy until they block it again!

[ghost]

Well that didnt work for me ! is there any other way ?

[jp-aa]

Nope, just got an invalid cert warning and then a 404 :'(

[Laggh]

Aparently its working again, see for how long it'll be up

[AdilsonTorres]

Someone from GitHub mentioned this or explained the reason for this?

[pablopoo]

Nothing. I believe the people in charge where traveling to the GitHub Universe conference.

[MichaIng]

Just that the issue started 3 days before the conference.

[pablopoo]

Just that the issue started 3 days before the conference.

Yes, but when you host an event, you don't start working on it the same day.

[MichaIng]

In an organization like GitHub, event management and technical maintenance is not done by the same people.

If you check the incident history, you will notice that several infrastructure issues were solved during the event days. They cannot and do not pause everything else just because some event is happening at the end of the week. Not everyone at GitHub is setting even close to the location to attend it.

[Alexhuszagh]

I'm receiving this issue as well despite curling a single file like 4x a day. I'm getting around it right now by caching the files but this is maybe 30MB of data transfer and getting 429 result accessing the raw data of any other file (done for testing) and the specific file is returning a 404.

[meerbahadin]

getting same issue just now!!

[johnspurlock]

Bear in mind github is having a pretty serious outage at the moment: https://www.githubstatus.com/incidents/5q7nmlxz30sk