Reddit RSS feeds recent rate limiting and solution

(lapcatsoftware.com)

31 points | by zdw 11 hours ago ago

12 comments

  • Symbiote 4 hours ago

    It would help if Reddit used the standard Retry-After HTTP header, but otherwise I don't see why more than one request per minute is necessary for the expected use of RSS feeds.

    • kevincox 2 hours ago

      I think the question is it a per-feed rate limit or an all-feeda rate limit. If the former then yeah, a complete non-issue. But if it is a global limit than for people following a decent number of feeds it can definitely be an issue.

      • lapcat an hour ago

        > I think the question is it a per-feed rate limit or an all-feeda rate limit.

        It's an all-feeds rate limit. This is also implied by the quoted comment:

        "It looks like only the first request in each batch works, then the others fail."

        It also follows from common sense. Why would all of the people who are seeing this problem be refreshing their feeds more than once per minute? I'm not aware of anyone who does this, and feed readers don't support it. Mine is once per hour. But 25 feeds is 25 requests within a minute.

        Ironically, just loading https://www.reddit.com in a web browser is around 150 URL requests.

  • butz 7 hours ago

    RSS feeds supposed to be the cheapest way to read data from your website, they are not pulling whole 10MB of javascript and other assets, but, yeah, let's block those. Everyone will just send their "llm agents" to pull data from regular website anyway.

    • Symbiote 4 hours ago

      The assets aren't a problem in 2026, they are in an edge cache.

      The RSS feed can't be cached for long, and AI crawlers will be making millions of requests to these.

  • nipperkinfeet 9 hours ago

    It's no wonder all my feeds are red. The internet is becoming so restricted! It's really sad.

    • encrypted_bird 9 hours ago

      Same with youtube. I only log into my Google account like once a month to check Gmail (it's not my daily driver), and I just "subscribe" to channels using RSS. But so often my feeds are red. Not always, but a lot of times at night (UTC-4) for sure.

    • DANmode 7 hours ago

      Why are they all Reddit feeds?! =]

  • hntiz 10 hours ago

    That explains quite a bit. I thought to myself that I've got less mail than usual today, and assumed one of my local cron jobs had failed. But now I noticed it's the Reddit feeds gone quiet.

  • add-sub-mul-div 8 hours ago

    Let it die. The internet will never evolve because people just bent over and took it when Reddit and Twitter closed themselves off and went hostile in 2023.

    • lapcat an hour ago

      Twitter actually removed RSS support way back in 2012, and it did not die. So there's no evidence that Reddit would die either. RSS users are only a small % of their user base.

  • Terr_ 8 hours ago

    The enshittification continues as the garden is walled-off.