Making Postgres queues scale

(dbos.dev)

52 points | by KraftyOne 2 hours ago ago

4 comments

  • dewey an hour ago

    > The conventional wisdom around Postgres-backed queues is that they don't scale.

    That might have been the case 10 years ago. In the past years there have been many Postgres powered queueing systems and even Rails switched to Postgres powered queues by default (SolidQueue) more than 3 years ago.

  • sorentwo 29 minutes ago

    They certainly do, and I don't think it's a controversial take at this point.

    Shameless link to an older article about throughput with Oban (https://oban.pro/articles/one-million-jobs-a-minute-with-oba...), and in follow-up research we've sustained 12k/s with a p99 under ~100ms.

  • richwater 6 minutes ago

    Reading Postgres queuing posts always seem like deja vu. People love to write about them

    • mlnj 4 minutes ago

      These days, most of them are from the DBOS folks. :)