Making the Rails Default Job Queue Fiber-Based

(paolino.me)

2 points | by earcar 5 hours ago ago

1 comments

  • earcar 5 hours ago

    Author here. I opened the Solid Queue fiber-worker PR because I needed Rails background jobs to handle long-running LLM streams without allocating a worker thread per conversation.

    The implementation shipped today in Solid Queue 1.6.0. It uses one Async reactor thread per fiber worker, keeps thread workers available for CPU-bound or blocking jobs, and requires fiber-scoped Rails isolation.

    One caveat: the benchmark results in the article were produced from the pre-release PR branch. I’ve marked that clearly and will rerun the suite against the 1.6.0 tag over the next few weeks.

    Happy to answer implementation or Active Record connection-pool questions.