SQLite Rsync: Database Remote-Copy Tool for SQLite

(sqlite.org)

75 points | by Peter5 a year ago ago

12 comments

  • vanous a year ago

    Thank you very much.

    It would be useful to have dates for created and for edited on the articles. With the huge scope of the SQLite project, I have no idea whether this is historical, current, or upcoming.

  • rich_sasha a year ago

    Fantastic, looks like something I need! Some questions in case someone knows:

    - is the source DB blocked in any way when this is running? E.g. is this like an ordinary read, or something different? I know WAL mode gives more concurrency but still writes are queued up in the wal file during a long read

    - can this operate on a ~continuous basis? Or can I run it every few mins?

    Thanks!

    • zimpenfish a year ago

      > is the source DB blocked in any way when this is running?

      Doesn't sound like it: "If other processes change the content of ORIGIN while this command is running, those changes will be applied to ORIGIN, but they are not transferred to REPLICA"

      Sounds like it uses the internal snapshot mechanism[0] and replicates that.

      [0] https://www.sqlite.org/c3ref/snapshot.html

  • config_yml a year ago

    This is great, could be useful for keeping a standby up to date with a systemd timer/cron.

  • ollybee a year ago

    It seems I have some scripts to update today

  • avinassh a year ago

    checkout Simon Willison's notes if you want to know how to get this running and try: https://til.simonwillison.net/sqlite/compile-sqlite3-rsync

  • rrevi a year ago

    Which now begs the question, sqlite3_rsync vs Litestream[0]?

    [0] https://litestream.io/

    • zimpenfish a year ago

      Why not both? They solve different problems, after all.

      I'm currently using `litestream` for backups but I might add `sqlite3_rsync` as a point-in-time replica for things that benefit from "remote" sqlite access - easier than restoring a version from `litestream`, safer than copying it myself, and a lot easier than transporting changes over NATS / HTTP / whatnot.

    • kgeist a year ago

      Looks like Litestream streams changes but sqlite3_rsync only updates a snapshot at the time it was called.

  • a year ago
    [deleted]