100M commits to GitHub without using Git push

(github.com)

1 points | by Wuerfelhusten 11 hours ago ago

2 comments

  • turtleyacht 3 hours ago

    Maybe in a couple years, a hundred million commits will be "next Tuesday." Developer machines might come with a 20 TB external hard drive.

  • Wuerfelhusten 11 hours ago

    Pure Python CLI that writes Git pack files directly and streams them via Smart HTTP. No git binary, no subprocess. git push recomputes deltas on every push (O(n²)). Streaming pre-built packs lets the server run index-pack (O(n)) instead. REF_DELTA + empty tree SHA-1 = ~80 bytes/commit. ~49,000 commits/sec. 34 min to generate, 3h to push. git fsck --full passes.