Over the last week, since Anthropic's announcement about watermarking Claude's text, I've seen a lot of questions being raised about the effect of watermarking on the quality of generated text, as well as debates about the efficacy of detectors. So I built this interactive demo where you can actually try 3 different watermarking schemes, along with their detectors.
I found it illustrative to try different examples like code, text rewriting, etc. to see how it affects the tokens. Playing around with the detector is interesting too to see how much of the watermark can remain in edited text.
I found it helpful to experientially understand how these watermarks work, and I hope you do too.
You note that your biggest takeaway "was how elegant the core watermarking schemes are"—and I agree. I've engaged in R&D surrounding similar schemes for nested data in the past, but the constraints of hiding signal in plaintext present an additional conceptual challenge and it's interesting to see how various implementations meet that challenge.
Over the last week, since Anthropic's announcement about watermarking Claude's text, I've seen a lot of questions being raised about the effect of watermarking on the quality of generated text, as well as debates about the efficacy of detectors. So I built this interactive demo where you can actually try 3 different watermarking schemes, along with their detectors.
I found it illustrative to try different examples like code, text rewriting, etc. to see how it affects the tokens. Playing around with the detector is interesting too to see how much of the watermark can remain in edited text.
I found it helpful to experientially understand how these watermarks work, and I hope you do too.
Excellent explainer and demo.
You note that your biggest takeaway "was how elegant the core watermarking schemes are"—and I agree. I've engaged in R&D surrounding similar schemes for nested data in the past, but the constraints of hiding signal in plaintext present an additional conceptual challenge and it's interesting to see how various implementations meet that challenge.