How to Watermark Text (LLM Watermarking Explained)

A primer on how watermarking for LLMs and text in general works. Contents: 0:00 Motivation 0:43 Ethics of LLM usage 1:09 Use cases 2:31 Desired properties 6:04 LLM refresher 7:08 "Hard" watermark 12:31 "Soft" watermark 14:25 Attacks 16:36 Other schemes 18:51 Watermarks are not ready References: - Kirchenbauer et al.: https://proceedings.mlr.press/v202/kirchenbauer23a.html - Kuditipudi et al.: https://arxiv.org/abs/2307.15593 - Jovanović et al.: https://watermark-stealing.org/ - Abdelnabi S., Fritz M.: https://arxiv.org/abs/2009.03015