Watermarks: Time and Progress in Apache Beam and Beyond

Slava Chernyak (Google Inc) Watermarks: Time and Progress in Apache Beam and Beyond Strata Hadoop NYC 2016 Watermarks are a system for measuring progress and completeness in out-of-order streaming systems, and are utilized to emit correct results in a timely manner. Given the trend towards out-of-order processing in existing streaming systems, watermarks are an increasingly important tool when designing streaming pipelines. This talk will explain watermarks and explore real-world applications.