Tutorial 3c – GroupBy, GroupByKey, CoGroupByKey and GroupIntoBatches Transform in Apache Beam

Tutorial 3c – GroupBy, GroupByKey, CoGroupByKey and GroupIntoBatches Transform in Apache Beam

3.446 Lượt nghe
Tutorial 3c – GroupBy, GroupByKey, CoGroupByKey and GroupIntoBatches Transform in Apache Beam
github url: https://github.com/vigneshSs-07/Cloud-AI-Analytics/tree/main/Apache%20Beam%20-Python In this videos we are going to discuss about what is Transformations - GroupBy, GroupByKey, CoGroupByKey and GroupIntoBatches. GroupBy: ● Takes a collection of elements and produces a collection grouped, by properties of those elements. GroupByKey: ● GroupByKey is a Beam transform for processing collections of key/value pairs. ● Takes a keyed collection of elements and produces a collection where each element consists of a key and all values associated with that key. CoGroupByKey: ● While GroupByKey performs this operation over a single input collection and thus a single type of input values, CoGroupByKey operates over multiple input collections. ● CoGroupByKey expects a dictionary of named keyed PCollections, and produces elements joined by their keys. GroupIntoBatches: ● Batches the input into desired batch size. Apache Beam - Playlist https://youtube.com/playlist?list=PLA3TuOOaQOnmxerILIQlBIIy7igMo0Ax1 Tutorial 0 - Introduction to Apache beam https://www.youtube.com/watch?v=82p6j5I_VD4&list=PLA3TuOOaQOnmxerILIQlBIIy7igMo0Ax1&index=2 Tutorial 2 - PCollections In Apache Beam - Python https://www.youtube.com/watch?v=8wDs7vNJoiY&list=PLA3TuOOaQOnmxerILIQlBIIy7igMo0Ax1 Tutorial 3a – Map, FlatMap and Filter Transforms in Apache Beam https://www.youtube.com/watch?v=dSZOY4vkr1E&list=PLA3TuOOaQOnmxerILIQlBIIy7igMo0Ax1&index=4 Tutorial 3 b – ParDo, Keys, Kvswap, Values, ToString Transform in Apache Beam https://www.youtube.com/watch?v=NaH-rVwUDTI&list=PLA3TuOOaQOnmxerILIQlBIIy7igMo0Ax1&index=5 Tutorial 3c – GroupBy, GroupByKey, CoGroupByKey and GroupIntoBatches Transform in Apache Beam https://www.youtube.com/watch?v=hcUTBjsgl3Q&list=PLA3TuOOaQOnmxerILIQlBIIy7igMo0Ax1&index=6 Subscribe to Channel: https://lnkd.in/ehFZbVH5 Follow us in LinkedIn: https://lnkd.in/gDT3ESdm Follow us in Instagram: https://lnkd.in/gZ278ShA Follow us in Facebook: https://lnkd.in/gQGF_3Eb Follow us in Twitter: https://lnkd.in/gh7dZACW Join in Telegram channel: https://lnkd.in/guFt2sAg Join in WhatsApp group: https://lnkd.in/gAqkuDPA Connect with me here: Instagram: https://www.instagram.com/thearrow0494 LinkedIn: https://www.linkedin.com/in/vignesh-sekar-sujatha-02aa9b125/ 🙏🙏🙏🙏🙏🙏🙏🙏 YOU NEED TO DO BELOW THINGS to support my channel 1. LIKE 2. SHARE & 3. SUBSCRIBE TO MY YOUTUBE CHANNEL #gcpcloud #gcpdataengineer #Apachebeam