Large-Scale Architecture: The Unreasonable Effectiveness of Simplicity • Randy Shoup • YOW! 2022

This presentation was recorded at YOW! 2022. #GOTOcon #YOW https://yowcon.com Randy Shoup - VP Engineering & Chief Architect at eBay @randyshoup46 RESOURCES https://twitter.com/randyshoup https://linkedin.com/in/randyshoup https://medium.com/@randyshoup ABSTRACT Building distributed systems that work is quite challenging. But systems that provide customer value will grow and evolve, and scaling those systems by multiple orders of magnitude is even harder. Citing specific failures and successes from internet-scale consumer properties like Google and eBay, and measuring customer value through the architecturalilities, this session deep-dives into the often counterintuitive architectural principles of simplicity, orthogonality, asynchrony, and feedback. Simplicity helps us turn seemingly intractable problems into discrete and solvable ones. We will discuss component responsibilities, single-threaded straight-line processing, and making changes in small steps. Orthogonality allows us to compose separate concerns and bound the complexity of each dimension of the problem. We will discuss processing abstractions like mixins and addons, as well as communication abstractions like channels and pipes. Asynchrony and eventual consistency further reduce complexity and lead us to drive the system design directly from what really matters – what is actually changing in our core business domain. We will explore events, caching, and dataflow. Finally, fast and consistent feedback help us continually maintain and improve a complex system. We will discuss quality feedback in the small, as well as systems feedback in the large. You will take away some interesting anecdotes, as well as actionable insights you can put into practice in scaling your own systems. [...] TIMECODES 00:00 Intro 01:38 eBay architecture 03:55 Amazon architecture 06:00 Large-scale architecture 06:43 Simple components 14:12 Simple interactions 20:30 Simple changes 30:04 Putting it all together 44:54 Outro 45:35 Q&A Read the full abstract here: https://yowcon.com/brisbane-2022/sessions/2256 RECOMMENDED BOOKS Mary & Tom Poppendieck • Lean Software Development • https://amzn.to/3CxlMUq Ron Kohavi, Ya Xu, Diane Tang • Trustworthy Online Controlled Experiments • https://amzn.to/3qIsTaa Simon Brown • Software Architecture for Developers Vol. 2 • https://leanpub.com/visualising-software-architecture David Farley • Modern Software Engineering • https://amzn.to/3GI468M Dave Farley & Jez Humble • Continuous Delivery • https://amzn.to/3ocIHwd Woods, Erder & Pureur • Continuous Architecture in Practice • https://amzn.to/2QWAmkl George Fairbanks • Just Enough Software Architecture • https://amzn.to/3uZzVo0 https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #SoftwareArchitecture #MinimumViableArchitecture #ModularMonolith #Monolith #Microservices #FeatureFlags #ContinuousDelivery #RandyShoup #SoftwareEngineering #Programming #TDD #SoftwareDevelopment #EventDrivenArchitecture #NetflixArchitecture AmazonArchitecture #FeatureFlag #Sharding #YOWcon CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1