The State of GenAI & ML in the Cloud Native Ecosystem - Alejandro Saucedo & Bartosz Ocytko, Zalando

Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon events in Hong Kong, China (June 10-11); Tokyo, Japan (June 16-17); Hyderabad, India (August 6-7); Atlanta, US (November 10-13). Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at https://kubecon.io The State of GenAI & ML in the Cloud Native Ecosystem - Alejandro Saucedo & Bartosz Ocytko, Zalando SE The growth of GenAI & ML has brought new emerging challenges; in this talk we dive into the state of production of GenAI & ML in the cloud native ecosystem, where we provide an overview of trends, challenges, opportunities and tooling that the ecosystem is standardizing towards. As part of this session, we will provide a snapshot of the current state of the ecosystem, as uncovered by recent surveys, which highlights the gaps in tooling and skills [1]. We will then cover the best practices and tooling that are arising from production use-cases of LLMOps/MLOps at scale to tackle domain-specific challenges such as agentic-workflows, AI guardrails, efficiency requirements - between others. These include the OSS frameworks [2] that are supporting the end-to-end LLMOps / MLOps lifecycle across pipelining, optimization, productionisation, monitoring/observability and ML safety. [1] https://ethical.institute/state-of-ml... [2] https://bit.ly/ml-list