ArcGIS Survey123: How to Create an AI Smart Assistant | #EsriDevSummit2024

Leverage your own AI models within your Survey123 forms. Use them to automatically detect objects in photos or to classify images. In this session, we will share some common use patterns and discuss the process to create your own models for the Survey123 mobile app. Session Level: Advanced 📚 Resources ============= 📄 Slides: https://static.rainfocus.com/esri/24epcdev/sess/1699045865827001vVJM/SPDF/ArcGIS%20Survey123%20How%20to%20Create%20an%20AI%20Smart%20Assistant_1709753941030001wVuK.pdf Questions? We'd love to answer them on Esri Community! 💬 Community forums: https://community.esri.com/t5/developers/ct-p/developers 📹 More Esri Developer Summit 2024 videos ============= Mediaspace (all): https://mediaspace.esri.com/channel/2024+Esri+Developer+Summit/325483122 YouTube: https://www.youtube.com/playlist?list=PL0VMTWv3XRwXlVEMgQxTrux6Tlk4DTWGO 🕑 Chapters ============ 00:00 Intro 00:48 What we'll cover 01:30 AI in ArcGIS Survey123 02:50 Smart assistants 04:02 Machine learning models 04:38 ML models in Survey123 05:28 Image classification and object detection 07:22 Smart attributes 07:50 Object detection results 08:28 Live camera preview 09:03 Smart redaction 10:12 Smart annotation 11:07 Samples in Survey123 Connect 11:40 Smart reduction demo 13:53 Smart attributes demo 15:27 Train a model 15:41 Manhole object detection model 16:10 Training procedure (object detection) 17:01 Train models with ArcGIS 17:58 Environment: Cloud vs local 19:34 Gather images 21:47 Label images 22:50 Label images demo 24:57 Set up environment 25:39 Train with ArcGIS API for Python 28:22 Python code to train the model 34:19 Summary of considerations 36:59 Add the model to a survey 37:45 Extract attributes from an image 38:16 Our model in action 40:00 Resources 40:14 Lean more 40:24 Enhanced calculations with AI 41:38 Demo 44:51 Survey123 sessions at the DevSummit 45:14 Survey123 resources 45:41 Social accounts 46:00 Q&A 👉 Follow us ============= 🔔 Subscribe to Esri Developers on YouTube: https://www.youtube.com/@EsriDevs 🔴 Videos at Esri Mediaspace: https://bit.ly/3MXWbqq ❎ @EsriDevs on X: https://x.com/EsriDevs ❎ @EsriDevEvents on X: https://x.com/EsriDevEvents ❎ @EsriStartups: https://x.com/EsriStartups 🐙 GitHub: https://github.com/esri & https://github.com/EsriDevEvents 🏷️ Tags ============= #developers #EsriDevSummit2024 #maps #mapping #esri #arcgis #geodev #gis #geospatial #spatialdata #geospatialdata #survey123 #geo #locationintelligence #artificialintelligence #ai #objectdetection