Collect and Store Logs of Apps Running on Kubernetes Cluster Using Complete ELK Stack | Tutorial

Collect and Store Logs of Apps Running on Kubernetes Cluster Using Complete ELK Stack | Tutorial

180 Lượt nghe
Collect and Store Logs of Apps Running on Kubernetes Cluster Using Complete ELK Stack | Tutorial
GitHub Repo: https://github.com/iQuantC/Filebeat-Logstash-Elasticsearch-Kibana-Kubernetes 💡Description: In this hands-on DevOps tutorial, you’ll learn how to collect, store, visualize, and analyze logs from applications running inside a Kubernetes cluster using the ELK Stack — Elasticsearch, Filebeat, Logstash and Kibana — all deployed on Minikube! Whether you're a beginner exploring Kubernetes observability or an engineer building production-grade logging pipelines, this project gives you practical, real-world experience. 🔧 What You'll Learn: 📦 How to deploy and expose apps (NGINX, Busybox) in Kubernetes 📊 How to set up Elasticsearch for storing logs with persistent storage 📄 How to deploy Filebeat as a DaemonSet to collect container logs 🧠 How to configure Filebeat to forward logs to Logstash 🧠 How to configure Logstash to forward logs to Elasticsearch 📈 How to access and analyze logs using Kibana’s Discover dashboard 🌐 How to mount local storage into Minikube using hostPath volumes 🔐 Tips for troubleshooting PVC/PV issues and pod scheduling problems 💡 Tools Used: 1. Kubernetes (Minikube) 2. Elasticsearch 7.17 3. Filebeat 7.17 4. Logstash 7.17 5. Kibana 7.17 6. NGINX + Busybox Sample Apps 7. YAML, Kubectl, and curl 📁 Project Highlights: ✔️ Full ELK Stack integration with Kubernetes ✔️ Persistent volume storage for Elasticsearch ✔️ Namespace-level app logging ✔️ Live NGINX log ingestion into Kibana ✔️ Production-grade troubleshooting steps included 👉 Ready to master Kubernetes logging and observability? 🎯 Hit Like, Subscribe, and Turn on Notifications for more DevOps projects! 🧠 Drop your questions or thoughts in the comments — let’s build and learn together! #Kubernetes #Elasticsearch #elasticsearchtutorial #Filebeat #Logging #kibana #DevOps #TechTutorial #observability #Daemonset 🔗 Timestamps: 00:00 - Intro and Project Overview 02:46 - Minikube Kubernetes Cluster Set up 03:30 - Deploying Sample Apps 05:27 - Setting up Elasticsearch with PVC 09:11 - Setting up Kibana 12:03 - Setting up Logstash 14:39 - Deploying Filebeat 17:39 - Viewing Logs in Terminal and Kibana 25:44 - NGINX App deployment 29:12 - Final Wrap-up Disclaimer: This video is for educational purposes only. The tools and technologies demonstrated are subject to change, and viewers are encouraged to refer to the official documentation for the most up-to-date information. Follow Us: GitHub: https://github.com/iQuantC Instagram: https://www.instagram.com/iquantconsult/ Happy logging! 🎉