Download as PDF, PPTX
Uploaded byBret Fisher
Building Your Docker Swarm Tech Stack
The document outlines a presentation by Bret Fisher on building a Docker swarm tech stack, focusing on developing full-stack infrastructure tools for container clusters. It emphasizes the need for patterns and examples to manage complex clusters, advocating for a practical approach to start small and scale. The document also discusses various cloud-native tools, deployment strategies, and operational considerations, along with promoting the use of Docker and related technologies for effective DevOps practices.
Building Your Docker Swarm Tech Stack
- 1. BRET FISHER Docker Captain,DevOps Dude, Author of Docker Mastery Building Your Swarm Tech Stack bretfisher.com/dockercon18 @bretfisher
- 2. People ask "Where'smy LAMP for container clusters?" Your solutions will be a "stack" of infrastructure tools Cloud-native container tools are new We need patterns and examples of full cluster stacks Problem: No Server Tool Lives In Isolation
- 3. Build examples offull-ish stacks on different tools Options for solo to medium-sized DevOps/Ops teams Use Docker Swarm latest stable as orchestrator Limit cloud vendor lock-in* 4 Goals for Today * Lock-in: A service I can't swap out in my server stack
- 4. The Duality ofContainer Infrastructure “It was the best of times, it was the worst of times, it was the age of wisdom, it was the age of foolishness, it was the epoch of belief, it was the epoch of incredulity...” Charles Dickens A Tale of Two Cities, 1859
- 5. Clusters are Complex Startsmall and simple, grow them as you grow
- 6. EE Platform Architecture PhysicalVirtualizationPublicCloud Platform Security Developer Services Registry Services Access Policies App Lifecycle Management Automation & Extensibility Networking Orchestration Storage Container Engine ENTERPRISE EDITION PLATFORM
- 7. CE Platform Architecture PublicCloud Overlay Swarm Container Engine COMMUNITY EDITION PLATFORM PhysicalVirtualization Platform Security
- 9.
- 10.
- 11. Epic Battle Royale,on Swarm dogvs.cat
- 12. Epic Battle Royale,on Swarm dogvs.cat VS
- 13. Epic Battle Royale,on Swarm dogvs.cat Sci-Fi Sounds Edition
- 14. dogvs.cat App Services www.dogvs.catvote.dogvs.cat blog.dogvs.catresult.dogvs.cat
- 15. dogvs.cat App Services www.dogvs.catvote.dogvs.cat blog.dogvs.catresult.dogvs.cat (Stack Files)
- 16. dogvs.cat Swarm CE, (Han) SoloSysadmin
- 17. Cloud agnostic, minimalinfra Apps auto-recover on node fail Incoming TLS Centralized logging Centralized monitoring Healthcheck all containers Infra Requirements of dogvs.cat Performance auto-scaling Self-healing nodes Support serverless functions Services highly available Han Solo Requirements Optional Requirements for Later
- 18. 3+ Droplets (Ubuntu18.04) Block Storage (Volumes) Load Balancer (incoming HTTP) Digital Ocean dogvs.cat Services Needed for High Availability
- 19. App Services www.dogvs.cat vote.dogvs.catblog.dogvs.catresult.dogvs.cat
- 20. App Services +L7 Proxy www.dogvs.cat vote.dogvs.cat blog.dogvs.catresult.dogvs.cat
- 21. App Services +L7 Proxy + Overlay www.dogvs.cat vote.dogvs.cat blog.dogvs.catresult.dogvs.cat
- 22. App Services +L7 Proxy + Ops www.dogvs.cat vote.dogvs.cat blog.dogvs.catresult.dogvs.cat
- 23. App Services +L7 Proxy + Ops www.dogvs.cat vote.dogvs.cat blog.dogvs.catresult.dogvs.cat
- 24. Cluster + ExternalLoad Balancer www.dogvs.cat vote.dogvs.cat blog.dogvs.catresult.dogvs.cat
- 25. Open Source Stack HW/ OS Docker Machine + Digital Ocean Runtime Docker CE Orchestration Docker Swarm Networking Docker Swarm Overlay Storage REX-Ray + Digital Ocean Volumes Layer 7 Proxy Traefik + Let's Encrypt Central Logging Elastic ELK Central Monitoring Prometheus + Grafana Swarm GUI Portainer
- 26. Deploy Nodes: DockerMachine ./create-servers.sh ./enable-monitoring.sh ./create-swarm.sh
- 27. Deploy Storage: RexRayPlug-in docker stack deploy -c stack-rexray.yml rexray
- 28. Deploy Proxy Stack:Traefik with Let's Encrypt docker stack deploy -c stack-proxy.yml proxy http://www.dogvs.cat:8080/dashboard/
- 29. Deploy Ops Stacks: Prometheus+ ELK + Portainer docker stack deploy -c stack-swarmprom.yml prom docker stack deploy -c stack-elk.yml elk docker stack deploy -c stack-portainer.yml portainer
- 30. Our Apps: Voting+ Ghost + Static Site docker stack deploy -c stack-ghost.yml ghost docker stack deploy -c stack-voting.yml vote docker stack deploy -c stack-menu.yml menu
- 31. Deploy Stacks: MaintenanceTasks docker stack deploy -c stack-prune.yml prune backups (in stack file with app)
- 32. Day Two Operations:Updates stack deploy ∞ micromanage update_config and healthcheck tune your limits and reservations
- 33. Swarm CE, Trek Tag-TeamDevOps dogvs.cat
- 34. Create Swarm withTerraform Moving beyond docker-machine for multi-admin
- 35. Docker for AWS/Azure *forCE only
- 36. Remote Management Bonus 18.09has SSH endpoints for docker CLI !! DOCKER_HOST=ssh://user@server docker ps
- 37. Windows Server 2019Workers Swarm and overlay network feature parity!
- 38. Windows Server 2019Workers Swarm and overlay network feature parity!
- 39. Our Apps usingDocker App docker-app deploy dogvscat/ghost:0.1.0 docker-app deploy dogvscat/voting:0.1.0 docker-app deploy dogvscat/menu:0.1.0 * Go check it out at github.com/docker/app
- 40. Security? host setup scanning:Docker Bench image scanning: Aqua Microscanner behavior monitoring: Sysdig Falco user namespaces
- 41.
- 42. Complex Infrastructure, HarderDeployment "How can I deploy many multi-tier app on a many servers, with all the b e l l s a n d w h i s t l e s o f H A orchestration, have load balancing at all levels, with failover and auto recovery?" Amazonian Team
- 43. CE Platform Architecture PhysicalVirtualizationPublicCloud Platform Security Networking Orchestration Container Engine COMMUNITY EDITION PLATFORM
- 44. EE Platform Architecture PhysicalVirtualizationPublicCloud Platform Security Developer Services Registry Services Access Policies App Lifecycle Management Automation & Extensibility Networking Orchestration Storage Container Engine ENTERPRISE EDITION PLATFORM
- 45. No More OneSize Fits All Docker for AWS Docker for Azure for CE only
- 46.
- 47.
- 48.
- 49. Docker EE onAWS Stack HW / OS Terraform + Ansible + AWS Runtime Docker EE Orchestration Docker Swarm Networking Docker Swarm Overlay Storage Docker Cloudstor EBS/EFS Layer 7 Proxy HTTP Routing Mesh (Interlock+Nginx) Registry Docker EE DTR Central Logging AWS Cloudwatch Logs Central Monitoring AWS Cloudwatch + Telegraph Swarm GUI Docker EE UCP
- 50. Summary Infrastructure as code,make everything repeatable No "special" nodes, use remote management Grow as you go, assume you'll resize Look for compose files of popular tools to make stacks Don't throw out the good in search of the perfect
- 51. Where to GoFrom Here Automating Docker Enterprise 5:25 this room Mission-Critical Migration to Multi-Cluster Kubernetes Wed 2pm room 113 Swarm Intro Workshop Today 4pm room 133 Wed 1:30pm room 133 Swarm Hallway Track Wed 4pm
- 52. I'd like to thankthe internet
- 53.
- 54. PLEASE USE SESSION SURVEYIN EVENTSPACE APP Thanks! ! bretfisher.com/dockercon18 "Building Your Swarm Tech Stack"