I’m a Backend & Platform Engineering Leader with over a decade of experience building software from the ground up and scaling platforms to serve millions of users globally.
Throughout my career, I’ve worn many hats — from founding engineer and team builder to technical lead and platform architect. I’ve spent 8+ years in startup environments, partnering closely with business, product, and design teams to turn ideas into scalable, user-focused solutions.
- Backend Engineering: Design and build highly available, performant microservices (HTTP/REST, GraphQL, gRPC, WebSockets, XMPP).
- Platform & Infrastructure: Architect Kubernetes, Helm and Terraform-based systems for cloud-native deployment and scalability.
- MLOps / LLMOps: Build model-serving infrastructure, enabling seamless AI model deployment, scaling, and observability across clusters.
- Leadership: Hire, mentor, and lead cross-functional teams to deliver robust, user-centric software that scales.
- Product & UX Collaboration: Bridge the gap between technical complexity and business goals, ensuring smooth product delivery and a great user experience.
Languages & Frameworks: Python, Go, NodeJS, TypeScript, Django, FastAPI, NestJS, Erlang/OTP
Data & Messaging: PostgreSQL, MongoDB, Redis, Kafka, RabbitMQ, ElasticSearch
DevOps & Cloud: Kubernetes, Docker, Terraform, AWS, Azure, Prometheus, Grafana
AI & MLOps: Model Deployment, vLLM, Hugging Face, Ray, Monitoring, Benchmarking
- Open Innovation AI (OICM): Designing AI & LLM infrastructure for distributed Kubernetes clusters.
- Open Source:
- 🧠 GitGossip — LLM-powered Git commit summarizer.
- ⚙️ KubeMemory — Namespace-based in-memory store for Kubernetes.
- 🔍 MIGScope — GPU MIG metrics introspection tool.
- Learning & Exploration: Distributed Systems, AI Infrastructure, and next-gen MLOps patterns.
“There is a solution after the problem.”
I believe in simplicity, ownership, and continuous learning — building systems and teams that scale together.
- 🌍 Website
- 🧑💻 GitHub
- ✉️ osmangoni.se@gmail.com