Transforming data into business value through scalable cloud solutions
Data Engineer with 5+ years of professional experience and 10+ years in technology, specializing in Python, Apache Airflow & FinOps. Proven track record in building scalable ETL/ELT pipelines and implementing cloud cost optimization strategies for financial services and e-commerce companies.
- Data Engineering: Apache Airflow, Apache Spark (PySpark), Databricks, Kafka
- Cloud Optimization: AWS to OCI migration, FinOps practices, Infrastructure cost reduction
- Programming: Python (Pandas, NumPy, Boto3), SQL, Go
- Database Management: PostgreSQL, MySQL, MongoDB, Oracle, SQL Server
- DevOps: Docker, Terraform, GitHub Actions, CI/CD pipelines
- 🌩️ Cloud Migration: Led zero-downtime migration of legacy financial systems to Oracle Cloud Infrastructure
- 💰 Cost Optimization: Achieved significant infrastructure cost reduction through strategic cloud migration
- 📊 Scale Processing: Managed hundreds of Airflow DAGs processing millions of daily financial transactions
- 🔧 Performance Improvement: Optimized Databricks/Spark clusters and SQL queries for better performance
- 📈 Uptime Excellence: Maintained high reliability for financial data processing systems
- 🤖 Automation Impact: Substantially reduced manual errors through Python automation scripts
- ⚡ Incident Response: Significantly improved incident response time through proactive monitoring
- Companies: PicPay (Fintech)
- Tech Stack: Apache Airflow, Apache Spark, Oracle Cloud Infrastructure
- Scope: Hundreds of DAGs processing millions of daily transactions
- Achievement: Strategic AWS to OCI migration with cost reduction
- Tools: Oracle Data Pump, Terraform, Cloud monitoring tools
- Impact: Ensured business continuity during financial system migrations by minimizing downtime and overall impact
- Company: INPE (Space Research Institute)
- Project: Atmospheric research data processing and astronomical observation
- Tech Stack: Python (PyQt, NumPy), Shell scripting, GitHub
I'm always interested in discussing:
- 🔧 Data Engineering best practices & Apache Airflow
- ☁️ Cloud cost optimization strategies (FinOps)
- 🏗️ Large-scale data processing architectures
- 💳 Financial services data challenges
| Platform | Link | Direct Access |
|---|---|---|
 | Professional Profile | linkedin.com/in/pliniopereira |
 | Code Repository | github.com/pliniopereira |
 | Send Message | pliniojr@gmail.com |
💬 Let's connect! Feel free to reach out for collaborations, opportunities, or just to say hello!