Experience: 8+ Years
Industry: Fintech / Financial Services
Notice Period: Immediate to 30 Days
Job Summary
We are looking for an experienced Data Engineering Manager with strong hands-on expertise in Big Data, Data Warehousing, Distributed Data Architecture, Python/Scala, SQL, Hadoop, and AWS.
The candidate will be responsible for designing, developing, and maintaining scalable data pipelines, data warehouses, data marts, and large-scale data processing systems.
Mandatory Technical Skills
Python / Scala: Strong hands-on development experience with production-grade data engineering systems.
SQL & Data Warehousing: Advanced SQL, data modelling, query optimization, and large-scale data warehouse design.
Hadoop Ecosystem: Strong understanding of Hadoop architecture, HDFS, YARN, and MapReduce.
AWS Cloud: Hands-on experience designing and developing data pipelines using AWS services.
Big Data & Distributed Systems: Experience with high-volume data processing, distributed architecture, and performance optimization.
ETL / Data Pipelines: Strong experience building scalable ETL/ELT pipelines, data marts, and data frameworks.
API Development: Hands-on experience in API development, publishing, and integration.
Data Processing: Experience handling structured, unstructured, and streaming datasets.
Performance Tuning: Experience identifying and resolving production performance bottlenecks.
Leadership & Communication: Ability to collaborate with global engineering teams, guide developers, and manage multiple projects.