Job Description Overview:
Designs, develops, implements and operates highly complex data pipelines, data products and data management solutions across modern cloud, warehouse and lakehouse platforms. Applies strong software-engineering, data-modeling and distributed-processing practices to deliver solutions that are scalable, secure, resilient, observable and cost efficient. Independently resolves ambiguous engineering problems, contributes to technical direction and reusable standards, and mentors other engineers while partnering across product, architecture, governance, cybersecurity and platform teams.
Primary Responsibilities:
Lead the detailed engineering design, development, testing, deployment and production support of complex data pipelines and reusable data products.
Develop maintainable data-processing and transformation solutions using advanced SQL and programming languages such as Python.
Engineer solutions using Snowflake, Databricks, dbt and comparable modern data platforms; select appropriate warehouse, lakehouse or hybrid patterns based on workload needs.
Design analytical storage solutions using relational databases, cloud object storage, columnar formats and open table formats such as Apache Iceberg.
Implement batch, micro-batch, change data capture (CDC), event-driven and streaming patterns using technologies such as Apache Kafka or comparable platforms.
Integrate data from relational and mainframe systems, APIs, event streams, SaaS platforms, files and object storage with appropriate security and operational controls.
Apply normalized, dimensional, denormalized and data-product-oriented modeling approaches based on access, performance and lifecycle requirements.
Optimize Snowflake, Databricks/Spark and SQL workloads for performance, scalability, reliability and cost, including partitioning, parallelism, data movement and compute utilization.
Build data quality, reconciliation, metadata, lineage, observability, alerting and service-level controls into production solutions.
Design for restartability, idempotency, retry, replay, recovery and failure isolation; lead diagnosis and root-cause analysis for complex production incidents.
Apply source control, peer review, automated testing, CI/CD, environment promotion and infrastructure/configuration automation to data engineering delivery.
Create reusable libraries, templates, implementation patterns and reference solutions that improve consistency and engineering velocity.
Evaluate design alternatives and clearly document tradeoffs involving security, privacy, resiliency, maintainability, performance, cost and operational complexity.
Contribute to technical standards, identify technical debt and recommend pragmatic modernization or remediation approaches.
Mentor engineers through design reviews, code reviews, pairing and technical problem solving; influence engineering practices across the team and adjacent teams.
Partner with product owners, architects, governance, cybersecurity, platform and consuming teams to translate business and data requirements into scalable solutions.
Develop technical epics and stories, estimate complex work, surface dependencies and risks, and support iterative delivery through Agile practices.
Provide technical leadership and mentorship without direct people-management responsibility.
Understand and adhere to the Company’s risk and regulatory standards, policies and controls in accordance with the Company’s Risk Appetite.
Design, implement, maintain and enhance internal controls to mitigate risk on an ongoing basis. Identify risk-related issues requiring escalation to management.
Maintain internal control standards, including timely implementation of internal and external audit points and issues raised by external regulators, as applicable.
Promote an environment that supports belonging and reflects the Company brand.
Complete other related duties as assigned.
Education and Experience Required:
Associate’s degree and a minimum of 7…