Manager - Data Engineering (TPA)

Manager – Data Engineering (TPA)

Join our dynamic team as a **Manager – Data Engineering (TPA)**, where you will play a pivotal role in shaping our organization’s data infrastructure. In this strategic position, you will architect and oversee scalable, high-performance data pipelines that ensure our enterprise operates with reliable, secure, and analytics-ready data. Your expertise will empower stakeholders across the business to make informed, data-driven decisions while maintaining cost efficiency and operational excellence.

Key Responsibilities

As the **Manager – Data Engineering (TPA)**, your responsibilities will span the entire data lifecycle, from ingestion to governance, ensuring seamless integration with our enterprise reporting, business intelligence (BI), and analytical initiatives. Your strategic vision will drive the following critical areas:

• Enterprise Data Ingestion & Advanced Data Engineering: Design and implement reusable, parameterized data mappings and workflows using Informatica IDMC to standardize data ingestion processes. Leverage cutting-edge techniques such as Change Data Capture (CDC), idempotent loads, and schema evolution to ensure data integrity. Optimize BigQuery performance through partitioning, clustering, and strategic load-streaming approaches. Establish robust version control and CI/CD pipelines to streamline data engineering asset management.
• Data Mapping & Transformation Design: Conduct in-depth profiling of source systems to define precise field-level mappings and transformation rules. Develop sophisticated business logic, including advanced joins, lookups, and derivations, while enforcing rigorous data quality rules, exception handling, and reject criteria to maintain data accuracy.
• Orchestration, Automation & Reliability Engineering: Parameterize task flows and configure schedules and dependencies to ensure seamless automation. Implement resilient retry mechanisms, backoff strategies, and checkpointing to guarantee reliable data processing. Integrate comprehensive monitoring and alerting systems through Ops consoles and ChatOps for proactive issue resolution.
• Data Roles, Privacy & Security Management: Define and enforce least-privilege IAM roles and service accounts to secure data access. Apply granular security measures, including dataset, table, row, and column-level permissions, alongside data masking techniques. Implement robust audit logging and retention policies while classifying and safeguarding PHI/PII data in compliance with regulatory standards.
• Modern Data Architecture & Data Modelling: Adopt and implement the Medallion Architecture across Bronze, Silver, and Gold layers to create a scalable, curated data ecosystem. Develop high-performance analytical data models tailored for reporting and BI needs. Establish and enforce data quality, lineage, and governance standards to ensure curated datasets are trusted and actionable. Collaborate closely with business and analytics teams to deliver impactful, self-service-ready datasets.
• Workload Monitoring, Performance & Cost Optimization: Track critical metrics such as data freshness, job health, volumes, and anomalies to maintain operational efficiency. Monitor SLAs for job duration, error rates, cost per TB, and slot usage. Optimize BigQuery performance through query tuning and resource management while minimizing costs via storage lifecycle management, query optimization, and caching strategies.

Key Skills & Expertise

To excel in this role, you will bring a robust technical skill set and industry-leading experience in:

• Data Engineering Tools: Proficiency in Informatica IDMC, Airflow, and Apache Spark for building and managing enterprise-grade data pipelines.
• Programming Languages: Advanced knowledge of SQL and Python for data transformation, automation, and analytics.
• Cloud Technologies: Deep expertise in Google Cloud Platform (GCP), particularly BigQuery and IAM, with optional experience in Azure/AWS environments.
• Visualization & BI Platforms: Familiarity with Power BI, Looker, Looker Studio, and Tableau to support data-driven decision-making.
• BigQuery Mastery: Hands-on experience with BigQuery SQL, modeling, and performance tuning to optimize analytical workloads.
• Informatica Proficiency: Extensive experience with Informatica IDMC/IICS ETL/ELT solutions for end-to-end data pipeline development.
• Medallion Architecture: Proven ability to design and implement Bronze-Silver-Gold data architectures for scalable analytics.
• Reporting & BI Datasets: Experience building reporting-ready data marts and BI datasets to support self-service analytics.
• Healthcare Data Expertise: Knowledge of healthcare-specific data domains, including claims, providers, and member data, is highly valued.
• Cloud Security: Strong understanding of IAM principles, service accounts, and private endpoints to ensure secure cloud operations.

This is an opportunity to lead a team of data engineers in delivering a world-class data infrastructure that drives innovation and operational excellence. If you are passionate about transforming raw data into strategic insights and are eager to make a significant impact, we invite you to apply.