Senior Data, ML Engineers (PySpark, Databricks, Healthcare Claims)

Overview

We are seeking a highly skilled Senior Data Engineer with strong expertise in PySpark, SQL, and Databricks to support the design, development, and optimization of large‑scale data pipelines. The ideal candidate will have hands‑on experience with medallion architecture, data quality frameworks, and Spark performance tuning. Healthcare domain knowledge is essential for success in this role.

Key Responsibilities

• Design, build, and maintain scalable data pipelines using PySpark based ETL, SQL, and Databricks.

• Implement and enhance medallion architecture (Bronze/Silver/Gold) for structured, governed data delivery.

• Develop and enforce data quality frameworks, validation rules, and monitoring processes.

• Optimize Spark jobs for performance, reliability, and cost efficiency.

• Collaborate with cross‑functional teams including data architects, analysts, and business stakeholders.

• Translate healthcare business requirements into robust technical solutions.

• Ensure compliance with healthcare data standards, privacy regulations, and governance practices.

• Claims ingestion and orchestration

• Data validation and transformation

• Supporting batch and event-driven workflows

• Feature engineering

Required Technical Skills

• Strong hands‑on experience with PySpark based ETL, SQL, and Databricks

• Deep understanding of medallion architecture and modern data lakehouse patterns.

• Experience implementing data quality frameworks and automated validation.

• Proficiency in Spark optimization techniques (partitioning, caching, AQE, cluster tuning).

• Familiarity with CI/CD, version control, and DevOps practices for data engineering.

Healthcare Domain Expertise

• Experience working with healthcare claims platforms such as Facets, QNXT, or Health Rules.

• Understanding of CPT, ICD‑10, HCPCS, and related healthcare coding standards.

• Knowledge of claims lifecycle, adjudication processes, and provider/member data structures.

• Ability to interpret healthcare data models and ensure accurate mapping, transformation, and enrichment.

Preferred Qualifications

• Experience in cloud environments (Azure preferred).

• Exposure to data governance, MDM, and metadata management.

• Strong analytical, communication, and problem‑solving skills.

• Ability to work independently and drive technical decisions.

Work model

We strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a remote position open to qualified applicants in the United States. Regardless of your working arrangement, we are here to support a healthy work‑life balance through our various wellbeing programs.

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you’re engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.

Salary and Other Compensation

Applications will be accepted until March 30th 2026.

The annual salary for this position is between $ 100,000 K -$ 156,500 K depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Benefits

• Medical/Dental/Vision/Life Insurance

• Paid holidays plus Paid Time Off

• 401(k) plan and contributions

• Long‑term/Short‑term Disability

• Paid Parental Leave

• Employee Stock Purchase Plan

Disclaimer

The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Cognizant is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.