Senior Developer - Databricks

Company Description

Newscape Consulting is a digital services provider in the healthcare industry, helping clients integrate legacy platforms with the latest technologies to adapt to the rapidly changing healthcare ecosystem. With a focus on improving productivity and enhancing user experience, Newscape Consulting offers a broad spectrum of business process experience in healthcare digital transformation areas.

Role Description

We are looking for a highly skilled Senior Databricks Developer to join our data engineering team. You will be responsible for building scalable and efficient data pipelines using Databricks, Apache Spark, Delta Lake, and cloud-native services (Azure/AWS/GCP). You will work closely with data architects, data scientists, and business stakeholders to deliver high-performance, production-grade solutions.

Required Skills and Qualifications:

•Strong hands-on experience with Databricks (Workspace, Jobs, DLT, Repos, Unity Catalog).

•Proficient in PySpark, Spark SQL, and optionally Scala.
• Solid understanding of Delta Lake, Lakehouse architecture, and medallion architecture.

•Proficient in at least one cloud platform: Azure, AWS, or GCP.

•Experience in CI/CD for Databricks (e.g., using Azure DevOps, GitHub Actions).

•Strong SQL skills and experience with data warehousing concepts.

•Knowledge of data governance, lineage, and catalog tools like Unity Catalog or Purview.

•Familiarity with orchestration tools like Airflow, Azure Data Factory, or Databricks Workflows.

•Excellent communication, problem-solving, and stakeholder management skills.

Location

Pune, India - Full time - Work from office