Databricks Data Architect Position

Expert Databricks Consultant Role

At think bridge, we're on a mission to empower growth-stage companies to transform into tech disruptors. Our clients rely on us to provide world-class technology strategy, development, maintenance, and data science solutions. As a highly skilled Databricks Consultant, you'll be working remotely with one of our esteemed clients in New York City.

About the Job
As a key member of our team, you will design and implement scalable data pipelines using Databricks to process and transform large-scale datasets. You'll collaborate closely with the client's technical teams to gather requirements and create customized data solutions that meet their specific needs. Additionally, you'll optimize Databricks clusters for performance, reliability, and cost efficiency, ensuring that our clients receive the best possible results from their investments.

Key Responsibilities
• Design and implement efficient data pipelines using Databricks
• Collaborate with cross-functional teams to gather requirements and create customized data solutions
• Optimize Databricks clusters for performance, reliability, and cost efficiency
• Implement ETL processes to ensure data quality, security, and accuracy
• Provide guidance on best practices for leveraging Databricks for analytics and data engineering
• Troubleshoot and resolve issues in data workflows and platform configurations

Requirements
To be successful in this role, you'll need:
• A bachelor's degree in computer science, data engineering, or a related field
• At least 3+ years of experience in data engineering and pipeline development
• Expertise in Databricks, Spark, and PySpark
• Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud
• Proficiency in programming languages such as Python or Scala
• Strong knowledge of ETL processes, data integration, and data warehousing concepts
• Exceptional problem-solving and analytical skills
• Strong communication skills to effectively collaborate with cross-functional teams

Benefits
As a member of our team, you can expect:
• A competitive compensation package
• Opportunities for professional growth and development
• A collaborative and supportive work environment
• Flexible working hours, allowing you to balance your work and personal life