Databricks Engineer

Job Summary

We are seeking an experienced Databricks Engineer to join our team. As a Databricks Engineer, you will be responsible for designing, developing, and implementing big data solutions using Databricks and Apache Spark.

Key Responsibilities
• Design, develop, and test big data solutions using Databricks and Apache Spark.
• Collaborate with cross-functional teams to gather requirements and design big data solutions.
• Develop and maintain Databricks notebooks, jobs, and workflows.
• Troubleshoot and resolve big data processing issues.
• Optimize Databricks solutions for performance, scalability, and cost-effectiveness.
• Collaborate with other teams to ensure seamless integration of big data solutions.
• Develop and maintain technical documentation.

Requirements
• 6-12 years of experience in big data engineering and development.
• Strong experience with Databricks and Apache Spark.
• Experience with big data technologies such as Hadoop, Hive, and Kafka.
• Strong understanding of data structures, algorithms, and database design principles.
• Experience with cloud-based big data platforms such as AWS or Azure.
• Strong analytical and problem-solving skills.
• Excellent communication and interpersonal skills.

Skills: kafka,databricks,algorithms,data structures,hive,big data,apache spark,azure,apache,spark,aws,database design,hadoop