Lead I - Data Engineering
- Category: IT Engineer & Developer Jobs
- Location: Thiruvananthapuram, Kerala
- Job Type: Full Time / Part Time
- Salary: Estimated: $ 23K to 29K
- Published on: 2025/09/16
Role Description
Experience Range:
5-10 years in a similar role
Hiring Locations:
Noida, Pune, Hyderabad, Bangalore, Kochi, Trivandrum, Chennai
Must-Have Skills
• Hands-on experience with PySpark and GCP (or any other cloud platform)
• Strong proficiency in SQL
• Expertise in designing, implementing, and optimizing data pipelines using Spark, Hadoop, Hive
• Proven experience in monitoring and troubleshooting data pipelines to ensure minimal downtime and optimal performance
• Strong problem-solving skills and ability to work in a collaborative team environment
• Excellent communication skills (written and verbal)
Good-to-Have Skills
• Experience working closely with product managers and data stewards to understand data requirements
• Familiarity with data governance and data quality best practices
• Knowledge of big data architecture and distributed computing
Key Responsibilities
• Design, implement, and optimize scalable data pipelines using Spark, Hadoop, Hive, and other relevant technologies
• Collaborate with product managers and data stewards to translate data requirements into efficient data workflows
• Monitor and troubleshoot data pipelines, ensuring reliability and performance
• Work in a fast-paced, agile environment, solving complex data challenges
• Stay updated with the latest data engineering trends and technologies
Skills
Spark,Hadoop,Hive,Gcp
Related jobs
-
Senior .Net full stack Developer
Work location: Trivandrum (Work from office) Working hours: 01 PM to 10 PM (IST) Experience: 5-12 years Responsibilitie • sDevelop and maintain back-end components using ASP.NET, MVC, Web API, and .NET CORE • .Design and implement front-end component...
-
Automation Tester- (Mobile & Web)
Automation Tester – Mob & Web (6+ Yrs. Exp) Required Skills & Qualifications: · 6+ years of experience in test automation for web and mobile applications. · Strong expertise in Selenium with Java for web automation. · Experience in Appium for...
-
Machine Learning Internship
Job description Roles & Responsibility • Responsible for developing software for processing inspection data (video, sensor data) • Responsible for the processing of inspection data Skills: • Basic knowledge of Python / C++ • Building software for...