Hadoop Engineer
- Category: IT Engineer & Developer Jobs
- Location: Sydney, New South Wales
- Job Type: Full Time / Part Time
- Salary: Estimated: $ 16K to 29K
- Published on: 2025/07/26
Job description
**Job Summary**
We are seeking a Hadoop Engineer to join our team in Sydney. This role will be part of a major project for a Global Consulting firm.
Key Responsibilities:
Implementation experience in Big Data Platform, preferably in Cloudera Hadoop platform.
Minimum 2 years of development experience using Hadoop ecosystem tools & utilities: MapReduce, PySpark, Kafka, Sqoop, Impala, Hive, etc.
Minimum 2 years of development experience in traditional Enterprise Data Warehouse (EDW), ETL design & development using Informatica or Talend.
Ability to work independently and contribute to overall architecture and design.
Experience in writing Shell scripts in Linux Platform.
Knowledge of API management concepts and design.
Experience in CI/CD deployment automation in Big Data Platform.
Experience with Metadata management tools like Informatica Metadata Manager or Collibra.
Requirements:
Strong understanding of Hadoop ecosystem tools & utilities.
Experience in traditional Enterprise Data Warehouse (EDW) and ETL design & development.
Ability to work collaboratively and independently.
Excellent problem-solving skills and attention to detail.
Strong communication and interpersonal skills.
About Us:
We are a leading Recruitment Company based in Australia, specializing in Digital, ERP, and larger IT Services. We offer flexible, efficient, and collaborative solutions to any organization that requires IT experts.
Related jobs
-
Software Development Engineer In Cloud Services
Job description At eero, an Amazon Company, we're revolutionizing the way people connect to the internet. Our mission is to deliver a seamless and reliable WiFi experience that's unparalleled in the industry. About the Role We're scaling our ISP team...
-
IT Application Engineer
Job description Conexxia Pty Ltd, a prominent Australian IT consulting company, is seeking a skilled IT Application Engineer to strengthen their team in Sydney, Melbourne, Brisbane, or Perth. The ideal candidate will hold a bachelor's degree in Compu...
-
Graduate Site Reliability Engineer, Video Arch
Job description Graduate Site Reliability Engineer, Video Arch This is an exciting opportunity to join one of the world's leading video platforms, TikTok, as a Graduate Site Reliability Engineer, Video Arch. About the Role As a Graduate Site Reliabil...