Data Consultant | Spark Developer with AWS
- Category: Database Administrator
- Location: Gurugram, Haryana
- Job Type: Full Time / Part Time
- Salary: Estimated: $ 16K to 30K
- Published on: 2025/09/20
· Position Title : Data Consultant - Spark Developer with AWS
· Mandatory Skills: Experience working on Big Data Consultant with PySpark/Scala or Java, AWS Glue, EMR and Lambda, Cloudera Data Platform (CDP) Rest as per below JD.
· Exp – 7 to 12 years
· Qualification : B Tech/BE
· Job Location – Gurgaon (Remote during pandemic)
· Interview procedure:–Video (MS Teams) interviews in weekdays. (Google & MS team )
· Shift Timing : NA
JOB DESCRIPTION
A passionate Big Data Consultant with PySpark/Scala or Java
Desired Candidate Profile
- Strong Programming skill in Spark, Scala or Java
- must have implemented solutions on AWS Glue, EMR and Lambda
- worked with s3 based data lakes, crawlers and Athena for data exploration
- integration with various source systems for data ingestion pipelines
- Experience with Impala, Kafka or other streaming solutions is good to have
- JIRA, GitLab, Jenkins is a must
- IntelliJ IDEA, Eclipse
- Strong knowledge in Cloudera Data Platform (CDP)
Roles and Responsibilities
- Hands on Spark/Scala programming experience
- Participating in agile development projects for batch and real time data ingestion.
- Integration with AWS, Real-Time Systems, Data Warehouses, and Analytics solutions.
- Working with business and peers to define, estimate, and deliver functionality.
- Produce unit tests for Spark transformations and helper methods
- Design data processing pipelines
- Good in writing Scaladoc-style documentation with all code
Related jobs
-
Head of Information Technology Department
Development & implementation of the IT Strategy of the organization -Operational support and optimization of SAP ECC-6 -all modules vz MM, FI, SD, PP, QA -Building an Information Secured organization through Implementation of Information Security...
-
Supply Chain Intern
We’re currently looking for a Supply Chain Management Intern to join our team. The position will be at the following location Smyrna, TN, and will be a full-time role. Think you’ve got the internal drive to support the production of great vehicles an...
-
SEO Manager
We are looking for an experienced and knowledgeable SEO (Search Engine Optimization) Manager to join our Marketing team! As an SEO Manager, you will be responsible for planning, implementing, and managing our SEO strategy. As our online presence is e...