Lead Big Data Developer
- Category: Software Developer Jobs
- Location: Pune, Maharashtra
- Job Type: Full Time / Part Time
- Salary: Estimated: $ 21K to 28K
- Published on: 2025/09/11
Job Description
To be successful in this role, you should possess a unique blend of technical expertise and leadership skills.
Key Responsibilities
• Collaborate closely with cross-functional teams to devise and build scalable solutions.
• Design and implement systems to cleanse, process, and analyze large data sets using distributed processing tools like Akka and Spark.
• Participate in design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.
• Understand and critically review existing data pipelines, and come up with ideas to improve upon current bottlenecks.
• Take initiatives to pick up new technologies and work as a Senior Individual contributor on multiple products and features.
Requirements
• 8+ years of experience in developing highly scalable Big Data pipelines.
• Hands-on experience in team leading and leading product or module development.
• In-depth understanding of the Big Data ecosystem including processing frameworks like Spark, Akka, Storm, and Hadoop.
• Experience with ETL and Data pipeline tools like Apache NiFi, Airflow etc.
• Excellent coding skills in Java or Scala, including the understanding to apply appropriate Design Patterns when required.
• Experience with Git and build tools like Gradle/Maven/SBT.
• Strong understanding of object-oriented design, data structures, algorithms, profiling, and optimization.
Related jobs
-
AI Developer Technology Engineer
Job description NVIDIA is looking for a passionate, world-class computer scientist to work in its Compute Developer Technology (Devtech) team as an AI Developer Technology Engineer. Artificial intelligence, the dream of computer scientists for over h...
-
Software Developer - Java
Job description Job Summary:We are looking for a highly skilled and motivated Software Developer to join our dynamic team. The ideal candidate will have strong expertise in Java, Web Services, and NoSQL databases such as ElasticSearch or MongoDB. In ...
-
PHP Developer Intern
Job description Company Description IRP Innovative Solutions (OPC) Private Limited is a custom software development company based in Pune. They offer services in web development, mobile app development, ERP solutions, and digital marketing, focusing ...