Development-Big Data
- Category: IT Engineer & Developer Jobs
- Location: Pune, Maharashtra
- Job Type: Full Time / Part Time
- Salary: Estimated: $ 18K to 26K
- Published on: 2025/09/16
Technical Leadership
• Lead the design, development, and deployment of big data solutions using Java, Apache Spark, and modern orchestration tools.
• Architect and optimize data workflows, ensuring modularity, scalability, and maintainability across multiple domains and business units.
• Guide the adoption and integration of low-code transformation platforms (e.g., DBT) and ensure best practices in SQL-based transformation logic.
• Should be able to debug and fine tune workload , processing billions of records
Solution Delivery & Collaboration
• Oversee the development and management of APIs for data ingestion, transformation, and consumption, ensuring seamless integration with upstream and downstream systems.
• Collaborate with product managers, data scientists, analysts, and platform teams to translate business requirements into technical deliverables.
• Drive the implementation of metadata-first strategies, ensuring comprehensive cataloging, lineage, and data quality across the platform.
Quality, Observability & Governance
• Implement and enforce data engineering standards for quality, integrity, and security.
• Leverage observability suites for active and passive data validations, anomaly detection, and performance monitoring.
• Ensure robust governance by supporting RBAC/ABAC controls and compliance requirements.
Mentorship & Team Development
• Mentor and coach a team of big data engineers, fostering a culture of innovation, continuous improvement, and technical excellence.
• Conduct code reviews, knowledge sharing sessions, and technical upskilling initiatives.
Continuous Improvement
• Stay abreast of emerging trends in big data, cloud-native technologies, MLOps, and GenAI integration.
• Drive proof-of-concept (POC) initiatives and evaluate new tools and frameworks for adoption.
Related jobs
-
Associate Systems Engineer (windows server infrastructure/ App dynamics)
काम का वर्णन Altera, a member of the N. Harris Computer Corporation family, delivers health IT solutions that support caregivers around the world. These include the Sunrise™, Paragon®, Altera TouchWorks®, Altera Opal, STAR™, HealthQuest™ and dbMotion...
-
Sr Software Engineer ( C#, Azure, angular)
काम का वर्णन Altera, a member of the N. Harris Computer Corporation family, delivers health IT solutions that support caregivers around the world. These include the Sunrise™, Paragon®, Altera TouchWorks®, Altera Opal, STAR™, HealthQuest™ and dbMotion...
-
Senior Manager-PV & EV Cost Engineering-Product Lines - PV-TMPV
काम का वर्णन Purpose of the Role TVM Engineer is responsible for analysing perceived value through value laddering, total cost of ownership (TCO) and resale value of TML products by comparing them with competition products and drive improvements in e...