Pyspark Developer
- Category: Software Developer Jobs
- Location: Haridwar, Uttarakhand
- Job Type: Full Time / Part Time
- Salary: Estimated: $ 21K to 35K
- Published on: 2025/09/21
JD:
Strong hands on experience on PySpark
• Good experience in AWS services, Oozie, Airflow
• Good Understanding experience in Hadoop, Hive, Oozie, HDFS, YARN, Sqoop
• Should have experience/understanding of AWS design and architectural concepts
• Clear in communication, ability to understand and articulates solution clearlyBuilding ETL/ELT jobs for batch data with HiveQL and Spark (Scala/Java/Pyspark), Scheduling Jobs using oozie, Data loads/extraction using Sqoop.
• Building Real-Time ingestion using Kafka and Spark Streaming, Data flow pipelines using Ni-Fi
• Building data pipelines within Big Data Eco-Systems with large structured/unstructured data from multiple sources.
Implementing large scale data platforms, Ingestion Automation Frameworks, Data Ops with Industry standards, reusable data products and business ready data by utilizing modern and open source technologies, Building automating end to end data lifecycle through CI/CD processes/tools, using Docker & Github.
Related jobs
-
PHP Developer
Key Responsibilities:- Write clean, well documented, robust and reusable code. Unit Testing and Debugging. Actively involve in client interaction and requirement gathering. Adhere to and recommend improvements to coding standards. Keep abreast of the...
-
Wordpress Developer
A WordPress Developer at Rubico will be responsible for developing and maintaining web applications and dynamic websites using WordPress. A WordPress Developer will require a strong understanding of industry trends and content management systems. Abl...
-
Web Developers
Internship Category Software Development Work Type Full-time Number of Openings 4 Salary 7000 Start Date (Approx.) Mar 08, 2024 End Date (Approx.) Aug 08, 2024 Skills HTML 5, CSS, JavaScript, PHP, AJAX, JSON Description About the work from home job/i...