Sr|Data Engineer | PySpark | AWS |1306

Job Title – Sr. Data Engineer- PySpark + AWS

As a Python/ PySpark Developer, you will support the business as a technology partner and collaborate with teams across the organization to develop and deliver complex software requirements. You should be able to coach team members in delivery/release events, and have previous experience working in a Cloud environment.

Job Duties and Responsibilities

As a Python Sr. Software Engineer, you will exercise your design and implementation skills while contributing to the day-to-day work by:
• Expanding client system and implementing new features
• Collaborating with other team members in a Feature Team perspective
• Being a technology partner for our business users
• Supporting the business in the execution of their functions
• Fostering constant improvement and modernization of platforms and projects
• Developing and delivering complex software requirements to accomplish business goals
• Coding solutions, unit tests, and ensuring solutions can be integrated successfully into the overall application/system with clear, robust and well-tested interfaces
• Participating and guiding your team in estimating the work necessary to realize a story/requirement through the delivery lifecycle
• Contributing to existing test suites (integration, regression, performance); analyze test reports, identify any test issues/errors, triage the underlying cause
• Documenting and communicating the required information for deployment, maintenance, support, and business functionality
• Participating, contributing, and coaching team members in the delivery/release (CI-CD) events, e.g., branching timelines, pull requests, issue triage, merge/conflict resolution, and release notes.

Work Location
• The position will be based out of Indiaat Client Location (Viman Nagar, Pune, Maharashtra). You need to be travel and working at client office on daily basis.
• Working hours inline with Client working hours.
• Holidays will be inline with Client holidaycalendar

Requirements

Professional experience of at least 4-6 years in
• As Sr. software engineer/developer focused on engineering solutions using PySpark and Python for financial reporting using AWS
• Experienced in working in a Cloud environment (preferably AWS)
• Able to create cohesive technology solutions using AWS Glue, ApacheAirflow ,Quick Sight, Crawlers, Athena ,Autoscaling, Data Catalog, Spark and PySpark.
• Strong working knowledge ofSpark SQL, Data Modeling, Identity & Access Management, Query optimization, Parallel processing.
• Good exposer on Design Patterns, Enterprise Library, UML, Agile & Waterfall Methodologies and DevOpsetc.

It would be great if you also had:

Previous banking industry experience

Required Qualifications

Education
• Good to have a AWS certification in Data Analytics
• Bachelor's degree

experience

6