Ferns N Petals | Senior Software Engineer|Lead Data Engineer | Business|

Job Description

This position is for the Ecommerce division of FNP India, FNP UAE, FNP Singapore (fnp.com, fnp.ae & fnp.sg respectively). The hire in this position will be a part of the core technology team participating in the continuous evolution of FNP resulting in systems on the bleeding edge of technology.

We are looking for a Data Engineering Leader with deep leadership skills and a vision to implement and try the latest cutting-edge technologies to find competitive edge in the market and bring operational efficiency within the organization. The candidate should be a highly creative and technically skilled individual responsible for crunching data to drive business analytics. The ideal candidate should be a master on MySQL, MongoDB, Big Query, Kafka, Metabase, Athena, EMR, Spark, S3 and DMS.

Key Responsibilities
• Migrating on-premises corporate applications and related data to the cloud.
• Build and maintain data pipelines and maintain databases.
• Design, build, test, and maintain data management systems.
• Develop, implement and optimize process in the data migration process.
• Performance data query focused delivery.
• Experience in Data Architecture, Collect Data, Conduct Research, improve skills on his own based on requirements.
• Should be able to analyze existing SQL platform data - stabilize and improve performance.
• Develop Archival scripts, along with access to on demand for archived data.
• Monitoring pipelines performance for potential bottlenecks and resolving performance issues.
• Provide timely scheduled management reporting.
• Report status, ******** any risks identified with the task delivery to Engineering Manager

Desired Skills And Experience
• Should have a working experience of 2+ years of experience in Pentaho.
• Should have an experience of 2-3 yrs on cloud data using technologies like MySQL, MongoDB, Big Query, Kafka, Metabase, Athena, EMR, Spark, S3.
• 2+ years of experience as a SQL developer or similar role.
• Fundamentals of distributed systems like Apache Hadoop, Apache Spark.
• Should be experienced in data structures, data modeling, data lakes, data architecture.
• Excellent understanding of SQL programming.
• Business intelligence and analytics.
• Visualization / big data analytics / dashboards like Metabase, Tableau.
• Knowledge of working with connectors - REST, SOAP, FTP, HTTP, etc.
• Should be experienced with operating systems like UNIX, Linux, etc.
• Master in Migrating, Indexing, Performance, Partitioning, Archiving etc.
• Familiarity with the practical application of NoSQL / NewSQL databases.
• Sense of ownership and pride in your performance and its impact on the company's success.
• Good time-management skills.
• Debugging query performance.
• Ability to innovate, feasibility analysis, PoC execution and R&D. Ability to identify tools for future use.
• Should be able to do effort estimations.
• Strong mathematical, analytical and problem-solving techniques.
• Confidence to liaise with application developers and senior technology managers.
• Ability to work and thrive in a fast-paced environment, learn rapidly and master diverse database technologies.
• Ability to multitask and work under pressure.
• Must have experience in EMR, Spark, Big Query, MySQL, MongoDB, Kafka.
• Experience in Hadoop, AWS Athena, s3, AWS DynamoDB, AWS DMS, Any graph DB, AWS Lambda, Pyscript and AWS Firehose are good to have

Functional/Leadership Competencies
• Excellent Communication Skills both verbal and written.
• Clarity of thought (Sequential/logical presentation explaining a subject matter).
• Adaptability/Flexibility to change (New ideas/ new concepts).
• Creativity (Initiatives for change/new ideas).
• Excellent analytical and quantitative skills; ability to make decisions backed up by data and metrics.
• Attention to detail with proven ability to manage multiple projects, competing for priorities simultaneously.
• Positive, pro-active attitude with a willingness to anticipate and manage change in a highly dynamic environment.

(ref:hirist.tech