Developer II | Software Engineering | Azure Data Bricks

Role Description

Role Proficiency:
• Azure Data Engineer As a member of the data engineering team, you will be the key technical expert developing and overseeing data product build & operations and drive a strong vision for how data engineering can proactively create a positive impact on the business. You'll be an empowered member of a team of data engineers who build data pipelines into various source systems, rest data on the Data Lake, and enable exploration and access for analytics, visualization, machine learning, and product development efforts across the company. As a member of the data engineering team, you will help lead the development of very large and complex data applications into public cloud environments directly impacting the design, architecture, and implementation of flagship data products around topics like supply chain, manufacturing, and logistics. You will work closely with process owners, product owners and business users. You'll be working in a hybrid environment with in-house, on-premise data sources as well as cloud and remote systems. Accountability Experience of minimum 4-6 years as an ETL/Hadoop/Azure Cloud Engineer in various Development Projects. In-depth project development experience in Hadoop, ETL and Azure Cloud technologies (Azure Databricks, Azure Data Factory, Azure Data Lake, Blob Storage, Synapse). Strong SQL knowledge. Hands on python/spark/pyspark. Active contributor to code development in projects and services. Manage and scale data pipelines from internal and external data sources to support new product launches and drive data quality across data products. Understand and adapt existing frameworks for data engineering pipelines in the organization. Responsible for adopting best practices around systems integration, security, performance, and data management defined within the organization.

Skills

Azure,Azure Data Factory,Azure Data Lake