Senior Data Engineer/Lead-Canada

Job description
Role: Senior Data Engineer/Lead

Location: Vancouver, BC (PST time zone)

Duration: 6+ Months

JOB Description:
• We are looking for a hands-on, talented DATA ENGINEER - LEAD to join our rapidly expanding team in NA.

Essential Skills and Experience:
• 8 to 10 years of developing data solutions Refer below Table for tech stack.
• Good understanding of Data Processing Frameworks (like Spark) Orchestration Frameworks (like Airflow).
• Should be able to manage & co-ordinate 6-8 Data Engineers in India Time Zone
• Deliver updates to stakeholders based on analytics
• Excellent problem solving skills
• Expertise in full data stack: ETL/ELT, data analysis, storage, data pipelines, Orchestration
• Hands on experience in relational databases (PL/SQL, Postgres) etc.
• Experience with Version Control (e.g. GIT, GitHub)
• Cloud Experience (AWS)
• Good communication skills and ability to work as part of a Scrum team & well co-ordinate with development team in different Time Zone.

Tools:
• Cloud Technologies: AWS (S3, Glue, RDS),
• Big Data: Hive, Spark, Kafka
• Databases: Oracle, Postgres SQL
• Languages/Tools: SQL, PL/SQL, Python, Windows Shell Scripting, AirFlow
• Source Control Tool: GITHUB, GIT
• ETL Tools: SSIS,
• PM Tools & Delivery Model: JIRA, Confluence, AGILE [SCRUM]

Key Job Responsibilities:
• Work with DE team Mentor & guide data engineers on their deliverables.
• Develop, construct, test and maintain architectures
• Align architecture with business requirement
• Data acquisition
• Develop data set processes
• Use programming language and tools
• Identify ways to improve data reliability, efficiency and quality
• Use large data sets to address business issues
• Deploy sophisticated analytics programs, machine learning and statistical methods
• Prepare data for predictive and prescriptive modeling
• Find hidden patterns using data
• Use data to discover tasks that can be automated