Data Engineer|Big Data Technology Teaching Assistant

Data Engineer / Big Data Technology Teaching Assistant

Job Title : Teaching Assistant - Data Engineering / Big Data Technologies

Job Description : We are seeking a Teaching Assistant with a solid foundation in Data Engineering to assist our team members with tasks such as conducting interviews for incoming candidates, addressing technical queries, and collaborating closely with Training Managers to facilitate the development and education of candidates in training.

The ideal candidate should be highly skilled in Big Data technologies, proficient in data processing frameworks, and possess excellent communication skills.

They should be professional, well-presented, and adept in both individual and collaborative settings.

Must Have :

3-5 years of experience with Big Data tools and data warehousing technologies such as Apache Hadoop, Spark, Hive and Snowflake / BigQuery.

Proficient understanding of lakehouse architecture and technologies such as Databricks or Delta Lake.

Strong experience of ETL processes and experience with ETL tools like AWS Glue or SSIS.

Proficient in programming languages used in Big Data, including Python, SQL, Scala, or Java.

In-depth knowledge of data storage solutions such as HDFS, Amazon S3, or SQL and NoSQL databases (e.g., Postgresql, MongoDB).

Familiarity with data processing and analytics frameworks like Apache Spark or Flink and data pipeline construction and maintenance using tools like Apache Airflow or dbt.

Experience with building and maintaining data pipelines in a distributed data architecture.

Understanding of data modeling and data architecture optimized for big data platforms.

Experience with stream-processing systems using Kafka or similar technologies.

Knowledge of CI / CD pipelines and version control systems like Git.

Familiarity with AGILE / SCRUM workflows and the software development lifecycle like Jira.

Excellent English communication skills and strong interpersonal abilities.

Professional demeanor and well-presented in all communications and interactions.

Nice to Have :

Experience with cloud platforms like AWS, Azure, or Google Cloud Platform.

Familiarity with orchestration tools such as Apache Airflow or Luigi.

Understanding of containerization (e.g., Docker) and orchestration tools (e.g., Kubernetes).

Knowledge of advanced analytics and machine learning frameworks.

Experience with data visualization tools and technologies.

Additional certifications in Big Data technologies or cloud services.

Technical Interview Process : Candidates must exhibit robust technical expertise in data engineering and exceptional communication skills to effectively support the Training Team in the United States.