Junior Data Engineer

Job description
Job Overview:
">
• We are seeking a motivated and detail-oriented individual to join our team as a Junior Data Engineer. This pivotal role is responsible for supporting data operations, executing and auditing tasks within Databricks, and assisting with the migration of SAS code to Python/PySpark.
">

About the Role:
">
• This Junior Data Engineer position plays a crucial part in ensuring seamless operation and timely execution of Databricks jobs.
• The selected candidate will be responsible for conducting thorough audits of job outputs to maintain data integrity and accuracy.
• Collaboration with senior engineers to convert SAS code to Python/PySpark is also a key responsibility, focusing on robustness and efficiency of the new codebase.
• Strong debugging and scripting skills are required to work closely with team members to identify and resolve issues.
• Fostering a collaborative environment by following detailed instructions and project guidelines provided by senior engineers is essential to achieve project goals.
• Continuous learning and adaptation to new technologies and methodologies are expected from the selected candidate.
">

Requirements and Qualifications:
">
• A Bachelor's degree in IT, Computer Science, or a related field.
• 1-3 years of experience in a data engineering or related role.
• Mandatory proficiency in Python and/or PySpark.
• Essential familiarity with Databricks.
• Strong debugging and scripting fundamentals.
• Experience with SAS is beneficial but not required.
• BASIC understanding of GitHub and version control practices.
• Knowledge of SQL/Teradata is desirable.
">

Tools and Technologies:
">
• Essential: Python, PySpark, Databricks.
• Desirable: SAS, GitHub, SQL/Teradata, Airflow (optional).
">

Critical Soft Skills:
">
• Demonstrated willingness to learn and adapt to new challenges.
• Keen attention to detail to ensure high-quality data outputs.
• Strong ability to follow instructions and work collaboratively within a team.
• Effective communication skills to facilitate collaboration and knowledge sharing.