Senior software engineer

Profile insights
Here’s how the job qualifications align with your profile.
Skills

Spark
(required)

Python
(required)

ETL
(required)
+ show more

Do you have experience in Spark?
 
Job details
Here’s how the job details align with your profile.
Pay

Up to ₹16,00,000 a year
Job type

Full-time
Shift and schedule

Day shift
 
Location
Chennai, Tamil Nadu
 
Benefits
Pulled from the full job description
Flexible schedule
Health insurance
Paid time off
Work from home
 
Full job description
We are seeking a skilled Data Engineer to design, build, and maintain robust data pipelines and infrastructure. You will play a pivotal role in optimizing data flow, ensuring scalability, and enabling seamless access to structured/unstructured data across the organization. This role requires technical expertise in Python, SQL, ETL/ELT frameworks, and cloud data warehouses, along with strong collaboration skills to partner with cross-functional teams.

Company: BigThinkCode Technologies
URL: https://www.bigthinkcode.com/
Experience: 4- 6 Years
Location: Chennai (Work from Office/ Hybrid )

Key Responsibilities:

Design, develop, and maintain scalable ETL/ELT pipelines to process structured and unstructured data.
Optimize and manage SQL queries for performance and efficiency in large-scale datasets.
Experience working with data warehouse solutions (e.g., Redshift, BigQuery, Snowflake) for analytics and reporting.
Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions.
Experience in Implementing solutions for streaming data (e.g., Apache Kafka, AWS Kinesis) is preferred but not mandatory.
Ensure data quality, governance, and security across pipelines and storage systems.
Document architectures, processes, and workflows for clarity and reproducibility.
Required Technical Skills:

Proficiency in Python for scripting, automation, and pipeline development.
Expertise in SQL (complex queries, optimization, and database design).
Hands-on experience with ETL/ELT tools (e.g., Apache Airflow, dbt, AWS Glue).
Experience working with structured data (RDBMS) and unstructured data (JSON, Parquet, Avro).
Familiarity with cloud-based data warehouses (Redshift, BigQuery, Snowflake).
Knowledge of version control systems (e.g., Git) and CI/CD practice
Preferred Qualifications:

Experience with streaming data technologies (e.g., Kafka, Kinesis, Spark Streaming).
Exposure to cloud platforms (AWS, GCP, Azure) and their data services.
Understanding of data modeling (dimensional, star schema) and optimization techniques.
Soft Skills:

Team player with a collaborative mindset and ability to mentor junior engineers.
Strong stakeholder management skills to align technical solutions with business goals.
Excellent communication skills to explain technical concepts to non-technical audiences.
Proactive problem-solving and adaptability in fast-paced environments.
Thank you

Job Type: Full-time

Pay: Up to ₹1,600,000.00 per year

Benefits:

Flexible schedule
Health insurance
Paid time off
Work from home
Schedule:

Day shift
Supplemental Pay:

Performance bonus
Application Question(s):

How many Years of experience you have in total?
How many Relevant years of Experience do you have?
Notice Period