Python Engineer

Responsibilities:-
• Design core architecture
• Setup, management and monitoring of jobs to collect data.
• Design the jobs to scrape data and URLs.
• Create more and better ways to crawl relevant information.
• Integrate the data scraped into our database.
• Building databases, creating and maintaining automated jobs.
• Document code, write test cases, etc.
• Familiarity with techniques and tools for crawling, extracting, and processing data
• Experience with design and testing of RESTful APIs
• Familiarity with relational database technology

Profile Preference :-
• Expertise in programming using Python or similar scripting languages.
• Expert knowledge of Python related frameworks including Flask and Django.
• A deep understanding and multi-process architecture and the threading limitations of Python.
• Sound understanding of writing web scraping jobs.
• Sound understanding of MySQL.
• Knowledge of Microservices concept.
• Ability to collaborate on projects and work independently when required.
• Exposure to AWS/Azure or similar cloud providers.
• Excellent problem solving and communication skills
• Bachelor’s degree in Computer Science or equivalent combination of education and experience required