Hadoop|BDA Administrator

Hi Folks,

We are looking for Infrastructure – Hadoop/BDA Administrator for Gurgaon location

Experience Required: 6+ Years

Job Description:

Key accountabilities
• Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.
• Implementing ETL process
• Monitoring performance and advising any necessary infrastructure changes
• Defining data retention policies
• Configuration and tuning of PROD clusters:
• Implement end to end encrypted cluster.
• Configuring and Upgrading Oracle Big Data Appliances (BDA) Hadoop Clusters.
• Building and managing further Dev clusters on HP Servers.
• Design of edge architecture, including job execution nodes
• Automate operation, installation, and monitoring of Hadoop ecosystem components in both our open source and engineered system infrastructure stack.
• Evaluate Hadoop infrastructure requirements and design/deploy solutions (high availability, big data clusters, elastic load tolerance, etc.)
• Create productive models for integrating internal application teams and vendors with our infrastructure.
• Experience is creating multiple Cloudera Clusters both for production and development.
• Do performance analysis and capacity planning for clusters.
• Troubleshoot and debug Hadoop ecosystem run-time issues.
• Provide developer and operations documentation.
• Cluster Monitoring and Troubleshooting
• Hadoop Cluster capacity planning
• Design, implement and maintain security.
• Manage and review data backups and restores.
• Integration of back-end strong Kerberos authentication with existing Active Directory.
• Implementation of Role-based access control through Sentry.
• Execute system and disaster recovery processes as required.
• Creating multiple client’s environments and administer security.
• End to end DR cluster implementation.

DESIRABLE
• Ability to deploy Hadoop cluster, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name-node high availability, schedule and configure it and take backups.
• Well versed in installing & managing distributions of Hadoop (Cloudera)
• Experience using and troubleshooting Open-Source technologies.
• A record of working effectively with application and infrastructure teams
• Review existing DB infrastructure and determine areas of improvement.
• Implement software lifecycle methodology to ensure supported release and roadmap adherence