Databricks with Pyspark, Python

Job DescriptionPrimary Skills : Databricks with Pyspark, PythonSecondary skills; ADF7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.4+ years of work experience with very large data warehousing environment4+ years of work experience in Databricks, Pyspark and Python project development workExpertise in Bigdata Eco systems like HDFS and SparkStrong hands-on experience on Python or Scala.Hands on experience on Azure Data Factory.Able to convert the SQL stored procedures to Python code in Pyspark frame work using Dataframes.Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.SQL SERVER development work experience with relational databases and knowledge is a mustDevelopment of Stored Procedures for transformations in ETL pipelineShould have work experience in Agile projectsWrite and maintain documentation of the ETL processes via process flow diagrams.Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouseGood experience on customer interaction is required.Possesses good interpersonal and communication skills.