Expertise:
· Good Knowledge of Data Brick lakehouse and Azure DataLake concept
· Knowledge of Data Bricks delta concept– Delta live tables (DLT)
· Strong hands-on experience in ELT– pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
· Strong knowledge of metadata-driven data pipeline, metadata management, dynamic logic
· In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool.
· Experience with data transformation using Spark, and SQL technologies. · Solid understanding of design patterns, and best practices of the cloud stack.
· Experience with code management and version control using Git or similar tools.
· Strong problem-solving and debugging skills in ETL workflows and data pipelines.
· Strong understanding of Azure Data bricks and Azure Synapse internals – features and capabilities.
· Knowledge of Azure DevOps and continuous integration and deployment (CI/CD) process.
· Knowledge of data quality and data profiling techniques, with experience in data validation and data cleansing.
More Information
Application Details
-
Organization Details
TCS / Tata Consultancy Services
Recommended Comments
There are no comments to display.
Join the conversation
You are posting as a guest. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.