Professional Overview
Have working experience 5+ years with Azure data factory to load data from on-premise, Azure Cloud to Azure SQL database, and coordinated with the reporting team to generate Power BI Reports on Azure SQL DB. Expertise in Azure Data Factory for building scalable ETL/ELT pipelines, orchestrating data workflows, and integrating diverse data sources. Highly involved in Transformations using Dataflows like Source, Select, Derived columns, Lookup, Conditional Split, Join, Sort, Aggregate. Hands-on experience with Azure SQL, SQL Server, and T-SQL for database development, optimization, and performance tuning. Proficient in Azure Databricks for big data processing, advanced analytics, and PySpark transformations to handle large-scale datasets efficiently. Strong knowledge of Azure Synapse Analytics for data warehousing, enabling seamless analytics and reporting across structured and unstructured data. Created connection mount points to Data Lake storage, Blob Storage, Azure Synapse, and Azure SQL DB. Experience in migrating on-premises ETL to Azure Cloud. Worked with different Data flow source connectors like SQL Server, Flat, CSV, and Parquet files. Used Logic Apps to send Email notifications to the Dev team and Users when the pipeline fails. Understanding of medallion architecture for data lakehouse design, ensuring data quality and reliability in big data environments. Proven ability to work with big data technologies, optimizing storage, processing, and analytics for high-volume datasets.