Robert Half 100% remote - Senior Azure Data Engineer in Ogden, Utah
Analyze, design and build Modern data solutions using Azure PaaS service to support visualization of data. Understand current Production state of application and determine the impact of new implementation on existing business processes.
Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL and U-SQL Azure Data Lake Analytics. Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in In Azure Databricks.
Implemented Proof of concepts for SOAP & REST APIs
REST APIs to retrieve analytics data from different data feeds
Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards.
Developed Spark applications using Pyspark and Spark-SQL for data extraction, transformation and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.
Responsible for estimating the cluster size, monitoring and troubleshooting of the Spark data bricks cluster.
Experienced in performance tuning of Spark Applications for setting right Batch Interval time, correct level of Parallelism and memory tuning.
Developed JSON Scripts for deploying the Pipeline in Azure Data Factory (ADF) that process the data using the Sql Activity.
Hands-on experience on developing SQL Scripts for automation purpose.
Azure Data lake, Data factory
Azure Databricks, Azure SQL database, Azure SQL Datawarehouse
SQL Server 2017, SQL Server 2016, SQL Server 2014
Programming Scala, Python, Spark SQL
MSBI (SSIS, SSAS, SSRS)
SQL Server programming
Confidential Power BI
Created Build and Release for multiple projects (modules) in production environment using Visual Studio Team Services (VSTS).
Requirements Microsoft Azure, Azure SQL Database, ETL - Extract Transform Load, Cube Design, Cube Development, Snowflake
Technology Doesn't Change the World, People Do.®
Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Robert Half puts you in the best position to succeed by advocating on your behalf and promoting you to employers. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity – even on the go. Download the Robert Half app and get 1-tap apply, instant notifications for AI-matched jobs, and more.
Questions? Call your local office at 1.888.490.4429. All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals. Visit https://roberthalf.gobenefits.net/ for more information.