Azure Data Engineer Job at 3B Staffing LLC, Chicago, IL

  • 3B Staffing LLC
  • Chicago, IL

Job Description

This will require an onsite interview or require the candidate to pick up their laptop in person


Requirements/Top Skills Needed:
ADF
Databricks
Python
SQL
Retail experience would be helpful, but not required


Job Title: Azure Data Engineer
Job Summary: We are seeking a highly skilled Azure Data Engineer to design, build, and optimize our next-generation cloud data platform. You will build scalable data pipelines, manage enterprise data warehouses, and transform massive datasets using Azure Cloud, ADF, Databricks, Spark, and PySpark.

Key Responsibilities
• Pipeline Orchestration: Design and implement scalable ETL/ELT pipelines using Azure Data Factory (ADF).
• Big Data Processing: Build high-performance, distributed data transformation workloads via Azure Databricks and Apache Spark/PySpark.
• Data Warehousing: Architect, model, and maintain cloud-native Data Warehouses and Data Lakes (ADLS Gen2).
• Architecture Implementation: Apply modern architectural patterns like the Medallion Architecture (Bronze, Silver, Gold layers) and Delta Lake formats.
• Performance Tuning: Optimize Spark jobs, cluster configurations, and SQL queries to minimize latency and cloud compute costs.
• Governance & Security: Implement security frameworks, data lineage, and user access policies using Unity Catalog.
• CI/CD Automation: Deploy, monitor, and automate workflows using Azure DevOps and automated alert configurations.

Required Technical Skills:
• Cloud Platform: Microsoft Azure Ecosystem (ADLS Gen2, Azure SQL, Synapse Analytics, Key Vault, Storages, Azure Functions, Logic Apps).
• Data Orchestration: Advanced proficiency in Azure Data Factory (ADF).
• Compute & Analytics: Deep hands-on experience with Azure Databricks.
• Big Data Frameworks: Strong mastery of Apache Spark and PySpark (including Spark SQL).
• Languages: Expert level in Python and SQL.
• Data Warehousing: Solid understanding of Data Modeling (Star/Snowflake schema) and warehousing concepts

Job Tags

Similar Jobs

company372

Student Office Assistant Job at company372

 ...environment. We are looking to hire a Student Office Assistant to start immediately, work through the academic year and continue into the summer and future academic years if the opportunity is mutually beneficial to the student and WiCell. We expect this intern to work... 

Medical Solutions

Travel Speech Language Pathologist (SLP) - $2,891 per week in Homer, AK Job at Medical Solutions

 ...Speech Language Pathologist Location: Homer, AK Agency: Medical Solutions Pay: $2,891 per week Shift Information: Days...  ...And more! Requirements BLS (AHA), Certified Clinical Competence in Speech-Language Pathology (CCC-SLP) Certificate via ASHA... 

TYR Tactical

Junior Product Designer Job at TYR Tactical

 ...Summary of Position: We are looking for a skilled Junior Product Designer to assist our Product design team in various design projects. Duties & Responsibilities: Understand project scope, product requirements, and design objectives. Assist with the development... 

LocumTenens

Diagnostic Radiologist Needed for Locum Tenens Coverage at Inpatient and ER Facility in Panama City, Florida Job at LocumTenens

 ...and snorkeling near jetties and reefs. Clinicians on assignment may also explore Oaks by the Bay Park, the Mural Trail, boat tours to Shell Island, and interactive science exhibits, with local shops and ongoing community programming available throughout the area. About... 

Ascend Medical Staffing

Nuclear Medicine Physician Job at Ascend Medical Staffing

Current opportunity for Nuclear Medicine in Wisconsin. Start: ASAP End: Ongoing Rate: Will submit rate you are comfortable with EMR: Epic Licensed in WI or IMLC Board Certified If interested reach out: Aaron Culpepper Ascend Medical