Azure Data Engineer
12 + years exp max 15 yrs
Mandatory Onsite to Indianapolis, IN
Contact to hire 65/hr to 90/hr
Visa: GC USC only
Profiles from Pharma/Life scince / BioTechnology are preferred
Mandatory Primary skills writeup/Summary
Data Engineering (Azure Data Factory, Databricks, PySpark, Python, SQL)
Key Fields
Inputs
Educational Qualification*
Any Bachelor's Degree
Experience Range
10-15 years
Primary (Must have skills)* - Minimum Experince
4+ years of experience in Azure Databricks with PySpark.
2+ years of experience in Databricks workflow & Unity catalog.
3+ years of experience in ADF (Azure Data Factory).
3+ years of experience in ADLS Gen 2.
3+ years of experience in Azure SQL.
5+ years of experience in Azure Cloud platform.
2+ years of experience in Python programming & package builds.
Job Description of Role* (RNR) - To be Evaluated by Technical Panel (Define it to give more clarity)
Key technical skills :
Data management experience handling Analytics workload covering design, development, and maintainenance of lakehouse solutions sourcing data from platforms such as ERP sources, API sources, Relational stores, NoSQL and on-prem sources using Databricks/PySpark as distributed /big data management service,supporting batch and near-real-time ingestion, transformation, and processing.
Ability to optimize Spark jobs and manage large-scale data processing using RDD/DataFrame APIs.Demonstrated expertise in partitioning strategies, file format optimization (Parquet/Delta), and Spark SQL tuning.Familiarity with Databricks runtime versions, cluster policies, libraries, and workspace management.
Skilled in governing and manage data access for Azure Data lakehouse with Unity Catalog . Experience in configuring data permissions, object lineage, and access policies with Unity Catalog.Understanding of integrating Unity Catalog with Azure AD, external metastores, and audit trails.
Experience in building efficient orchestration solutions using Azure data factory, Databricks Workflows. Ability to design modular, reusable workflows using tasks, triggers, and dependencies.Skilled in using dynamic expressions, parameterized pipelines, custom activities, and triggers.
Familiarity with integration runtime configurations, pipeline performance tuning, and error handling strategies.
Strong experience in implementing secure, hierarchical namespace-based data lake storage for structured/semi-structured data, aligned to bronze-silver-gold layers with ADLS Gen2. Hands-on experience with lifecycle policies, access control (RBAC/ACLs), and folder-level security. Understanding of best practices in file partitioning, retention management, and storage performance optimization.
Capable of developing T-SQL queries, stored procedures, and managing metadata layers on Azure SQL.
Comprehensive experience working across the Azure ecosystem, including networking, security, monitoring, and cost management relevant to data engineering workloads.Understanding of VNets, Private Endpoints, Key Vaults, Managed Identities, and Azure Monitor.Exposure to DevOps tools for deployment automation (e.g., Azure DevOps, ARM/Bicep/Terraform).
Experience in writing modular, testable Python code used in data transformations, utility functions, and packaging reusable components.Familiarity with Python environments, dependency management (pip/Poetry/Conda), and packaging libraries.Ability to write unit tests using PyTest/unittest and integrate with CI/CD pipelines.
Lead solution design discussions, mentor junior engineers, and ensure adherence to coding guidelines, design patterns, and peer review processes.Able to prepare Design documents for development and guiding the team technically. Experience preparing technical design documents, HLD/LLDs, and architecture diagrams.Familiarity with code quality tools (e.g., SonarQube, pylint), and version control workflows (Git).
Demonstrates strong verbal and written communication, proactive stakeholder engagement, and a collaborative attitude in cross-functional teams.Ability to articulate technical concepts clearly to both technical and business audiences.Experience in working with product owners, QA, and business analysts to translate requirements into deliverables.
...company that values innovation and continuous development? Mead & Hunt has an exceptional opportunity for a highly motivated Entry-Level Construction Inspector to join our Transportation Group in Virginia. Grow your career with us. Learn with us. Thrive with us....
...independent practice while providing high quality optometric care and services to your patients next to an optical dispensary operated by Luxottica. Professional fee schedule is yours to decide and you keep the associated patient revenues for professional services that you...
...Compliance : Follow all appropriate health and safety regulations, food safety guidelines, and cleanliness requirements. Baking... ...: Understanding of proper pastry methods, techniques, and industry standards. Food Handler Certificate : Food Handlers Certificate...
...has grown tremendously in the last five years and now has a mission-driven staff of 3,000 and over 80 sites in the five boroughs. Dance Instructors are key members of the Health & Wellness team and will report to the Senior Director of Health & Wellness Department....
...)~ Paid Time Off ~401K ~ H1B/Green Card Sponsorship for qualified employee ~ Hands-on experience at global industry leader Samsung ~ Opportunities for career advancement Compensation $28-30/hr Overview Provide administrative, clerical support and...