Azure Databricks Engineer Job at Diverse Lynx, New York, NY

WTlnUlJuNVpnYndsSGFjb1VPRFE0VzI2
  • Diverse Lynx
  • New York, NY

Job Description

Role – Azure Databricks Engineer Location – New York, NY (Onsite) Experience – 10+ Years Job Description We are looking for an experienced Data Engineer with expertise in building data pipelines using Azure Databricks and other Azure Data Services. The person should have a good understanding and working experience in Lakehouse and Medallion architectures. Responsibilities include developing and implementing scalable, high-performance data solutions on Databricks using Delta Lake, ADLS2, Spark, and Apache Airflow. Experience working with Azure Services such as Azure Data Lake, Databricks, Azure Data Factory, Azure SQL DB, Azure Functions, etc. Hands-on experience with Delta Live Tables, Unity Catalog, and Lakehouse Federation. Technical expertise with data models, data mining, and analytics techniques. Technical expertise on various storage mechanisms. Programming skills in Python or .NET/C#. SQL Database design experience. Experience working in an Agile (Scrum) environment. Experience with Git/DevOps, implementing CI/CD pipelines (preferably Azure-based). Experience in data modeling, analysis, data warehousing concepts, and best practices. Strong collaboration skills and experience working with remote teams. Responsibilities Analyze and organize raw data. Build data systems and pipelines. Evaluate business needs, interpret trends and patterns. Conduct complex data analysis and report results. Prepare data for prescriptive and predictive modeling. Build and incorporate business rules, logic, transformations, and aggregations. Combine raw data from different sources and build data pipelines across multiple layers. Explore ways to enhance data quality and build data quality frameworks. Identify opportunities for data acquisition. Preferred Qualifications Databricks Certified Data Engineer Professional. Experience in banking or finance domains is a plus. Education Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field. Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive consideration without discrimination. We support a diverse workforce across all levels. #J-18808-Ljbffr

Diverse Lynx

Job Tags

Work experience placement, Remote job,

Similar Jobs

LHH

Real Estate Associate Attorney Job at LHH

 ...A large firm with an office in Phoenix is seeking a real estate associate attorney with 1-7 years of experience to join its commercial real estate and land use practice. This associate will draft and negotiate commercial real estate transactions, including development,... 

Medix™

Quality Assurance Manager - 242632 Job at Medix™

**Seeking a Quality Insurance Manager for a well known Clinical Research Site in Dallas,...  ...are looking to add a full time Quality Assurance Manager to our growing team. This role can...  ...will include performing on-site and remote audits, writing quality reports and Corrective... 

Royal Caribbean Group

Onboard Digital Manager Job at Royal Caribbean Group

As the ambassador of our digital transformation program in your assigned ship, you will oversee all digital experience products across...  ..., and coordinating all releases, implementation, and change management efforts. You will also monitor the onboard digital employee and... 

Adventist Health

Registered Nurse (RN) - Manager, NICU - Neonatal Intensive Care Job at Adventist Health

 ...Credentialing Center. Glendale is known for its urban living, with easy access to dining, entertainment, shopping, amusement parks and outdoor recreation. Adventist Health Glendale is proud to be part of the thriving, diverse community since 1905. \n Job Summary: \n... 

Concentrus

Hygienist - Join Our Empowering Team: Full-Time & Part-Time Hygienists Wanted! Job at Concentrus

About the job Hygienist - Join Our Empowering Team: Full-Time & Part-Time Hygienists Wanted!Perfect Smile Dental Care is a growing group of 2 dental offices...  ...Jose. We offer professional and personal development to help team members grow stronger in all aspects of their lives...