DataBricks Architect Job at Abidi Group LLC, Houston, TX

K01nTS95OHdMMmNOQW93VlV5Z1NLa0FC
  • Abidi Group LLC
  • Houston, TX

Job Description

Technical Expertise:

  • Data bricks Mastery:  Deep, expert-level knowledge of the Data bricks Platform, including:
    • Unity Catalog:  Designing and implementing data governance and security.
    • Delta Lake & Delta Live Tables:  Architecture and building reliable, scalable data pipelines.
    • Performance & Cost Optimization:  Expertise in tuning Spark jobs, optimizing cluster usage, and managing platform costs.
    • MLOps:  Strong, practical understanding of the machine learning lifecycle on Data bricks using tools like MLflow.
    • Data bricks SQL:  Knowledge of designing and optimizing analytical workloads.
    • Mosaic AI:  Knowledge of designing and optimizing AI Agents.
  • Cloud & Infrastructure:  Deep knowledge of cloud architecture and services on AWS. Strong command of Infrastructure as Code (Terraform, YAML).
  • Data Engineering & Programming:  Strong background in data modeling, ETL/ELT development, and advanced, hands-on programming skills in Python and SQL.
  • CI/CD & Automation:  Experience with designing and implementing CI/CD pipelines (preferably with GitHub Actions) for data and ML workloads.
  • Severability:  Familiarity with implementing monitoring, logging, and alerting for data platforms.
  • Automation:  The platform is ephemeral, and all changes are implemented using Terraform and Python. Expertise in Terraform and Python is a must.

Job Tags

Contract work,

Similar Jobs

Alameda Health System

Occupational Therapy Aide, Per diem, Days, 8hours Job at Alameda Health System

Occupational Therapy Aide, Per diem, Days, 8hoursFeatured Job+ San Leandro, CA+ Fairmont Hospital+ FMT Outpatient Psychiatric SVCS+ Services As Needed / Per Diem - Day+ Allied Health+ $34.93/HR+ Req #:42160-31255+ FTE:0.01+ Posted:Yesterday**Summary****SUMMARY... 

Vensure Employer Solutions

Marine Systems Engineer - FL - On site Job at Vensure Employer Solutions

 ...Essential Duties and Responsibilities Work within a small company atmosphere with other marine engineers, naval architects, and designers to solve engineering challenges. Projects will span all different types of vessels in the maritime industry, so the role will... 

Waed Ventures

Public Relations Specialist Job at Waed Ventures

 ...and liaise with external graphic designers to establish brand guidelines and designs for published content Coordinate relevant public relations activities including handling sponsorship opportunities, developing press releases and presentations, while maintaining a... 

HCA Healthcare

Operating Room Nurse Job at HCA Healthcare

 ...Description****Introduction**Do you want to be appreciated daily? Our nurses are celebrated for being on the front line, empathetic for...  ...apart from any other healthcare provider. We are seeking an Operating Room Nurse to join our healthcare family.**Benefits**Alaska... 

Activate Talent

Marketing Copywriter Job at Activate Talent

Location: Remote (Pacific Time Zone)Job Summary: We are seeking a talented and dynamic Creative Writer to join our team. This role is essential for ideating, scripting, and overseeing the production of high-quality advertisements and marketing content. The ideal...