Job Description


Job Overview

  • Job ID:

    J55978

  • Job Title:

    Databricks Data Engineer

  • Location:

    Atlanta, GA

  • Duration:

    24 Months + Extension

  • Domain Exposure:

    Aerospace/ Airlines

  • Client:

    To Be Discussed Later

  • Employment Type:

    W-2, 1099, C2C

  • Work Authorization:

    US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: Databricks Data Engineer
Location: Atlanta, GA
Duration: 24 Months + Extension
Bill Rate: $76/hour
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD

Job Description

  • We are looking for a skilled Databricks Data Engineer to develop and manage enterprise-scale data processing solutions using Databricks, Apache Spark, PySpark, and Delta Lake.
  • The ideal candidate should have strong experience in building data pipelines, implementing lakehouse architecture, optimizing Spark workloads, and integrating cloud data platforms. The candidate will work with data architects, analysts, and engineering teams to deliver scalable and reliable data solutions.

Required Skills: 

  • Strong hands-on experience with Databricks.
  • Advanced programming skills in Python and PySpark.
  • Strong knowledge of Apache Spark and Spark SQL.
  • Experience with Delta Lake and lakehouse architecture.
  • Knowledge of Unity Catalog and data governance.
  • Experience with Delta Live Tables / Lakeflow.
  • Experience building ETL and ELT pipelines.
  • Knowledge of AWS, Azure, or GCP cloud platforms.
  • Experience with SQL, data modeling, and data warehousing.
  • Familiarity with Git, CI/CD, and workflow orchestration.

Key Responsibilities: 

  • Design and develop scalable data engineering solutions using Databricks.
  • Build batch and streaming data pipelines using Apache Spark.
  • Develop data transformations using PySpark and Spark SQL.
  • Implement lakehouse architecture using Delta Lake.
  • Manage data access, governance, and permissions through Unity Catalog.
  • Build and maintain automated workflows using Databricks Workflows.
  • Implement incremental data processing and CDC pipelines.
  • Optimize Spark jobs and improve processing performance.
  • Integrate Databricks with cloud storage and enterprise databases.
  • Develop data validation and quality monitoring processes.
  • Collaborate with data scientists and analytics teams.
  • Troubleshoot production issues and ensure pipeline reliability.

Preferred Qualifications: 

  • Experience with Databricks Lakeflow and Lakeflow Connect.
  • Knowledge of Apache Kafka and real-time data processing.
  • Experience with Terraform and cloud infrastructure automation.
  • Knowledge of MLflow and machine learning workflows.
  • Experience with enterprise data migration projects.




Apply Now
Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.