Responsibilities
- Build, test, and orchestrate data pipelines in Databricks.
- Design and optimize data structures, schemas, and ETL processes.
- Translate business use cases into SQL queries, reports, and dashboards.
- Manage database objects in development environments without impacting production.
- Automate workflows using Databricks Workflows or the Jobs API.
- Integrate code into GitHub/GitLab and support CI/CD practices.
- Diagnose data gaps/quality issues and design test cases for validation.
- Collaborate with developers and analysts to synchronize code and ensure reliability.
Requirements
- Active Secret clearance (required).
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
- 7+ years of professional experience in data engineering.
- Expert‑level proficiency in Databricks, Apache Spark, and SQL.
- Experience with Kafka, Airflow, or AWS Glue for ETL.
- Proficiency in CI/CD pipelines and GitHub/GitLab version control.
- Knowledge of cloud platforms (AWS, Azure, GCP).
- Excellent problem‑solving, debugging, and collaboration skills.
- Position will be hybrid, onsite in Arlington/Washington DC depending on meetings.
Rubix Solutions LLC is an EEO Employer - M/F/Disability/Protected Veteran Status
#J-18808-Ljbffr