Databricks Architect | US

About Cuesta Partners We are looking for a Databricks Architect to lead the delivery of data engineering solutions in a client-facing environment. This is a hands‐on leadership role where you will work directly with clients – including C‐level stakeholders – to design, build, and deploy production‐grade Databricks platforms.

What You’ll Do

• Design and architect scalable Databricks‐based solutions for enterprise clients.
• Lead end‐to‐end cloud data platform implementations across AWS and/or Azure.
• Design and build production pipelines using Databricks Workflows and Spark Declarative Pipelines.
• Design scalable ETL/ELT pipelines using Spark, PySpark, and Databricks Workflows.
• Partner directly with client stakeholders to understand business needs and translate them into technical solutions.
• Provide technical leadership and guidance to data engineering teams.
• Implement CI/CD pipelines and infrastructure‐as‐code for Databricks resources.
• Drive collaborative development through Git workflows, pull requests, and code reviews.
• Collaborate cross‐functionally with analytics, engineering, and business teams.
• Serve as the primary technical point of contact for clients, including C‐level executives.

What We’re Looking For

• 6+ years of experience in Data Engineering, Cloud Architecture, or related roles.
• 3+ years of hands‐on experience with Databricks.
• Strong proficiency in PySpark, Spark SQL, Python, and SQL.
• Deep experience with Delta Lake, Unity Catalog, Delta Live Tables, and Databricks Jobs.
• Proven experience delivering Databricks projects in a consulting or professional services environment.
• Strong understanding of data lake concepts and formats (Delta, Iceberg, Parquet, etc.).
• Experience designing and managing Unity Catalog for governance, access control, and lineage.
• Familiarity with medallion architecture (bronze/silver/gold) patterns.
• Hands‐on experience with Git version control, pull requests, code reviews, and collaborative development workflows.
• CI/CD and infrastructure‐as‐code for Databricks resources (Terraform, Asset Bundles, GitHub Actions).
• MLflow experience: experiment tracking, model registry, deployment, and observability.
• Cloud platform experience.
• Experience working in client‐facing, consulting, or cross‐functional environments.
• Experience leading technical projects or mentoring engineering teams.

Nice to Have

• Databricks certifications (Data Engineer Associate or Professional, Machine Learning Associate or Professional, Data Engineer Associate or Professional or ML Engineer Associate or Professional).
• Experience with agentic AI workflows, including agents, skills, and tools on the Databricks side (Agentbricks), as well as LangChain and Claude agentic workflows.

Benefits: What you’ll gain

• At Cuesta, we value entrepreneurship, humility, diversity, learning, speed, and balance.
• Constant opportunities for exposure & learning
• Flexible working location and enabling personal‐life harmony with work
• Agency and influence in the company’s total strategy and direction
• Collaboration with a high‐performing team
• Competitive base salary (outlined in this listing) and target bonus of 20‐25%
• 401k, healthcare benefits, paid time‐off, and more!

Compensation

$145K – $188K. Offers Bonus. In addition to the base salary, there is typically an annual bonus of between 20-25% of salary. The offered salary may vary within this range depending on the candidate’s experience and the team’s feedback at the end of the process.