RemoteLeaf Logo
Log in Sign up

Senior Data Engineer - Databricks

27 minutes ago
Mexico
Full-time
Senior
Data Engineer
Data Science and Analytics
Agile Apache Spark AWS CI/CD Databricks Python
Apply Now
Caylent

Caylent

Caylent is a cloud native services company that simplifies AWS cloud adoption with a user-friendly DevOps platform for scalable cloud environments.

IT Services
251-1K
Founded 2015
$16M raised
View All Jobs 26

Description

  • Deliver complex data platform components and migration solutions independently.
  • Define RDS data sources and develop ETL jobs.
  • Manage data warehouses and lakehouse platforms, including Databricks-based environments.
  • Troubleshoot performance, scalability, and reliability issues.
  • Contribute to solution design and engineering standards.
  • Communicate technical topics clearly to peers and stakeholders.
  • Produce high-quality documentation and implementation reviews.
  • Participate in daily standups and agile ceremonies with the customer.

Requirements

  • 4+ years of RDBMS or big data engineering experience.
  • 2+ years of AWS-based implementations.
  • 1+ years of hands-on Databricks experience or equivalent lakehouse platform experience.
  • Strong experience building scalable cloud-native data platforms and pipelines.
  • Advanced knowledge of modern data lake and lakehouse practices.
  • Hands-on experience with distributed processing such as Spark/PySpark or equivalent.
  • Hands-on experience with Databricks notebooks, job orchestration, Delta Lake, and Unity Catalog or a comparable managed lakehouse platform.
  • Experience with streaming or event-driven ingestion patterns.
  • Python experience with solid engineering principles, including OOP and testing.
  • Strong expertise in relational databases and schema design.
  • Advanced query optimization and performance troubleshooting experience.
  • Experience executing large-scale migrations and modernization efforts, including migrations onto Databricks.
  • Knowledge of HA/DR patterns, security, and cost optimization.
  • Infrastructure-as-code and CI/CD integration experience.
  • Cloud security fundamentals and cost-aware design experience.
  • Upper-Intermediate English (minimum B2).
  • Visa sponsorship is not available now or in the future.

Benefits

  • 100% remote work.
  • Generous holidays and flexible PTO.
  • Competitive phantom equity.
  • Paid exams and certifications.
  • Peer bonus awards.
  • State-of-the-art laptop and tools.
  • Equipment and office stipend.
  • Individual professional development plan.
  • Annual learning and development stipend.
  • Work with a worldwide team in an inclusive company culture.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Ondo Finance

Senior Data Engineer

Ondo Finance 11-50 Diversified Financial Services

Ondo Finance is hiring its first Data Engineer to build the foundational data platform for its onchain financial products and analytics teams.

United States Full-time Senior Data Engineer
Apache Airflow CockroachDB dbt GCP Go QuestDB Snowflake SQL
12 minutes ago
Livefront

Data Engineer [Zeal]

Livefront 11-50 Internet Software & Services

Zeal, now part of Livefront, is hiring a Data Engineer in Peru to build and support data pipelines and migration solutions for Fortune 1000 consulting engagements.

Peru Full-time Junior Data Engineer
Apache Airflow CI/CD Databricks dbt GCP Git Kafka Oracle PostgreSQL Power BI Python RabbitMQ Snowflake SQL SQL Server Tableau
42 minutes ago
SSC Egypt

Senior Data Engineer

SSC Egypt 11-50 IT Services

Senior Data Engineer at a data and analytics team, focused on analyzing diverse data sources, building master data records, and delivering cloud-based data integration and quality solutions.

Egypt Senior Data Engineer
Apache Spark HIPAA Python REST API SQL
1 hour, 12 minutes ago
Boldr

Senior Data Engineer

Boldr 251-1K Professional Services

Boldr is seeking a Senior Data Analytics Engineer to lead client-facing data platform work across Professional Services, building and optimizing data infrastructure that turns complex data into reliable insights.

Philippines Full-time Senior Data Engineer
Java Microsoft Dynamics 365 Power BI Python Scala SQL SQL Server
1 hour, 12 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers