QA Engineer(Databricks)

2 hours, 56 minutes ago
Mid Level
Quality Assurance and Testing
66degrees

66degrees

66degrees: Google Cloud Premier Partner shaping the Future of Work with AI and data solutions.

IT Services
251-1K

Description

  • Validate data in Databricks Delta tables across Bronze, Silver, and Gold layers.
  • Perform source-to-target data validation and reconciliation.
  • Verify data transformations, business rules, and aggregation logic.
  • Execute SQL queries to validate data accuracy, completeness, consistency, and integrity.
  • Validate schemas, data types, null values, duplicate records, and primary key constraints.
  • Perform regression, integration, and end-to-end testing for data pipelines.
  • Create, execute, and maintain test cases and test scenarios based on business requirements.
  • Log, track, and manage defects using JIRA and collaborate with Data Engineers to resolve issues.
  • Participate in Agile ceremonies, including sprint planning, daily stand-ups, and retrospectives.
  • Prepare test execution reports and communicate testing status to stakeholders.

Requirements

  • 3–5 years of experience in data testing, ETL testing, or data validation.
  • Hands-on experience with Databricks and Delta Lake.
  • Strong proficiency in SQL for data validation and reconciliation.
  • Experience validating ETL/ELT pipelines and data transformations.
  • Knowledge of Spark SQL and Databricks notebooks.
  • Experience with JIRA for defect tracking and test management.
  • Understanding of data warehousing concepts and relational databases.
  • Experience working in Agile/Scrum environments.
  • Strong analytical, troubleshooting, and communication skills.
  • Basic knowledge of PySpark and Python.
  • Experience with Azure Databricks.
  • Experience with ETL testing.
  • Exposure to Azure DevOps or Git for version control.
  • Familiarity with data quality frameworks and test automation tools.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Specialist Quality Assurance, CSV

Definium Therapeutics 51-250 Health Care Providers & Services

Definium Therapeutics is hiring a Senior Specialist, Quality Assurance, CSV to oversee compliance and lifecycle management of computerized GxP systems supporting regulated software, validation, and change control activities.

2 hours, 40 minutes ago

Junior QA Analyst

Ace IT Careers 1-10 Internet Software & Services

Ace IT Careers is hiring a Junior QA Analyst to support a technology delivery team in testing web-based and business applications and helping improve product quality.

Agile Azure JIRA Postman REST API SQL
2 hours, 56 minutes ago

Lead Hardware Reliability Engineer, Electrical (Starshield)

SpaceX 10K-50K Aerospace & Defense

SpaceX is seeking a Lead Electrical Hardware Reliability Engineer for Starshield to build and lead a team focused on improving the reliability, robustness, and longevity of government-use hardware supporting national security missions.

Flux
2 hours, 56 minutes ago

QA Engineer

Freedom24 Capital Markets

An experienced QA Engineer will join a fintech-focused team to test mobile, web, and API products supporting brokerage services and financial markets.

Appium Postman Selenium SQL
2 hours, 56 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers