Gate.com

Gate.com

Gate.com offers premium Managed WordPress hosting with top-notch security, management tools, and 24/7 support for small and medium-sized businesses, ensuring an enterprise-grade experience at an affordable price.

IT Services
51-250
Founded 1996

Description

  • 分析、设计并交付基于 Flink、Kafka 的实时数据处理链路,为实时分析、监控、指标和业务决策提供数据支持。
  • 参与实时数仓架构、数据分层、指标口径、维度模型和数据服务的设计与落地。
  • 优化实时任务,解决数据延迟、反压、Checkpoint 异常、状态膨胀、资源利用率不合理和数据不一致等问题。
  • 参与任务依赖梳理、元数据管理、数据质量监控、告警机制、开发规范和问题排查体系建设。
  • 维护大数据平台及计算引擎,协同上下游团队保障数据链路的稳定性、准确性和时效性。
  • 通过技术分享、代码评审和方案评审沉淀实时开发最佳实践,提升团队研发能力。

Requirements

  • 本科及以上学历,计算机、软件工程、信息技术或相关专业,具备 5 年及以上数据开发或大数据研发经验;优秀者可适当放宽。
  • 具备完整的数据仓库项目经验,熟悉实时数仓架构、数据分层和数据模型设计。
  • 熟练掌握 Flink,具备 Flink SQL、DataStream API 实际项目经验,理解 State、Checkpoint、Watermark、窗口、反压和容错机制。
  • 具备实时任务开发与优化经验,能够解决任务延迟、资源消耗、状态异常、数据倾斜和数据一致性问题。
  • 熟悉 Kafka 及实时数据链路,理解数据采集、传输、计算、存储和服务流程。
  • 熟悉 Hadoop、Hive、Spark,并具备离线数据开发能力。
  • 熟练掌握 SQL,能够进行复杂数据加工和性能优化;至少掌握 Python、Java 或 Scala 之一。
  • 熟悉 MySQL、PostgreSQL、Elasticsearch 等数据库或存储系统。
  • 具备良好的业务理解、沟通协作和书面表达能力,能够主动推动问题解决和项目落地。
  • 具备大规模 Flink 任务调优、实时数仓治理、Hologres/ClickHouse/Doris 或实时指标、监控、风控、推荐场景经验者优先。

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Platform Engineer

Qonto 1K-5K Banks

Qonto is hiring a Data Solution Engineer to build and operate reliable, self-service data solutions for its European fintech platform serving more than 600,000 customers and nearly 2,000 employees.

Apache Airflow AWS CI/CD Git Kubernetes Metabase Python Snowflake SQL Trino
22 hours, 50 minutes ago

Azure Data Engineering Architect - freelance

Lingaro 5K-10K IT Services

Data Engineering Architect responsible for designing and guiding scalable, secure data architecture and processing solutions that support the organization’s analytics needs and long-term data strategy.

Apache Spark AWS Azure Hadoop Python SQL
23 hours, 5 minutes ago

Full Stack Data Engineer

BioIntelliSense 51-250 Pharmaceuticals

BioIntelliSense develops medical-grade continuous health monitoring and clinical intelligence solutions for remote patient monitoring, infection screening, and care delivery outside traditional clinical settings.

23 hours, 5 minutes ago

Director – Analytics Platform

Bounteous 1K-5K Internet Software & Services

Bounteous is seeking a Director of Analytics Platform in the USA to lead the strategy, architecture, implementation, and evolution of enterprise analytics platforms that support data-driven business transformation.

AWS Azure Looker Power BI Tableau
23 hours, 5 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers