观看量 24.2k
本视频由 保利威 提供技术支持

ApacheCon Asia - 工作流和数据治理

工作流和数据治理

出品人 : 郭炜

工作流和数据治理将复杂的数据处理进行有序调度及处理,并在元数据和数据质量方面进行管控。在ASF有多种个项目提供了多种数据工作流方案,例如Apache AirflowApache Dolphin SchedulerApache Oozie,而Apache AtlasApache Griffin提供了多种元数据、数据质量的管理。在工作流和数据治理主题中大家不但会了解到一线用户将这些Apache项目应用到具体项目当中的实践经验,而且会了解这些Apache项目生态的最新进展,同时也将展望数据调度和数据治理方面的愿景。

2021-08-07

13:30 GMT+8DolphinScheduler 调度工具在运营商的实践中文演讲王兴杰

14:10 GMT+8Apache DolphinScheduler - 一个用于处理大量复杂的任务优秀调度工具中文演讲Qiang Guo

14:50 GMT+8Airflow深度实践中文演讲吴琏

15:30 GMT+8基于Apache Hudi的数据湖上的Dolphin调度器的实践英文演讲Zhao Yuwei

WORKFLOW/DATA GOVERNANCE

TRACK CHAIRS : WEI GUO

Tools of Workflow and Data Governance can deal with complex data processing jobs, meta-data and data quality. There are a variety of projects in ASF that provide a variety of Workflow and Data Governance solutions. For example,Apache AirflowApache Dolphin SchedulerApache Oozieprovide powerful data workflow platform, andApache AtlasandApache Griffinprovide meta data and data quality management. You will not only learn about the practical experience of first-line users in applying these Apache projects to data projects, but also learn about the latest developments in the ecology of these Apache Workflow and Data Governance projects, and visions on this project in the future.

2021-08-07

13:30 GMT+8The Practice of DolphinScheduler in Telecom IndustryChinese Session王兴杰

14:10 GMT+8Apache DolphinScheduler - An Excellent Scheduler Tool for Massive Complicate TasksChinese SessionQiang Guo

14:50 GMT+8Airflow in depth practiceChinese Session吴琏

15:30 GMT+8Practice of Dolphin Scheduler on Data Lake Based On Apache HudiEnglish SessionZhao Yuwei