ApacheCon Asia - 工作流和数据治理

工作流和数据治理

出品人 : 郭炜

工作流和数据治理将复杂的数据处理进行有序调度及处理，并在元数据和数据质量方面进行管控。在ASF有多种个项目提供了多种数据工作流方案，例如Apache Airflow，Apache Dolphin Scheduler，Apache Oozie，而Apache Atlas和Apache Griffin提供了多种元数据、数据质量的管理。在工作流和数据治理主题中大家不但会了解到一线用户将这些Apache项目应用到具体项目当中的实践经验，而且会了解这些Apache项目生态的最新进展，同时也将展望数据调度和数据治理方面的愿景。

2021-08-08

13:30 GMT+8新一代大数据工作流调度平台--Apache DolphinScheduler的架构演变中文演讲Lidong Dai

14:10 GMT+8基于DolphinScheduler的数据质量服务实践中文演讲孙朝和

14:50 GMT+8使用Airflow在Kubernetes进行数据处理中文演讲栾鹏

15:30 GMT+8DolphinScheduler json拆分项目中文演讲lijinyong

WORKFLOW/DATA GOVERNANCE

TRACK CHAIRS : WEI GUO

Tools of Workflow and Data Governance can deal with complex data processing jobs, meta-data and data quality. There are a variety of projects in ASF that provide a variety of Workflow and Data Governance solutions. For example,Apache Airflow，Apache Dolphin Scheduler，Apache Oozieprovide powerful data workflow platform, andApache AtlasandApache Griffinprovide meta data and data quality management. You will not only learn about the practical experience of first-line users in applying these Apache projects to data projects, but also learn about the latest developments in the ecology of these Apache Workflow and Data Governance projects, and visions on this project in the future.

2021-08-08

13:30 GMT+8The new generation of big data workflow scheduler platform - the architecture evolution of Apache DolphinSchedulerChinese SessionLidong Dai

14:10 GMT+8DolphinScheduler based Data Quality Services in PracticeChinese Session孙朝和

14:50 GMT+8Airflow with kubernetes for data processingChinese Session栾鹏

15:30 GMT+8DolphinScheduler json split projectChinese Sessionlijinyong