Search before asking

• I had searched in the issues and found no similar feature requirement.

Purpose

At present, DS is the scheduling of offline tasks, but as the business requires more and more timely addition of task results, there are more and more scenarios of stream-batch integration, so it is necessary to support real-time tasks.

Use case

• define stream task, such as flink-stream.
• stream task action in ds, such as start, stop, savepoint, monitor etc.
• stream task in DAG, we can do impact analysis based on the relationship between tasks in the DAG, which is a proactive approach.

Related items

• Support stream task definition and instance action [Feature][Stream] Support stream task #11223
• Use flink SDK replace the shell cli, make more standard and easy to develop [Feature][Flink Stream] Use flink SDK replace the shell cli #11440
• Add flink cluster manager
• Support flink sql
• Add flink metircs, such as checkpoints, received, sent etc.
• Support other stream task.
• Event-based scheduling.
• checkpoint/savepoint mange, task continuing, failover