Skip to content

[Feature-11223] support stream task#11350

Merged
caishunfeng merged 41 commits intoapache:devfrom
caishunfeng:stream_task
Aug 10, 2022
Merged

[Feature-11223] support stream task#11350
caishunfeng merged 41 commits intoapache:devfrom
caishunfeng:stream_task

Conversation

@caishunfeng
Copy link
Copy Markdown
Contributor

@caishunfeng caishunfeng commented Aug 8, 2022

Purpose of the pull request

this pr close #11223

Brief change log

  • add flink-stream task
  • add stream task definition、instance ui
  • stream task action (start / savepoint/ stop), see StreamTaskExecuteRunnable
  • show stream task in DAG use dotted line, skip stream task when run DAG.

Verify this pull request

@github-actions github-actions bot added backend UI ui and front end related labels Aug 8, 2022
@SbloodyS SbloodyS added this to the 3.1.0 milestone Aug 8, 2022
@caishunfeng caishunfeng marked this pull request as ready for review August 10, 2022 01:43
@caishunfeng
Copy link
Copy Markdown
Contributor Author

Please take a review @ruanwenjun @songjianet

Copy link
Copy Markdown
Member

@labbomb labbomb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@sonarqubecloud
Copy link
Copy Markdown

SonarCloud Quality Gate failed.    Quality Gate failed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 71 Code Smells

6.0% 6.0% Coverage
3.9% 3.9% Duplication

Copy link
Copy Markdown
Member

@ruanwenjun ruanwenjun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@caishunfeng caishunfeng merged commit 0464123 into apache:dev Aug 10, 2022
@caishunfeng caishunfeng deleted the stream_task branch August 11, 2022 01:24
xdu-chenrj pushed a commit to xdu-chenrj/dolphinscheduler that referenced this pull request Oct 13, 2022
* add task execute type

* update task definition list paging

* update task instance list paging

* stream task start

* [Feature][UI] Some changes to execute task.
    * Set the connection edge to dashed line.
    * Add FLINK_STREAM task.

* add stream task

* flink savepoint and cancel

* fix query bug

* add stream task definition

* add task instance for stream task

* delete stream task definition state

* update api for stream task definition edit

* modify search for stream task instance

* add language

* delete task type search for stream task definition

* change task type search for stream task instance

* add jump button

* add savepoint

* add down log for stream task instance

* ui test

* stream task start

* run DAG

* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.

* [Feature][UI] Remove some fields for FLINK_STREAM.

* add start modal

* add dryRun column for stream task instance

* fix duration

* fix pon

* fix build error

* Add success tip

* add auto sync for stream task instance

* remove forgien key for task instance

* license header

* UT fix

* modify locales

* recover common config

* fix UT

* add doc

Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend document UI ui and front end related

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature][Stream] Support stream task

6 participants