Skip to content

[Bug][Module Name] job state always in final state:RUNNING_EXECUTION when execution engine is tez #5551

@SbloodyS

Description

@SbloodyS
yarn application -status application_1621995850095_6901
21/05/27 07:06:04 INFO client.RMProxy: Connecting to ResourceManager at ip-192-168-24-254.us-west-2.compute.internal/192.168.24.254:8032
21/05/27 07:06:04 INFO client.AHSProxy: Connecting to Application History server at ip-192-168-24-254.us-west-2.compute.internal/192.168.24.254:10200
21/05/27 07:06:04 INFO conf.Configuration: resource-types.xml not found
21/05/27 07:06:04 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
21/05/27 07:06:04 INFO resource.ResourceUtils: Adding resource type - name = memory-mb, units = Mi, type = COUNTABLE
21/05/27 07:06:04 INFO resource.ResourceUtils: Adding resource type - name = vcores, units = , type = COUNTABLE
Application Report : 
        Application-Id : application_1621995850095_6901
        Application-Name : HIVE-f07905b9-25b6-4e3f-93a4-652ed349b9bd
        Application-Type : TEZ
        User : hadoop
        Queue : default
        Application Priority : 0
        Start-Time : 1622098349177
        Finish-Time : 1622098762224
        Progress : 100%
        State : FINISHED
        Final-State : ENDED

job final state is not SUCCEEDED but ENDED.Cause shell command always running.

worker.log
[INFO] 2021-05-27 07:05:41.030  - [taskAppId=TASK-10-264-3804]:[127] - FINALIZE_SESSION
[INFO] 2021-05-27 07:05:41.809  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:42.811  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:43.812  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:44.814  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:45.816  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:46.818  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:47.820  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:48.821  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:49.823  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:50.825  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:51.826  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION

Which version of Dolphin Scheduler:
-[1.3.6]

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions