2019-05-09 16:11:45,653 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint 2019-05-09 16:11:45,654 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint 2019-05-09 16:11:45,657 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint 2019-05-09 16:11:45,659 INFO org.apache.flink.configuration.GlobalConfiguration 2019-05-09 16:11:45,659 INFO org.apache.flink.configuration.GlobalConfiguration 2019-05-09 16:11:45,659 INFO org.apache.flink.configuration.GlobalConfiguration 2019-05-09 16:11:45,660 INFO org.apache.flink.configuration.GlobalConfiguration 2019-05-09 16:11:45,660 INFO org.apache.flink.configuration.GlobalConfiguration 2019-05-09 16:11:45,660 INFO org.apache.flink.configuration.GlobalConfiguration 2019-05-09 16:11:45,660 INFO org.apache.flink.configuration.GlobalConfiguration 2019-05-09 16:11:45,660 INFO org.apache.flink.configuration.GlobalConfiguration 2019-05-09 16:11:45,660 INFO org.apache.flink.configuration.GlobalConfiguration 2019-05-09 16:11:45,674 INFO org.apache.flink.runtime.clusterframework.BootstrapTools 2019-05-09 16:11:45,686 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint 2019-05-09 16:11:45,686 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint 2019-05-09 16:11:45,736 INFO org.apache.flink.runtime.security.modules.HadoopModule 2019-05-09 16:11:45,750 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint 2019-05-09 16:11:45,755 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint 2019-05-09 16:11:46,218 INFO akka.event.slf4j.Slf4jLogger 2019-05-09 16:11:46,269 INFO akka.remote.Remoting 2019-05-09 16:11:46,422 INFO akka.remote.Remoting 2019-05-09 16:11:46,431 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint 2019-05-09 16:11:46,452 INFO org.apache.flink.runtime.blob.BlobServer 2019-05-09 16:11:46,453 INFO org.apache.flink.runtime.blob.BlobServer 2019-05-09 16:11:46,468 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl 2019-05-09 16:11:46,472 INFO org.apache.flink.runtime.dispatcher.FileArchivedExecu 2019-05-09 16:11:46,495 INFO org.apache.flink.runtime.blob.TransientBlobCache 2019-05-09 16:11:46,504 WARN org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint 2019-05-09 16:11:46,504 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint 2019-05-09 16:11:46,507 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint 2019-05-09 16:11:46,758 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils 2019-05-09 16:11:46,758 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils 2019-05-09 16:11:46,837 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint 2019-05-09 16:11:46,837 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint 2019-05-09 16:11:46,837 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint 2019-05-09 16:11:46,892 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService 2019-05-09 16:11:46,933 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService 2019-05-09 16:11:46,967 INFO org.apache.hadoop.yarn.client.RMProxy 2019-05-09 16:11:47,199 INFO org.apache.flink.yarn.YarnResourceManager 2019-05-09 16:11:47,201 INFO org.apache.hadoop.yarn.client.api.impl.ContainerManag 2019-05-09 16:11:47,203 INFO org.apache.flink.yarn.YarnResourceManager 2019-05-09 16:11:47,203 INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager 2019-05-09 16:11:47,216 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher 2019-05-09 16:11:47,218 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher 2019-05-10 14:22:29,706 INFO org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl 2019-05-10 14:22:34,709 INFO org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl 2019-05-10 14:22:39,710 INFO org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl 2019-05-10 14:22:44,712 INFO org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl 2019-05-10 14:22:49,713 INFO org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl 2019-05-10 14:22:54,715 INFO org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl - --------------------------------------------------------------------------------
- Registered UNIX signal handlers for [TERM, HUP, INT]
- YARN daemon is running as: root Yarn client user obtainer: root
- Loading configuration property: rest.port, 8081
- Loading configuration property: internal.cluster.execution-mode, NORMAL
- Loading configuration property: parallelism.default, 1
- Loading configuration property: high-availability.cluster-id, application_1544768545362_1516
- Loading configuration property: jobmanager.rpc.address, 10.3.8.49
- Loading configuration property: jobmanager.heap.mb, 1024
- Loading configuration property: taskmanager.numberOfTaskSlots, 1
- Loading configuration property: taskmanager.heap.mb, 1024
- Loading configuration property: jobmanager.rpc.port, 6123
- Setting directories for temporary files to: /data/yarn/nm/usercache/root/appcache/application_1544768545362_1516,/data1/yarn/nm/usercache/root/appcache/application_1544768545362_1516,/data2/yarn/nm/usercache/root/appcache/application_1544768545362_1516,/data3/yarn/nm/usercache/root/appcache/application_1544768545362_1516
- Starting YarnSessionClusterEntrypoint.
- Install default filesystem.
- Hadoop user set to root (auth:SIMPLE)
- Initializing cluster services.
- Trying to start actor system at test-ai-etl-c1-2:20698
- Slf4jLogger started
- Starting remoting
- Remoting started; listening on addresses :[akka.tcp://flink@test-ai-etl-c1-2:20698]
- Actor system started at akka.tcp://flink@test-ai-etl-c1-2:20698
- Created BLOB server storage directory /data3/yarn/nm/usercache/root/appcache/application_1544768545362_1516/blobStore-3e28573d-d50a-4740-9d62-e321a6053cdf
- Started BLOB server at 0.0.0.0:1599 - max concurrent requests: 50 - max backlog: 1000
- No metrics reporter configured, no metrics will be exposed/reported.
tionGraphStore - Initializing FileArchivedExecutionGraphStore: Storage directory /data/yarn/nm/usercache/root/appcache/application_1544768545362_1516/executionGraphStore-90531c01-f565-4b1e-8249-5d9004ee0d1c, expiration time 3600000, maximum cache size 52428800 bytes.
- Created BLOB cache storage directory /data3/yarn/nm/usercache/root/appcache/application_1544768545362_1516/blobStore-fdba6d30-bd71-443a-8822-d7f4621efb7e
- Upload directory /tmp/flink-web-e2e9a8e7-e5e7-444d-b571-683487e9fd1f/flink-web-upload does not exist, or has been deleted externally. Previously uploaded files are no longer available.
- Created directory /tmp/flink-web-e2e9a8e7-e5e7-444d-b571-683487e9fd1f/flink-web-upload for file uploads.
- Starting rest endpoint.
- Determined location of main cluster component log file: /data2/yarn/container-logs/application_1544768545362_1516/container_1544768545362_1516_01_000001/jobmanager.log
- Determined location of main cluster component stdout file: /data2/yarn/container-logs/application_1544768545362_1516/container_1544768545362_1516_01_000001/jobmanager.out
- Rest endpoint listening at test-ai-etl-c1-2:15911
- http://test-ai-etl-c1-2:15911 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000
- Web frontend listening at http://test-ai-etl-c1-2:15911.
- Starting RPC endpoint for org.apache.flink.yarn.YarnResourceManager at akka://flink/user/resourcemanager .
- Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/dispatcher .
- Connecting to ResourceManager at test-ai-etl-c1-3/10.3.8.48:8030
- Recovered 0 containers from previous attempts ([]).
ementProtocolProxy - yarn.client.max-cached-nodemanagers-proxies : 0
- ResourceManager akka.tcp://flink@test-ai-etl-c1-2:20698/user/resourcemanager was granted leadership with fencing token 00000000000000000000000000000000
- Starting the SlotManager.
- Dispatcher akka.tcp://flink@test-ai-etl-c1-2:20698/user/dispatcher was granted leadership with fencing token 00000000-0000-0000-0000-000000000000
- Recovering all persisted jobs.
- Updating with new AMRMToken
- Updating with new AMRMToken
- Updating with new AMRMToken
- Updating with new AMRMToken
- Updating with new AMRMToken
- Updating with new AMRMToken

我之前也是这样的，没有提交任务都是tm个数都是0的，如果有任务提交了，就有对应个数的tm

最flinkx master版本 yarn 模式提交任务失败 #51

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions