Skip to content

rllib cannot run eager with tensorflow2.0-rc0 #5621

@idthanm

Description

@idthanm

System information

  • OS Platform and Distribution (e.g., Linux Ubuntu 16.04):Linux Ubuntu 16.04
  • Ray installed from (source or binary):binary
  • Ray version:ray-0.8.0.dev4
  • Python version:python37
  • Exact command to reproduce:rllib train --run=DQN --env=CartPole-v0 --eager

Describe the problem

I cannot run the simple command with eager while i use tensorflow2.0-rc0: rllib train --run=DQN --env=CartPole-v0 --eager.

Source code / logs

(pid=3259) 2019-09-03 23:56:25,208 INFO trainer.py:336 -- Executing eagerly
2019-09-03 23:56:25,250 ERROR trial_runner.py:552 -- Error processing event.
Traceback (most recent call last):
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/tune/trial_runner.py", line 498, in _process_trial
result = self.trial_executor.fetch_result(trial)
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/tune/ray_trial_executor.py", line 347, in fetch_result
result = ray.get(trial_future[0])
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/worker.py", line 2340, in get
raise value
ray.exceptions.RayTaskError: ray_worker (pid=3259, host=yang-XPS-15-9570)
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/rllib/agents/trainer_template.py", line 90, in init
Trainer.init(self, config, env, logger_creator)
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/rllib/agents/trainer.py", line 366, in init
Trainable.init(self, config, logger_creator)
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/tune/trainable.py", line 99, in init
self._setup(copy.deepcopy(self.config))
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/rllib/agents/trainer.py", line 486, in _setup
self._init(self.config, self.env_creator)
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/rllib/agents/trainer_template.py", line 109, in _init
self.config["num_workers"])
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/rllib/agents/trainer.py", line 531, in _make_workers
logdir=self.logdir)
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/rllib/evaluation/worker_set.py", line 64, in init
RolloutWorker, env_creator, policy, 0, self._local_config)
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/rllib/evaluation/worker_set.py", line 220, in _make_worker
_fake_sampler=config.get("_fake_sampler", False))
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/rllib/evaluation/rollout_worker.py", line 351, in init
policy_dict, policy_config)
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/rllib/evaluation/rollout_worker.py", line 762, in _build_policy_map
policy_map[name] = cls(obs_space, act_space, merged_conf)
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/rllib/policy/eager_tf_policy.py", line 88, in init
config)
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/rllib/agents/dqn/dqn_policy.py", line 218, in build_q_model
parameter_noise=config["parameter_noise"])
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/rllib/models/catalog.py", line 320, in get_model_v2
name, **model_kwargs)
File "/home/yang/Software/anaconda3/envs/tf2/lib/python3.7/site-packages/ray/rllib/agents/dqn/distributional_q_model.py", line 157, in init
store = tfc.eager.EagerVariableStore()
AttributeError: module 'tensorflow.contrib' has no attribute 'eager'

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions