This is a feature request. Currently, Ray does not support experiments requesting GPU resources if the head node doesn't not have any a GPU. A workaround is to put a GPU on the head node, but this is expensive as the head should run as non-preemptible. I think #4600 was an attempt to fix this, but it doesn't work and there's still no cheap workaround.

@hartikainen @ericl