[Bug]: A follow-up on a non blocking task, will return an error

### What happened?

If a followup on an existing running task is sent in a non blocking fashion, the error 
`Execution finished before a message or task was produced.`
Is returned


### Relevant log output

```shell

```

### Code of Conduct

- [x] I agree to follow this project's Code of Conduct