Not sure what you mean by event taxonomy. I found that this is an issue when I am logged into the backend, but disappears as soon as i log out.
Actually it works now. I had not added any people to the conference itself, just to the events. For some reason this needs to be done from both ends. After I added the people to the events, the columns are back to normal.