In the cryptocell310 backend, I tested a change in the initialization code so that it only runs once after boot.
This reduced handshake time by ~80 milliseconds.
Here is the commit for that: geonnave@d58b2ae

The goal with this issue is to bring a similar change to the other crypto backends.