Right now note inputs are stored in the advice map and are obtained from it only during the note::get_inputs procedure.

Since the number of the note inputs was moved to the memory as part of #1327 PR, we should decide does it worth it to move the entire note inputs to the memory the same way it is done to the note assets.