I've found that when adding input data of any reasonable length the demo errors and in the console I see it's limited to just 2048 tokens:

ValueError: Input length of input_ids is 22711, but `max_length` is set to 2048. This can lead to unexpected behavior. You should consider increasing `max_length` or, better yet, setting `max_new_tokens`.

Is it possible to set the maximum input length at runtime or perhaps chunk the input data into <= 2048 tokens?

Neat demo!