I added an alternate solution which lets you specify settings for the duration of generation in api via the override_settings:

{
  ...
  "override_settings": {"CLIP_stop_at_last_layers": 2},
  ...
}

This is much better. Thanks for your work.

Hi does this override_settings argument also allows for overriding other options? I need to override the hypernetwork

@aliencaocao Yes. See here:

So do I just pass sd_hypernetwork and the value into override settings? Because ive tried doing this and nothing is taking effect. I have both the CLIP last layer and sd_hypernetwork in the override settings, but only the CLIP one is taking effect. Im passing in the value as shown in the drop down. Currently i have to send the entire settings dict to /api/predict as if i modify the settings from UI.

@aliencaocao I am sorry that I was wrong.

This is the overriding part at the moment (see the comment). If we call shared.reload_hypernetworks() here, the hypernetwork override will take effect.

I see, so actually beside hypernet, most other settings that does not involve extra loading function can be overriden by this field in POST, correct?

I can confirm that show_progress_every_n_steps and show_progress_grid can be overrided.

You can find options in modules/shared.py and try to override something you need.

I see, thank you

Is it possible to get grid from api when batch size > 1?
Can't find this parameter