feat(image-gen): support Codex reference-image edits on raw SSE path#33644
feat(image-gen): support Codex reference-image edits on raw SSE path#33644xiaoyaner0201 wants to merge 1 commit into
Conversation
aa77375 to
790b9dc
Compare
|
Thanks — agreed that this overlaps with #21463, #15308, and the closed #18805. I updated this PR so it is no longer presented as an independent competing direction. The intended positioning is a small current-
I did not add the broader provider capability contract from #15308 in this PR, to keep the patch focused on the current Codex provider path. The schema now documents that Happy to align with maintainer preference here: if maintainers would rather move #21463 forward, I can close this PR and extract only the raw-SSE + |
Summary
image_generatetool schema/dispatch path to acceptreference_imagesopenai-codexprovider as Responsesinput_imagecontenthttpxCodex Responses path frommaininstead of reverting to SDK stream parsingimage_generationtool toaction: editwhenever references are presentRelationship to prior PRs
This overlaps with earlier reference-image work:
reference_imagessupport via SDKclient.responses.stream(...)referencesfield /supports_referencesThis PR is intentionally narrower and updated for current
main/ Hermes 0.15:reference_images, matching feat(image_gen): add reference_images for image-to-image (openai-codex) #21463 / fix(image-gen): forward reference images to providers #18805 and the local Hermes 0.15 tool schema directionaction: "edit"when references are providedreference_imagesis currently honored byopenai-codex, while other backends may reject or ignore itFollow-ups can add provider-level capability advertisement / shared normalization helpers if maintainers prefer that broader direction.
Hermes 0.15 compatibility
main(0.15.1) instead of the older 0.14-era baseimage_gen.provider = "fal"routing through the FAL pluginimage_gen.modelforwarding unchangedactionis sent whenreference_imagesis absentTesting
python -m pytest tests/plugins/image_gen/test_openai_codex_provider.py tests/tools/test_image_generation_plugin_dispatch.py tests/tools/test_image_generation.py -q -o 'addopts='python -m py_compile plugins/image_gen/openai-codex/__init__.py tools/image_generation_tool.py tests/plugins/image_gen/test_openai_codex_provider.py tests/tools/test_image_generation_plugin_dispatch.py tests/tools/test_image_generation.pygit diff --checkhermes_cli.__version__ == "0.15.1"and verifiedimage_generateexposesreference_images