Background

Google's Vertex Image Models return extra information besides the images themselves. This pull request exposes that information as .providerMetaData.vertex.* on the generateImage() return object.

Example response

{
    predictions: [
        {
            mimeType: "image/png",
            prompt: "A vibrant, high-contrast image ...",
            bytesBase64Encoded: "iVBORw...",
        },
    ]
}

Summary

I updated the response schema for Vertex' Image Model API responses and set the .providerMetaData key to the return object of GoogleVertexImageModel#doGenerate().

Verification

I altered examples/ai-core/src/generate-image/google-vertex.ts

Tasks

• Tests have been added / updated (for bug fixes / features)
• Documentation has been added / updated (for bug fixes / features)
• A patch changeset for relevant packages has been added (for bug fixes / features - run pnpm changeset in the project root)
• Formatting issues have been fixed (run pnpm prettier-fix in the project root)

Related Issues

Part of #6405