-
Notifications
You must be signed in to change notification settings - Fork 4.5k
[Feature Request]: Remove need for tf.function in TF ModelHandler #23584
Copy link
Copy link
Closed
Labels
P2done & doneIssue has been reviewed after it was closed for verification, followups, etc.Issue has been reviewed after it was closed for verification, followups, etc.mlnew featurepythonrun-inference
Milestone
Description
What would you like to happen?
Right now, to use the Tensorflow model handler you need to take in a string tf.example. To support models that don't do this and take in something like a numpy array of floats, we currently recommend adding a tf.function (see https://github.com/apache/beam/blob/c36077a96a4691ca9000c8b243847ac6c7f82a74/examples/notebooks/beam-ml/run_inference_tensorflow.ipynb). We should automatically support this use case, and ideally do so more generally.
Issue Priority
Priority: 2
Issue Component
Component: run-inference
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
P2done & doneIssue has been reviewed after it was closed for verification, followups, etc.Issue has been reviewed after it was closed for verification, followups, etc.mlnew featurepythonrun-inference