Skip to content

scripts to validate whether the performance of the deployed model matches that of its PyTorch model #216

@lvhan028

Description

@lvhan028

Motivation

As a part of the regression test, the performance of a deployed model should be checked if it is consistent with the performance of its PyTorch model. In other words, MMDeploy should test the metrics of a deployed model, and check if it matches the metrics reported by the PyTorch model.

Requirement

python scripts.py <args>

TODO
Discuss about proper args

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions