Skip to content

Definitions of Evaluation Results  #724

@ZiadElmassik

Description

@ZiadElmassik

Hello, I've evaluated both Second and MVXNet on some adverse weather conditions. However, I'm struggling to understand the format of the results. My problems are as follow:

  1. I understand that AP@0.70/0.50/0.25 means IOU thresholds of 70%, 50%, and 25%, respectively; meaning overlaps have to meet these thresholds to count as true positives then why is it that the 70% is labeled as easy not hard when it should be harder to achieve IOU of 70% then 50% and 50% than 25%?

  2. The results are divided into 4 categories: BBox, Bev, 3d, and aos. Some of these are familiar while others are not. BBox, I believe means the accuracy of estimating 2D boxes from the 3D boxes (please do correct me if I'm wrong). Bev means bird's eye view, though I'm not sure what it means in the context of object detection. 3d I believe means the accuracy of estimating 3D orientation but isn't that measured by aos?

  3. Finally, there are 2 sets of results for each class, "strict" and "loose". These terms are unfamiliar to me.

A detailed response would be greatly appreciated.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions