Add semantic segmentation tutorial#136
Conversation
Signed-off-by: pepisg <pedro.gonzalez@eia.edu.co>
Signed-off-by: pepisg <pedro.gonzalez@eia.edu.co>
6def6a3 to
07bba12
Compare
SteveMacenski
left a comment
There was a problem hiding this comment.
Really just small stuff - thanks for this :-)
nav2_semantic_segmentation_demo/nav2_semantic_segmentation_demo/package.xml
Outdated
Show resolved
Hide resolved
nav2_semantic_segmentation_demo/nav2_semantic_segmentation_demo/CMakeLists.txt
Outdated
Show resolved
Hide resolved
nav2_semantic_segmentation_demo/semantic_segmentation_node/resource/semantic_segmentation_node
Show resolved
Hide resolved
nav2_semantic_segmentation_demo/semantic_segmentation_sim/package.xml
Outdated
Show resolved
Hide resolved
nav2_semantic_segmentation_demo/semantic_segmentation_node/README.md
Outdated
Show resolved
Hide resolved
nav2_semantic_segmentation_demo/semantic_segmentation_sim/config/nav2_params.yaml
Show resolved
Hide resolved
nav2_semantic_segmentation_demo/semantic_segmentation_node/config/ontology.yaml
Show resolved
Hide resolved
...segmentation_demo/semantic_segmentation_node/semantic_segmentation_node/segmentation_node.py
Outdated
Show resolved
Hide resolved
...segmentation_demo/semantic_segmentation_node/semantic_segmentation_node/segmentation_node.py
Outdated
Show resolved
Hide resolved
|
Question: I recently opened github.com/ros-navigation/navigation2.ai. Would parts of this fall into that? The costmap layer I know we've talked about (maybe submodule). But is the node sufficiently generic? It seems so. I might have a few more scrutiny comments on it for efficiency if adding to github.com/ros-navigation/navigation2.ai, but if its general (i.e. any ONNX file works) then I think that would be a good not-just-tutorial contribution :-) |
inference should work with any onnx file, though I think the input, output and confidence handling may not be the same for all models (ex: ultralytics YOLO), or users may not wanna use the max rule for selecting the confidence. For isntance, this node applies imagenet normalization to the input, but I'm not sure that all segmentation models would produce correct results with this. Do you have any other model you think users may wanna run? TBH I'd leave the node in the tutorial for now |
|
Ok :-) |
Signed-off-by: pepisg <pedro.gonzalez@eia.edu.co>
|
thanks for your review! i think i adressed most comments in both PRs |
goes with ros-navigation/docs.nav2.org#876