Skip to content

feat(ptv3): add a lidar segmentation model with onnx support #45

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 12 commits into
base: main
Choose a base branch
from

Conversation

knzo25
Copy link
Contributor

@knzo25 knzo25 commented May 19, 2025

Summary

this PR ports Pointcept's PTv3 with the following features:

  • t4dataset support
  • onnx deployment support
  • most of the original codebase removed since we only want ptv3

Change point

Same as the summary

Note

Since the onnx compatible spconv had to be modified, BEVFusion and other spconv dependent modules should be trained with spconv from now instead of mmcv's implementation

Test performed

Logs [TIER IV INTERNAL LINK]

[2025-04-25 02:10:16,386 INFO test.py line 339 2191] Val result: mIoU/mAcc/allAcc 0.7411/0.8754/0.9103
[2025-04-25 02:10:16,386 INFO test.py line 345 2191] Class_0 - vehicle Result: iou/accuracy 0.9688/0.9838
[2025-04-25 02:10:16,386 INFO test.py line 345 2191] Class_1 - bicycle Result: iou/accuracy 0.3464/0.8544
[2025-04-25 02:10:16,386 INFO test.py line 345 2191] Class_2 - pedestrian Result: iou/accuracy 0.6848/0.7068
[2025-04-25 02:10:16,386 INFO test.py line 345 2191] Class_3 - road Result: iou/accuracy 0.9278/0.9616
[2025-04-25 02:10:16,386 INFO test.py line 345 2191] Class_4 - vegetation Result: iou/accuracy 0.7076/0.8744
[2025-04-25 02:10:16,386 INFO test.py line 345 2191] Class_5 - obstacle Result: iou/accuracy 0.8111/0.8714

knzo25 and others added 12 commits April 16, 2025 00:26
…ve more and awml-fy it (can train/test)

Signed-off-by: Kenzo Lobos-Tsunekawa <[email protected]>
…neralize yet. no idea how many errors will appear in tensorrt yet

Signed-off-by: Kenzo Lobos-Tsunekawa <[email protected]>
 - limited range on eval
 - used max spatial shape throughout the network for tensorrt generalization. inference may have changed somewhat so may need to retrain

Signed-off-by: Kenzo Lobos-Tsunekawa <[email protected]>
Signed-off-by: Kenzo Lobos-Tsunekawa <[email protected]>
Signed-off-by: Kenzo Lobos-Tsunekawa <[email protected]>
Signed-off-by: Kenzo Lobos-Tsunekawa <[email protected]>
Signed-off-by: Kenzo Lobos-Tsunekawa <[email protected]>
Signed-off-by: Kenzo Lobos-Tsunekawa <[email protected]>
@amadeuszsz
Copy link
Collaborator

@knzo25
Sorry for late response!
Are you still able to run environment and deploy ONNX for latest model (link)? I followed your instruction in Readme file, but seems the deployment script doesn't work due to missing ConcatDataset (I guess the true issue lies somewhere else).

@scepter914
Copy link
Collaborator

Memo
As whole design of AWML, changes of this PR looks great to me.
I asked to review code-level for @amadeuszsz 🙏

@knzo25
Copy link
Contributor Author

knzo25 commented Jun 15, 2025

@amadeuszsz
Can you look for a model compatible with the one I submitted in autowarefoundation/autoware_universe#10600?

The one you provided is 5cm per voxel, but for "real time" I recommend the 10cm one

@amadeuszsz
Copy link
Collaborator

@amadeuszsz Can you look for a model compatible with the one I submitted in autowarefoundation/autoware_universe#10600?

The one you provided is 5cm per voxel, but for "real time" I recommend the 10cm one

@knzo25
I confirm that the two available models use a grid size of 5 cm. Apart from these models, I can't find anything else in provided documentation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants