Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is this an error in bin file creation? #36

Open
limih0212 opened this issue May 3, 2023 · 2 comments
Open

Is this an error in bin file creation? #36

limih0212 opened this issue May 3, 2023 · 2 comments

Comments

@limih0212
Copy link

limih0212 commented May 3, 2023

First of all, thank you for your project.

I converted waymo dataset to pkl file according to this guide.
And I created a bin file with your "generate_input_data.py".

When I used these bin files, the detection result did not reach your sample result.
Again, the detection results of your samples (seq_0_frame_101.bin and seq_0_frame_100.bin) were very good.

Is this an error in bin file creation?
If my PC environment was a problem, the detection results of seq_0_frame_101.bin and seq_0_frame_100.bin would not be as good as the sample.

The environment in which I created the bin file is as follows.
And I attach the bin file and the result that I used.

  • dataset: waymo open dataset v1.2.0
  • Waymo-open-dataset devkit: waymo-open-dataset-tf-2.11.0==1.5.0
  • Command
    ./build/centerpoint --pfeOnnxPath=models/pfe_baseline32000.onnx --rpnOnnxPath=models/rpn_baseline.onnx --savePath=results --filePath=lidars --fp16

Screenshot from 2023-05-03 17-31-01

seq_0_frame_197.bin.txt
seq_0_frame_197.zip

@mhmmdjafarg
Copy link

mhmmdjafarg commented Jul 26, 2023

I have same issue here, i use waymo dataset v1.4.2 with 10 Val tfrecord.
And got result from waymo_eval like this

OBJECT_TYPE_TYPE_VEHICLE_LEVEL_2/AP [0.26191792]
OBJECT_TYPE_TYPE_VEHICLE_LEVEL_2/APH [0.25024492]
OBJECT_TYPE_TYPE_VEHICLE_LEVEL_2/[email protected] [0.0]
OBJECT_TYPE_TYPE_PEDESTRIAN_LEVEL_2/AP [0.4423461]
OBJECT_TYPE_TYPE_PEDESTRIAN_LEVEL_2/APH [0.3565605]
OBJECT_TYPE_TYPE_PEDESTRIAN_LEVEL_2/[email protected] [0.0]
OBJECT_TYPE_TYPE_SIGN_LEVEL_2/AP [0.0]
OBJECT_TYPE_TYPE_SIGN_LEVEL_2/APH [0.0]
OBJECT_TYPE_TYPE_SIGN_LEVEL_2/[email protected] [0.0]
OBJECT_TYPE_TYPE_CYCLIST_LEVEL_2/AP [0.030788602]
OBJECT_TYPE_TYPE_CYCLIST_LEVEL_2/APH [0.028065205]
OBJECT_TYPE_TYPE_CYCLIST_LEVEL_2/[email protected] [0.0]

But the result is quite good if using your bin file
Please help @HaohaoNJU thank you

@mhmmdjafarg
Copy link

mhmmdjafarg commented Jul 26, 2023

Looks like your pkl file xyz is like this, (very small number)
Screen Shot 2023-07-27 at 00 22 15

while waymo have like this
Screen Shot 2023-07-27 at 00 22 28

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants