keyboard interrupt

[vihantyagi]

Does viztracer fail to create the result file if the software to be profiled is killed via keyboard interrupt ? I do not get any output in this case. Command I'm using: viztracer -o result.html script.py

My workaround that worked was to break out of all the threads and exiting all processes after a certain time but it also includes too many changes in my code. Is there a way to profile the code using viztracer if the code is killed manually (keyboard interrupt or just kill -9 pid) after some time ?

Thank you for your help

[gaogaotiantian]

It should save the result after keyboard interrupt.
Can you share your code to profile and the os you are working on? Also python and viztracer version.

[gaogaotiantian]

How many times did you click Ctrl+C?

[vihantyagi]

Twice. If I do it once it's just stuck there (at the last line in the above traceback).

[gaogaotiantian]

This is because your multi-process program can not be properly keyboard-interrupted. The first Ctrl+C raise the first KeyboardInterrupt and VizTracer is waiting for the subprocess to finish, but it can't. The second Ctrl+C stops the VizTracer so it won't be able to collect any information.

Without VizTracer, is your program be able to stop with a single Ctrl+C? VizTracer can't deal with a multi-process program that can't be properly stopped, because it requires some after-execution operations.

For a more formal program, you should try to achieve - the user can use Ctrl+C to exit the full program, but no exception is explicitly raised. The main process should catch that exception then properly terminate the subprocesses(by politely asking them or terminate them, not kill them).

[gaogaotiantian]

Can you try creating your Process with daemon=True?

[vihantyagi]

Yes you're right about the Ctrl+C issue (unable to kill with single Ctrl+C even without viztracer) you have described above. Setting the daemon = True worked for my sample script. I will update here if it works for the code I'm trying to profile after making relevant changes.

Thank you so much for your help and quick replies !

[vihantyagi]

Also another I had one more question. Is log_parse compatible with multiprocess ?

[gaogaotiantian]

Yes, log_sparse works with multiprocess.