-
|
Hello I'm profiling an ETL written with pandas, my peak usage is 18 gb and 17 GB of it is 1 line "allocated at ???" this is not helpful at all, is this expected? how can I profile it better? reports by "PYTHONMALLOC=malloc" or "--leaks" doesn't change much. I can't share the result HTML because of safety reasons. but I wonder if this is a common phenomena or not. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
This happens if you are using Unfortunately there is nothing we can do on our side :( |
Beta Was this translation helpful? Give feedback.
This happens if you are using
--nativeand the libraries you are using don't have debug symbols available so it is not possible for us to resolve the name of the function where that happens. This can happen as well if you generate the binary dump in one machine and generate the flamegraph in another, because the second one won't have the shared objects, libraries or debug symbols that are necessary.Unfortunately there is nothing we can do on our side :(