Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

With EXCLUDE_SWAPPER_PROCESS enabled, kepler reports VM power more than actually consumed by VM #1836

Open
sthaha opened this issue Nov 5, 2024 · 0 comments

Comments

@sthaha
Copy link
Collaborator

sthaha commented Nov 5, 2024

Setup

Deploy latest kepler with EXCLUDE_SWAPPER_PROCESS set to true on a baremetal

kepler-1  | I1105 04:34:34.940824  939885 config.go:267] EXCLUDE_SWAPPER_PROCESS: true

Test

  • Compare increase in node-exporter-rapl vs kepler_node_package vs kepler_vm_package

image

Note that the

  • green is rate(node_rapl_package_joules_total{job="metal-node-exporter"}[${rate}s])
  • red is sum(rate(kepler_node_package_joules_total{job="metal"}[${rate}s]))
  • blue is sum(rate(kepler_vm_package_joules_total{job="metal"}[${rate}s]))

Blue (which is fraction of the total power) is reported way higher than the increase in kepler-node-package watts
In the above example, the increase in watts reported by kepler_node_package is as below
image

It raise from 18.0 to 29.2 =~ 12 W

While kepler_vm_package watts is as follows

image

It raises from 0.9 to a max of 26.9 W

Additionally, `
abs(
sum(rate(kepler_process_package_joules_total{job="metal"}[20s])) -
sum(rate(kepler_node_package_joules_total{job="metal"}[20s]))
)

 shows that the difference is sometime as high as 6W 

![image](https://github.com/user-attachments/assets/2431d058-5ec7-4177-88a0-35dcc05bd39b)


@sthaha sthaha closed this as completed Nov 5, 2024
@sthaha sthaha changed the title With EXCLUDE_SWAPPER_PROCESS enabled, kepler reports VM power more than the Total node Power With EXCLUDE_SWAPPER_PROCESS enabled, kepler reports VM power more than actually consumed by VM Nov 5, 2024
@sthaha sthaha reopened this Nov 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant