gcp job retriever

[afumagalli98]

Create a scheduled job to retrieve instances data and add recommendations.

• retrieve all projects from GCP (query-1)

• for each project retrieve all instances (query-2)

• for each instance retrieve the average CPU utilization per day between the current date (*) and 90 days ago (query-3)

• for each instance retrieve max CPU utilization per minute between the current date (*) and 7 days ago (query-4)

• for each instance retrieve max memory utilization per minute between the current date (*) and 7 days ago (query-5)

• for each instance retrieve all disk (query-6)

• for each disk retrieve the max throughput write per day between the current date (*) and 5 days ago (query-7)

• for each disk retrieve the max throughput read per day between the current date (*) and 5 days ago (query-8)

• for each disk retrieve the max iops write per day between the current date (*) and 5 days ago (query-9)

• for each disk retrieve the max iops read per day between the current date (*) and 5 days ago (query-10)

*always starting from midnight

recommendation must be created if these conditions are satisfied:

• query-3 doesn't return a value > 0.5 at least for 3 times (configurable)
• query-4 doesn't return a value > 0.5 at least for 180 times
• query-5 doesn't return a value > 0.9 at least for 1 time
• query-7-8-9-10 return a value < the half of the disk limit**

**disk limit

the limits must be calculated based on this doc.
if the of the disk and vm is greater than the reference use the reference value as the disk limit