Skip to content

Latest commit

 

History

History
 
 

leofs

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 

LeoFS Input Plugin

The LeoFS plugin gathers metrics of LeoGateway, LeoManager, and LeoStorage using SNMP. See LeoFS Documentation / System Administration / System Monitoring.

Configuration:

# Sample Config:

[[inputs.leofs]]
        servers = ["127.0.0.1:4010"]

Measurements & Fields:

Statistics specific to the internals of LeoManager

Erlang VM

  • 1 min Statistics
    • num_of_processes
    • total_memory_usage
    • system_memory_usage
    • processes_memory_usage
    • ets_memory_usage
    • used_allocated_memory
    • allocated_memory
  • 5 min Statistics
    • num_of_processes_5min
    • total_memory_usage_5min
    • system_memory_usage_5min
    • processes_memory_usage_5min
    • ets_memory_usage_5min
    • used_allocated_memory_5min
    • allocated_memory_5min

Statistics specific to the internals of LeoStorage

Erlang VM

  • 1 min Statistics
    • num_of_processes
    • total_memory_usage
    • system_memory_usage
    • processes_memory_usage
    • ets_memory_usage
    • used_allocated_memory
    • allocated_memory
  • 5 min Statistics
    • num_of_processes_5min
    • total_memory_usage_5min
    • system_memory_usage_5min
    • processes_memory_usage_5min
    • ets_memory_usage_5min
    • used_allocated_memory_5min
    • allocated_memory_5min

Total Number of Requests

  • 1 min Statistics
    • num_of_writes
    • num_of_reads
    • num_of_deletes
  • 5 min Statistics
    • num_of_writes_5min
    • num_of_reads_5min
    • num_of_deletes_5min

Total Number of Objects and Total Size of Objects

  • num_of_active_objects
  • total_objects
  • total_size_of_active_objects
  • total_size

Total Number of MQ Messages

  • num_of_replication_messages,
  • num_of_sync-vnode_messages,
  • num_of_rebalance_messages,
  • mq_num_of_msg_recovery_node
  • mq_num_of_msg_deletion_dir
  • mq_num_of_msg_async_deletion_dir
  • mq_num_of_msg_req_deletion_dir
  • mq_mdcr_num_of_msg_req_comp_metadata
  • mq_mdcr_num_of_msg_req_sync_obj

Note: The following items are available since LeoFS v1.4.0:

  • mq_num_of_msg_recovery_node
  • mq_num_of_msg_deletion_dir
  • mq_num_of_msg_async_deletion_dir
  • mq_num_of_msg_req_deletion_dir
  • mq_mdcr_num_of_msg_req_comp_metadata
  • mq_mdcr_num_of_msg_req_sync_obj

Data Compaction

  • comp_state
  • comp_last_start_datetime
  • comp_last_end_datetime
  • comp_num_of_pending_targets
  • comp_num_of_ongoing_targets
  • comp_num_of_out_of_targets

Note: The all items are available since LeoFS v1.4.0.

Statistics specific to the internals of LeoGateway

Erlang VM

  • 1 min Statistics
    • num_of_processes
    • total_memory_usage
    • system_memory_usage
    • processes_memory_usage
    • ets_memory_usage
    • used_allocated_memory
    • allocated_memory
  • 5 min Statistics
    • num_of_processes_5min
    • total_memory_usage_5min
    • system_memory_usage_5min
    • processes_memory_usage_5min
    • ets_memory_usage_5min
    • used_allocated_memory_5min
    • allocated_memory_5min

Total Number of Requests

  • 1 min Statistics
    • num_of_writes
    • num_of_reads
    • num_of_deletes
  • 5 min Statistics
    • num_of_writes_5min
    • num_of_reads_5min
    • num_of_deletes_5min

Object Cache

  • count_of_cache-hit
  • count_of_cache-miss
  • total_of_files
  • total_cached_size

Tags:

All measurements have the following tags:

  • node

Example output:

LeoManager

$ ./telegraf --config ./plugins/inputs/leofs/leo_manager.conf --input-filter leofs --test
> leofs, host=manager_0, [email protected]
  allocated_memory=78255445,
  allocated_memory_5min=78159025,
  ets_memory_usage=4611900,
  ets_memory_usage_5min=4632599,
  num_of_processes=223,
  num_of_processes_5min=223,
  processes_memory_usage=20201316,
  processes_memory_usage_5min=20186559,
  system_memory_usage=37172701,
  system_memory_usage_5min=37189213,
  total_memory_usage=57373373,
  total_memory_usage_5min=57374653,
  used_allocated_memory=67,
  used_allocated_memory_5min=67
  1524105758000000000

LeoStorage

$ ./telegraf --config ./plugins/inputs/leofs/leo_storage.conf --input-filter leofs --test
> leofs,host=storage_0,[email protected]
  allocated_memory=63504384,
  allocated_memory_5min=0,
  comp_last_end_datetime=0,
  comp_last_start_datetime=0,
  comp_num_of_ongoing_targets=0,
  comp_num_of_out_of_targets=0,
  comp_num_of_pending_targets=8,
  comp_state=0,
  ets_memory_usage=3877824,
  ets_memory_usage_5min=0,
  mq_mdcr_num_of_msg_req_comp_metadata=0,
  mq_mdcr_num_of_msg_req_sync_obj=0,
  mq_num_of_msg_async_deletion_dir=0,
  mq_num_of_msg_deletion_dir=0,
  mq_num_of_msg_recovery_node=0,
  mq_num_of_msg_req_deletion_dir=0,
  num_of_active_objects=70,
  num_of_deletes=0,
  num_of_deletes_5min=0,
  num_of_processes=577,
  num_of_processes_5min=0,
  num_of_reads=1,
  num_of_reads_5min=0,
  num_of_rebalance_messages=0,
  num_of_replication_messages=0,
  num_of_sync-vnode_messages=0,
  num_of_writes=70,
  num_of_writes_5min=0,
  processes_memory_usage=20029464,
  processes_memory_usage_5min=0,
  system_memory_usage=25900472,
  system_memory_usage_5min=0,
  total_memory_usage=45920987,
  total_memory_usage_5min=0,
  total_objects=70,
  total_size=2,
  total_size_of_active_objects=2,
  used_allocated_memory=69,
  used_allocated_memory_5min=0
  1524529826000000000

LeoGateway

$ ./telegraf --config ./plugins/inputs/leofs/leo_gateway.conf --input-filter leofs --test
> leofs, host=gateway_0, [email protected]
  allocated_memory=87941120,
  allocated_memory_5min=88067672,
  count_of_cache-hit=0,
  count_of_cache-miss=0,
  ets_memory_usage=4843497,
  ets_memory_usage_5min=4841574,
  num_of_deletes=0,
  num_of_deletes_5min=0,
  num_of_processes=555,
  num_of_processes_5min=555,
  num_of_reads=0,
  num_of_reads_5min=0,
  num_of_writes=0,
  num_of_writes_5min=0,
  processes_memory_usage=17388052,
  processes_memory_usage_5min=17413928,
  system_memory_usage=49531263,
  system_memory_usage_5min=49577819,
  total_cached_size=0,
  total_memory_usage=66917393,
  total_memory_usage_5min=66989469,
  total_of_files=0,
  used_allocated_memory=69,
  used_allocated_memory_5min=69 1524105894000000000