InfluxDB OSS metrics

Get metrics about the workload performance of an InfluxDB OSS instance.

InfluxDB OSS exposes a /metrics endpoint that returns performance, resource, and usage metrics formatted in the Prometheus plain-text exposition format.

  1. GET http://localhost:8086/metrics

Metrics contain a name, an optional set of key-value pairs, and a value.

The following descriptors precede each metric:

Example

  1. # HELP go_info Information about the Go environment.
  2. # TYPE go_info gauge
  3. go_info{version="go1.17"} 1
  4. # HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.
  5. # TYPE go_memstats_alloc_bytes gauge
  6. go_memstats_alloc_bytes 2.27988488e+08
  7. # HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.
  8. # TYPE go_memstats_alloc_bytes_total counter
  9. go_memstats_alloc_bytes_total 9.68016566648e+11

The InfluxDB /metrics endpoint returns metrics associated with the following categories:

Boltdb statistics

Reads total

Total number of boltdb reads.

Example

  1. # HELP boltdb_reads_total Total number of boltdb reads
  2. # TYPE boltdb_reads_total counter
  3. boltdb_reads_total 75129

Writes total

Total number of boltdb writes.

Example

  1. # HELP boltdb_writes_total Total number of boltdb writes
  2. # TYPE boltdb_writes_total counter
  3. boltdb_writes_total 201591

Go runtime statistics

For more detail about Go runtime statistics, see the following:

GC (garbage collection) duration seconds

Summary of the pause duration of garbage collection cycles.

Example

  1. # HELP go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.
  2. # TYPE go_gc_duration_seconds summary
  3. go_gc_duration_seconds{quantile="0"} 5.1467e-05
  4. --

Goroutines

Number of goroutines that currently exist.

Example

  1. # HELP go_goroutines Number of goroutines that currently exist.
  2. # TYPE go_goroutines gauge
  3. go_goroutines 1566

Info

Information about the Go environment.

Example

  1. # HELP go_info Information about the Go environment.
  2. # TYPE go_info gauge
  3. go_info{version="go1.17"} 1

Memory allocated bytes

Number of bytes allocated and still in use.

Example

  1. # HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.
  2. # TYPE go_memstats_alloc_bytes gauge
  3. go_memstats_alloc_bytes 2.27988488e+08

Memory allocated bytes total

Total number of bytes allocated, even if freed.

Example

  1. # HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.
  2. # TYPE go_memstats_alloc_bytes_total counter
  3. go_memstats_alloc_bytes_total 9.68016566648e+11

Memory bucket hash system bytes

Number of bytes used by the profiling bucket hash table.

Example

  1. # HELP go_memstats_buck_hash_sys_bytes Number of bytes used by the profiling bucket hash table.
  2. # TYPE go_memstats_buck_hash_sys_bytes gauge
  3. go_memstats_buck_hash_sys_bytes 1.0067613e+07

Memory frees total

Total number of frees.

Example

  1. # HELP go_memstats_frees_total Total number of frees.
  2. # TYPE go_memstats_frees_total counter
  3. go_memstats_frees_total 1.3774541795e+10

Memory GC (garbage collection) CPU fraction

Fraction of this program’s available CPU time used by the GC since the program started.

Example

  1. # HELP go_memstats_gc_cpu_fraction The fraction of this program's available CPU time used by the GC since the program started.
  2. # TYPE go_memstats_gc_cpu_fraction gauge
  3. go_memstats_gc_cpu_fraction 0.011634918451016558

Memory GC (garbage collection) system bytes

Number of bytes used for garbage collection system metadata.

Example

  1. # HELP go_memstats_gc_sys_bytes Number of bytes used for garbage collection system metadata.
  2. # TYPE go_memstats_gc_sys_bytes gauge
  3. go_memstats_gc_sys_bytes 4.63048016e+08

Memory heap allocated bytes

Number of heap bytes allocated and still in use.

Example

  1. # HELP go_memstats_heap_alloc_bytes Number of heap bytes allocated and still in use.
  2. # TYPE go_memstats_heap_alloc_bytes gauge
  3. go_memstats_heap_alloc_bytes 2.27988488e+08

Memory heap idle bytes

Number of heap bytes waiting to be used.

Example

  1. # HELP go_memstats_heap_idle_bytes Number of heap bytes waiting to be used.
  2. # TYPE go_memstats_heap_idle_bytes gauge
  3. go_memstats_heap_idle_bytes 1.0918273024e+10

Memory heap in use bytes

Number of heap bytes that are in use.

Example

  1. # HELP go_memstats_heap_inuse_bytes Number of heap bytes that are in use.
  2. # TYPE go_memstats_heap_inuse_bytes gauge
  3. go_memstats_heap_inuse_bytes 3.5975168e+08

Memory heap objects

Number of allocated objects. Allocated heap objects include all reachable objects, as well as unreachable objects that the garbage collector has not yet freed.

Example

  1. # HELP go_memstats_heap_objects Number of allocated objects.
  2. # TYPE go_memstats_heap_objects gauge
  3. go_memstats_heap_objects 2.404017e+06

Memory heap released bytes

Number of heap bytes released to the OS.

Example

  1. # HELP go_memstats_heap_released_bytes Number of heap bytes released to OS.
  2. # TYPE go_memstats_heap_released_bytes gauge
  3. go_memstats_heap_released_bytes 2.095038464e+09

Memory heap system bytes

Number of heap bytes obtained from the system.

Example

  1. # HELP go_memstats_heap_sys_bytes Number of heap bytes obtained from system.
  2. # TYPE go_memstats_heap_sys_bytes gauge
  3. go_memstats_heap_sys_bytes 1.1278024704e+10

Memory last GC (garbage collection) time seconds

Number of seconds since 1970 of the last garbage collection.

Example

  1. # HELP go_memstats_last_gc_time_seconds Number of seconds since 1970 of last garbage collection.
  2. # TYPE go_memstats_last_gc_time_seconds gauge
  3. go_memstats_last_gc_time_seconds 1.64217120199452e+09

Memory lookups total

Total number of pointer lookups.

Example

  1. # HELP go_memstats_lookups_total Total number of pointer lookups.
  2. # TYPE go_memstats_lookups_total counter
  3. go_memstats_lookups_total 0

Memory allocations total

Cumulative count of heap objects allocated.

Example

  1. # HELP go_memstats_mallocs_total Total number of mallocs.
  2. # TYPE go_memstats_mallocs_total counter
  3. go_memstats_mallocs_total 1.3776945812e+10

Memory mcache in use bytes

Number of bytes in use by mcache structures.

Example

  1. # HELP go_memstats_mcache_inuse_bytes Number of bytes in use by mcache structures.
  2. # TYPE go_memstats_mcache_inuse_bytes gauge
  3. go_memstats_mcache_inuse_bytes 9600

Memory mcache system bytes

Number of bytes used for mcache structures obtained from system.

Example

  1. # HELP go_memstats_mcache_sys_bytes Number of bytes used for mcache structures obtained from system.
  2. # TYPE go_memstats_mcache_sys_bytes gauge
  3. go_memstats_mcache_sys_bytes 16384

Memory mspan in use bytes

Number of bytes of allocated mspan structures.

Example

  1. # HELP go_memstats_mspan_inuse_bytes Number of bytes in use by mspan structures.
  2. # TYPE go_memstats_mspan_inuse_bytes gauge
  3. go_memstats_mspan_inuse_bytes 4.199e+06

Memory mspan system bytes

Bytes of memory obtained from the OS for mspan structures.

Example

  1. # HELP go_memstats_mspan_sys_bytes Number of bytes used for mspan structures obtained from system.
  2. # TYPE go_memstats_mspan_sys_bytes gauge
  3. go_memstats_mspan_sys_bytes 1.65609472e+08

Memory next GC (garbage collection) bytes

Number of heap bytes when next garbage collection will take place.

Example

  1. # HELP go_memstats_next_gc_bytes Number of heap bytes when next garbage collection will take place.
  2. # TYPE go_memstats_next_gc_bytes gauge
  3. go_memstats_next_gc_bytes 4.45628016e+08

Memory other system bytes

Number of bytes used for other system allocations.

Example

  1. # HELP go_memstats_other_sys_bytes Number of bytes used for other system allocations.
  2. # TYPE go_memstats_other_sys_bytes gauge
  3. go_memstats_other_sys_bytes 8.1917722e+07

Memory stack in use bytes

Number of bytes in use by the stack allocator.

Example

  1. # HELP go_memstats_stack_inuse_bytes Number of bytes in use by the stack allocator.
  2. # TYPE go_memstats_stack_inuse_bytes gauge
  3. go_memstats_stack_inuse_bytes 8.84736e+06

Memory stack system bytes

Number of bytes obtained from system for stack allocator.

Example

  1. # HELP go_memstats_stack_sys_bytes Number of bytes obtained from system for stack allocator.
  2. # TYPE go_memstats_stack_sys_bytes gauge
  3. go_memstats_stack_sys_bytes 8.84736e+06

Memory system bytes

Number of bytes obtained from system.

Example

  1. # HELP go_memstats_sys_bytes Number of bytes obtained from system.
  2. # TYPE go_memstats_sys_bytes gauge
  3. go_memstats_sys_bytes 1.2007531271e+10

Threads

Number of OS threads created.

Example

  1. # HELP go_threads Number of OS threads created.
  2. # TYPE go_threads gauge
  3. go_threads 27

HTTP API statistics

API request duration seconds

How long InfluxDB took to respond to the HTTP request.

Example

  1. # HELP http_api_request_duration_seconds Time taken to respond to HTTP request
  2. # TYPE http_api_request_duration_seconds histogram
  3. http_api_request_duration_seconds_bucket{handler="platform",method="DELETE",path="/api/v2/authorizations/:id",response_code="204",status="2XX",user_agent="Chrome",le="0.005"} 0
  4. --

API requests total

Number of HTTP requests received.

Example

  1. # HELP http_api_requests_total Number of http requests received
  2. # TYPE http_api_requests_total counter
  3. http_api_requests_total{handler="platform",method="DELETE",path="/api/v2/authorizations/:id",response_code="204",status="2XX",user_agent="Chrome"} 1
  4. --

Query request bytes

Count of bytes received.

Example

  1. # HELP http_query_request_bytes Count of bytes received
  2. # TYPE http_query_request_bytes counter
  3. http_query_request_bytes{endpoint="/api/v2/query",org_id="48c88459ee424a04",status="200"} 727

Query request count

Total number of query requests.

Example

  1. # HELP http_query_request_count Total number of query requests
  2. # TYPE http_query_request_count counter
  3. http_query_request_count{endpoint="/api/v2/query",org_id="48c88459ee424a04",status="200"} 2

Query response bytes

Count of bytes returned by the query endpoint.

Example

  1. # HELP http_query_response_bytes Count of bytes returned
  2. # TYPE http_query_response_bytes counter
  3. http_query_response_bytes{endpoint="/api/v2/query",org_id="48c88459ee424a04",status="200"} 103

InfluxDB object and query statistics

Buckets total

Total number of buckets on the server.

Example

  1. # HELP influxdb_buckets_total Number of total buckets on the server
  2. # TYPE influxdb_buckets_total counter
  3. influxdb_buckets_total 9

Dashboards total

Total number of dashboards on the server.

Example

  1. # HELP influxdb_dashboards_total Number of total dashboards on the server
  2. # TYPE influxdb_dashboards_total counter
  3. influxdb_dashboards_total 2

Info

Information about the InfluxDB environment.

Example

  1. # HELP influxdb_info Information about the influxdb environment.
  2. # TYPE influxdb_info gauge
  3. influxdb_info{arch="amd64",build_date="2021-12-28T22:12:40Z",commit="657e1839de",cpus="8",os="darwin",version="v2.1.1"} 1

Organizations total

Total number of organizations on the server.

Example

  1. # HELP influxdb_organizations_total Number of total organizations on the server
  2. # TYPE influxdb_organizations_total counter
  3. influxdb_organizations_total 2

Replications total

Total number of replication configurations on the server

Example

  1. # HELP influxdb_replications_total Number of total replication configurations on the server
  2. # TYPE influxdb_replications_total counter
  3. influxdb_replications_total 1

Scrapers total

Total number of scrapers on the server.

Example

  1. # HELP influxdb_scrapers_total Number of total scrapers on the server
  2. # TYPE influxdb_scrapers_total counter
  3. influxdb_scrapers_total 0

Telegrafs total

Total number of Telegraf configurations on the server.

Example

  1. # HELP influxdb_telegrafs_total Number of total telegraf configurations on the server
  2. # TYPE influxdb_telegrafs_total counter
  3. influxdb_telegrafs_total 0

Token services total

Total number of API tokens on the server.

Example

  1. # HELP influxdb_tokens_total Number of total tokens on the server
  2. # TYPE influxdb_tokens_total counter
  3. influxdb_tokens_total 23

Uptime seconds

InfluxDB process uptime in seconds.

Example

  1. # HELP influxdb_uptime_seconds influxdb process uptime in seconds
  2. # TYPE influxdb_uptime_seconds gauge
  3. influxdb_uptime_seconds{id="077238f9ca108000"} 343354.914499305

Users total

Total number of users on the server.

Example

  1. # HELP influxdb_users_total Number of total users on the server
  2. # TYPE influxdb_users_total counter
  3. influxdb_users_total 84

QC (query controller) statistics

All active

Number of queries in all states.

Example

  1. # HELP qc_all_active Number of queries in all states
  2. # TYPE qc_all_active gauge
  3. qc_all_active{org="48c88459ee424a04"} 0
  4. --

All duration seconds

Total time spent in all query states.

Example

  1. # HELP qc_all_duration_seconds Histogram of total times spent in all query states
  2. # TYPE qc_all_duration_seconds histogram
  3. qc_all_duration_seconds_bucket{org="48c88459ee424a04",le="0.001"} 0
  4. --

Compiling active

Number of queries actively compiling.

Example

  1. # HELP qc_compiling_active Number of queries actively compiling
  2. # TYPE qc_compiling_active gauge
  3. qc_compiling_active{compiler_type="ast",org="ed32b47572a0137b"} 0
  4. --

Compiling duration seconds

Histogram of times spent compiling queries.

Example

  1. # HELP qc_compiling_duration_seconds Histogram of times spent compiling queries
  2. # TYPE qc_compiling_duration_seconds histogram
  3. qc_compiling_duration_seconds_bucket{compiler_type="ast",org="ed32b47572a0137b",le="0.001"} 999
  4. --

Executing active

Number of queries actively executing.

Example

  1. # HELP qc_executing_active Number of queries actively executing
  2. # TYPE qc_executing_active gauge
  3. qc_executing_active{org="48c88459ee424a04"} 0
  4. --

Executing duration seconds

Histogram of times spent executing queries.

Example

  1. # HELP qc_executing_duration_seconds Histogram of times spent executing queries
  2. # TYPE qc_executing_duration_seconds histogram
  3. qc_executing_duration_seconds_bucket{org="48c88459ee424a04",le="0.001"} 0
  4. --

Memory unused bytes

Free memory as seen by the internal memory manager.

Example

  1. # HELP qc_memory_unused_bytes The free memory as seen by the internal memory manager
  2. # TYPE qc_memory_unused_bytes gauge
  3. qc_memory_unused_bytes{org="48c88459ee424a04"} 0
  4. --

Queueing active

Number of queries actively queueing.

Example

  1. # HELP qc_queueing_active Number of queries actively queueing
  2. # TYPE qc_queueing_active gauge
  3. qc_queueing_active{org="48c88459ee424a04"} 0
  4. --

Queueing duration seconds

Histogram of times spent queueing queries.

Example

  1. # HELP qc_queueing_duration_seconds Histogram of times spent queueing queries
  2. # TYPE qc_queueing_duration_seconds histogram
  3. qc_queueing_duration_seconds_bucket{org="48c88459ee424a04",le="0.001"} 2
  4. --

Requests total

Count of the query requests.

Example

  1. # HELP qc_requests_total Count of the query requests
  2. # TYPE qc_requests_total counter
  3. qc_requests_total{org="48c88459ee424a04",result="success"} 2
  4. --

Read request duration

Histogram of times spent in read requests.

Example

  1. # HELP query_influxdb_source_read_request_duration_seconds Histogram of times spent in read requests
  2. # TYPE query_influxdb_source_read_request_duration_seconds histogram
  3. query_influxdb_source_read_request_duration_seconds_bucket{op="readTagKeys",org="48c88459ee424a04",le="0.001"} 0
  4. --

InfluxDB service statistics

Bucket service new call total

Number of calls to the bucket creation service.

Example

  1. # HELP service_bucket_new_call_total Number of calls
  2. # TYPE service_bucket_new_call_total counter
  3. service_bucket_new_call_total{method="find_bucket"} 6177
  4. --

Bucket service new duration

Duration of calls to the bucket creation service.

Example

  1. # HELP service_bucket_new_duration Duration of calls
  2. # TYPE service_bucket_new_duration histogram
  3. service_bucket_new_duration_bucket{method="find_bucket",le="0.005"} 5876
  4. --

Bucket service new error total

Number of errors encountered by the bucket creation service.

Example

  1. # HELP service_bucket_new_error_total Number of errors encountered
  2. # TYPE service_bucket_new_error_total counter
  3. service_bucket_new_error_total{code="not found",method="find_bucket_by_id"} 76

Onboard service new call total

Number of calls to the onboarding service.

Example

  1. # HELP service_onboard_new_call_total Number of calls
  2. # TYPE service_onboard_new_call_total counter
  3. service_onboard_new_call_total{method="is_onboarding"} 11

Onboard service new duration

Duration of calls to the onboarding service.

Example

  1. # HELP service_onboard_new_duration Duration of calls
  2. # TYPE service_onboard_new_duration histogram
  3. service_onboard_new_duration_bucket{method="is_onboarding",le="0.005"} 11
  4. --

Organization service call total

Number of calls to the organization service.

Example

  1. # HELP service_org_call_total Number of calls
  2. # TYPE service_org_call_total counter
  3. service_org_call_total{method="find_labels_for_resource"} 10

Organization service duration

Duration of calls to the organization service.

Example

  1. # HELP service_org_duration Duration of calls
  2. # TYPE service_org_duration histogram
  3. service_org_duration_bucket{method="find_labels_for_resource",le="0.005"} 10
  4. --

Organization service new call total

Number of calls to the organization creation service.

Example

  1. # HELP service_org_new_call_total Number of calls
  2. # TYPE service_org_new_call_total counter
  3. service_org_new_call_total{method="find_org"} 1572
  4. --

Organization service new duration

Duration of calls to the organization creation service.

Example

  1. # HELP service_org_new_duration Duration of calls
  2. # TYPE service_org_new_duration histogram
  3. service_org_new_duration_bucket{method="find_org",le="0.005"} 1475
  4. --

Organization service new error total

Number of errors encountered by the organization creation service.

Example

  1. # HELP service_org_new_error_total Number of errors encountered
  2. # TYPE service_org_new_error_total counter
  3. service_org_new_error_total{code="not found",method="find_orgs"} 1

Password service new call total

Number of calls to the password creation service.

Example

  1. # HELP service_password_new_call_total Number of calls
  2. # TYPE service_password_new_call_total counter
  3. service_password_new_call_total{method="compare_password"} 4

Password service new duration

Duration of calls to the password creation service.

Example

  1. # HELP service_password_new_duration Duration of calls
  2. # TYPE service_password_new_duration histogram
  3. service_password_new_duration_bucket{method="compare_password",le="0.005"} 0
  4. --

Password service new error total

Number of errors encountered by the password creation service.

Example

  1. # HELP service_password_new_error_total Number of errors encountered
  2. # TYPE service_password_new_error_total counter
  3. service_password_new_error_total{code="forbidden",method="compare_password"} 1

Pkger service call total

Number of calls to the pkger service.

Example

  1. # HELP service_pkger_call_total Number of calls
  2. # TYPE service_pkger_call_total counter
  3. service_pkger_call_total{method="export"} 3

Pkger service duration

Duration of calls to the pkger service.

Example

  1. # HELP service_pkger_duration Duration of calls
  2. # TYPE service_pkger_duration histogram
  3. service_pkger_duration_bucket{method="export",le="0.005"} 0
  4. --

Pkger service template export

Metrics for exported resources.

Example

  1. # HELP service_pkger_template_export Metrics for resources being exported
  2. # TYPE service_pkger_template_export counter
  3. service_pkger_template_export{buckets="0",by_stack="false",checks="0",dashboards="0",endpoints="0",label_mappings="0",labels="0",method="export",num_org_ids="1",rules="0",tasks="0",telegraf_configs="0",variables="0"} 3

Replication service call total

Number of calls to the replication service.

Example

  1. # HELP service_replication_call_total Number of calls
  2. # TYPE service_replication_call_total counter
  3. service_replication_call_total{method="find_replications"} 1

Replication service call duration

Duration of calls to the replication service.

Example

  1. # HELP service_replication_duration Duration of calls
  2. # TYPE service_replication_duration histogram
  3. service_replication_duration_bucket{method="create_replication",le="0.005"} 0
  4. service_replication_duration_bucket{method="find_replications",le="0.005"} 1

Replication queue total points queued

Sum of all points that have been successfully added to the replication stream queue.

Example

  1. # HELP replications_queue_total_points_queued Sum of all points
  2. # TYPE replications_queue_total_points_queued Counter
  3. replications_queue_total_points_queued

Replications queue total bytes queued

Sum of all bytes that have been successfully added to the replication stream queue.

Example

  1. # HELP replications_queue_total_bytes_queued Sum of all bytes that have been successfully added to the replication stream queue
  2. # TYPE replications_queue_total_bytes_queued counter
  3. replications_queue_total_bytes_queued{replicationID="0cd2cd54e9fe9000"} 289

Replications queue current bytes queued

Current number of bytes in the replication stream queue remaining to be processed.

Example

  1. # HELP replications_queue_current_bytes_queued Current number of bytes in the replication stream queue remaining to be processed
  2. # TYPE replications_queue_current_bytes_queued gauge
  3. replications_queue_current_bytes_queued{replicationID="0cd2cd54e9fe9000"} 297

Replications queue remote write errors

Error codes returned from attempted remote writes.

Example

  1. # HELP replications_queue_remote_write_errors Error codes returned from attempted remote writes
  2. # TYPE replications_queue_remote_write_errors counter
  3. replications_queue_remote_write_errors{code="404",replicationID="0cd2cd54e9fe9000"} 11

Replications queue remote write bytes sent

Bytes of data successfully sent to the remote by the replication stream.

Example

  1. # HELP replications_queue_remote_write_bytes_sent Bytes of data successfully sent to the remote by the replication stream
  2. # TYPE replications_queue_remote_write_bytes_sent counter
  3. replications_queue_remote_write_bytes_sent{...}

Replications queue

Bytes of data dropped due to remote write failures.

Example

  1. # HELP replications_queue_remote_write_bytes_dropped Bytes of data dropped due to remote write failures
  2. # TYPE replications_queue_remote_write_bytes_dropped counter
  3. replications_queue_remote_write_bytes_dropped{...}

Replications queue

Sum of all points that could not be added to the local replication queue.

Example

  1. # HELP replications_queue_points_failed_to_queue
  2. # TYPE replications_queue_points_failed_to_queue
  3. replications_queue_points_failed_to_queue{...}

Replications queue

Sum of all bytes that could not be added to the local replication queue.

Example

  1. # HELP replications_queue_bytes_failed_to_queue Sum of all bytes that could not be added to the local replication queue
  2. # TYPE replications_queue_bytes_failed_to_queue counter
  3. replications_queue_bytes_failed_to_queue{...}

Session service call total

Number of calls to the session service.

Example

  1. # HELP service_session_call_total Number of calls
  2. # TYPE service_session_call_total counter
  3. service_session_call_total{method="create_session"} 3
  4. --

Session service duration

Duration of calls to the session service.

Example

  1. # HELP service_session_duration Duration of calls
  2. # TYPE service_session_duration histogram
  3. service_session_duration_bucket{method="create_session",le="0.005"} 3
  4. --

Session service error total

Number of errors encountered by the session service.

Example

  1. # HELP service_session_error_total Number of errors encountered
  2. # TYPE service_session_error_total counter
  3. service_session_error_total{code="not found",method="find_session"} 4

Token service call total

Number of calls to the token service.

Example

  1. # HELP service_token_call_total Number of calls
  2. # TYPE service_token_call_total counter
  3. service_token_call_total{method="delete_authorization"} 3
  4. --

Token service duration

Duration of calls to the token service.

Example

  1. # HELP service_token_duration Duration of calls
  2. # TYPE service_token_duration histogram
  3. service_token_duration_bucket{method="delete_authorization",le="0.005"} 1
  4. --

Token service error total

Number of errors encountered by the token service.

Example

  1. # HELP service_token_error_total Number of errors encountered
  2. # TYPE service_token_error_total counter
  3. service_token_error_total{code="not found",method="delete_authorization"} 1

URM new call total

Number of calls to the URM (unified resource management) creation service.

Example

  1. # HELP service_urm_new_call_total Number of calls
  2. # TYPE service_urm_new_call_total counter
  3. service_urm_new_call_total{method="find_urms"} 6451

urm new duration

Duration of calls to the URM creation service.

Example

  1. # HELP service_urm_new_duration Duration of calls
  2. # TYPE service_urm_new_duration histogram
  3. service_urm_new_duration_bucket{method="find_urms",le="0.005"} 6198
  4. --

User new call total

Number of calls to the user creation service.

Example

  1. # HELP service_user_new_call_total Number of calls
  2. # TYPE service_user_new_call_total counter
  3. service_user_new_call_total{method="find_permission_for_user"} 4806
  4. --

User new duration

Duration of calls to the user creation service.

Example

  1. # HELP service_user_new_duration Duration of calls
  2. # TYPE service_user_new_duration histogram
  3. service_user_new_duration_bucket{method="find_permission_for_user",le="0.005"} 4039
  4. --

InfluxDB storage statistics

To learn how InfluxDB writes, stores, and caches data, see InfluxDB storage engine.

Bucket measurement number

Number of measurements in a bucket.

Example

  1. # HELP storage_bucket_measurement_num Gauge of measurement cardinality per bucket
  2. # TYPE storage_bucket_measurement_num gauge
  3. storage_bucket_measurement_num{bucket="0c3dd7d2d97f4b23"} 4
  4. --

Bucket series number

Number of series in a bucket.

Example

  1. # HELP storage_bucket_series_num Gauge of series cardinality per bucket
  2. # TYPE storage_bucket_series_num gauge
  3. storage_bucket_series_num{bucket="0c3dd7d2d97f4b23"} 38
  4. --

Cache disk bytes

Size (in bytes) of the most recent snapshot.

Example

  1. # HELP storage_cache_disk_bytes Gauge of size of most recent snapshot
  2. # TYPE storage_cache_disk_bytes gauge
  3. storage_cache_disk_bytes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

Cache in use bytes

Current memory consumption (in bytes) of the cache.

Example

  1. # HELP storage_cache_inuse_bytes Gauge of current memory consumption of cache
  2. # TYPE storage_cache_inuse_bytes gauge
  3. storage_cache_inuse_bytes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

Cache latest snapshot

Unix time of the most recent snapshot.

Example

  1. # HELP storage_cache_latest_snapshot Unix time of most recent snapshot
  2. # TYPE storage_cache_latest_snapshot gauge
  3. storage_cache_latest_snapshot{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 1.644269658196893e+09
  4. --

Cache writes with dropped points

Cumulative number of cached writes that had rejected points. Writes with rejected points also increment the write errors counter (storage_cache_writes_err).

Example

  1. # HELP storage_cache_writes_dropped Counter of writes to cache with some dropped points
  2. # TYPE storage_cache_writes_dropped counter
  3. storage_cache_writes_dropped{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

Cache writes failed

Cumulative number of cached writes that failed, inclusive of cache writes with dropped points (storage_cache_writes_dropped).

Example

  1. # HELP storage_cache_writes_err Counter of failed writes to cache
  2. # TYPE storage_cache_writes_err counter
  3. storage_cache_writes_err{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

Cache writes total

Cumulative number of writes to cache.

Example

  1. # HELP storage_cache_writes_total Counter of all writes to cache
  2. # TYPE storage_cache_writes_total counter
  3. storage_cache_writes_total{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

Compactions active

Currently running TSM compactions (by level).

Example

  1. # HELP storage_compactions_active Gauge of compactions (by level) currently running
  2. # TYPE storage_compactions_active gauge
  3. storage_compactions_active{bucket="ec3f82d1de90eddf",engine="tsm1",id="565",level="1",path="/Users/me/.influxdbv2/engine/data/ec3f82d1de90eddf/autogen/565",walPath="/Users/me/.influxdbv2/engine/wal/ec3f82d1de90eddf/autogen/565"} 0
  4. --

Compactions since startup

TSM compactions (by level) since startup.

Example

  1. # HELP storage_compactions_duration_seconds Histogram of compactions by level since startup
  2. # TYPE storage_compactions_duration_seconds histogram
  3. storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="60"} 1
  4. storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="600"} 1
  5. storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="6000"} 1
  6. storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="+Inf"} 1
  7. storage_compactions_duration_seconds_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567"} 0.167250668
  8. storage_compactions_duration_seconds_count{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567"} 1
  9. --

Compactions failed

Failed TSM compactions (by level).

Example

  1. # HELP storage_compactions_failed Counter of TSM compactions (by level) that have failed due to error
  2. # TYPE storage_compactions_failed counter
  3. storage_compactions_failed{bucket="ec3f82d1de90eddf",engine="tsm1",id="565",level="1",path="/Users/me/.influxdbv2/engine/data/ec3f82d1de90eddf/autogen/565",walPath="/Users/me/.influxdbv2/engine/wal/ec3f82d1de90eddf/autogen/565"} 0
  4. --

Compactions queued

Queued TSM compactions (by level).

Example

  1. # HELP storage_compactions_queued Counter of TSM compactions (by level) that are currently queued
  2. # TYPE storage_compactions_queued gauge
  3. storage_compactions_queued{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="1",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567"} 0
  4. --

Retention check duration

Retention policy check duration (in seconds).

Example

  1. # HELP storage_retention_check_duration Histogram of duration of retention check (in seconds)
  2. # TYPE storage_retention_check_duration histogram
  3. storage_retention_check_duration_bucket{le="0.005"} 1
  4. storage_retention_check_duration_bucket{le="0.01"} 1
  5. storage_retention_check_duration_bucket{le="0.025"} 1
  6. storage_retention_check_duration_bucket{le="0.05"} 1
  7. storage_retention_check_duration_bucket{le="0.1"} 1
  8. storage_retention_check_duration_bucket{le="0.25"} 1
  9. storage_retention_check_duration_bucket{le="0.5"} 1
  10. storage_retention_check_duration_bucket{le="1"} 1
  11. storage_retention_check_duration_bucket{le="2.5"} 1
  12. storage_retention_check_duration_bucket{le="5"} 1
  13. storage_retention_check_duration_bucket{le="10"} 1
  14. storage_retention_check_duration_bucket{le="+Inf"} 1
  15. storage_retention_check_duration_sum 0.000351857
  16. storage_retention_check_duration_count 1
  17. --

Shard disk size

Disk size (in bytes) of the shard.

Example

  1. # HELP storage_shard_disk_size Gauge of the disk size for the shard
  2. # TYPE storage_shard_disk_size gauge
  3. storage_shard_disk_size{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 4.188743e+06
  4. --

Shard fields created

Number of shard fields created.

Example

  1. # HELP storage_shard_fields_created Counter of the number of fields created
  2. # TYPE storage_shard_fields_created counter
  3. storage_shard_fields_created{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

Shard series

Number of series in the shard index.

Example

  1. # HELP storage_shard_series Gauge of the number of series in the shard index
  2. # TYPE storage_shard_series gauge
  3. storage_shard_series{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 38
  4. --

Shard writes

Number of shard write requests.

Example

  1. # HELP storage_shard_write_count Count of the number of write requests
  2. # TYPE storage_shard_write_count counter
  3. storage_shard_write_count{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

Shard dropped points

Number of rejected points in shard writes.

Example

  1. # HELP storage_shard_write_dropped_sum Counter of the number of points dropped
  2. # TYPE storage_shard_write_dropped_sum counter
  3. storage_shard_write_dropped_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

Shard writes with errors

Number of shard write requests with errors.

Example

  1. # HELP storage_shard_write_err_count Count of the number of write requests with errors
  2. # TYPE storage_shard_write_err_count counter
  3. storage_shard_write_err_count{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

Points in shard writes with errors

Number of points in shard write requests with errors.

Example

  1. # HELP storage_shard_write_err_sum Counter of the number of points for write requests with errors
  2. # TYPE storage_shard_write_err_sum counter
  3. storage_shard_write_err_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

Points in shard writes

Number of points in shard write requests.

Example

  1. # HELP storage_shard_write_sum Counter of the number of points for write requests
  2. # TYPE storage_shard_write_sum counter
  3. storage_shard_write_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

Shard data size

Gauge of the data size (in bytes) for each shard.

Example

  1. # HELP storage_tsm_files_disk_bytes Gauge of data size in bytes for each shard
  2. # TYPE storage_tsm_files_disk_bytes gauge
  3. storage_tsm_files_disk_bytes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 4.188743e+06
  4. --

Shard files

Number of files per shard.

Example

  1. # HELP storage_tsm_files_total Gauge of number of files per shard
  2. # TYPE storage_tsm_files_total gauge
  3. storage_tsm_files_total{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 1
  4. --

WAL size

WAL size (in bytes).

Example

  1. # HELP storage_wal_size Gauge of size of WAL in bytes
  2. # TYPE storage_wal_size gauge
  3. storage_wal_size{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

WAL write attempts

Cumulative number of write attempts to the WAL.

Example

  1. # HELP storage_wal_writes Number of write attempts to the WAL
  2. # TYPE storage_wal_writes counter
  3. storage_wal_writes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

WAL failed write attempts

Cumulative number of failed write attempts to the WAL.

Example

  1. # HELP storage_wal_writes_err Number of failed write attempts to the WAL
  2. # TYPE storage_wal_writes_err counter
  3. storage_wal_writes_err{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
  4. --

Points dropped due to partial writes

Number of points dropped due to partial writes.

Example

  1. # HELP storage_writer_dropped_points Histogram of number of points dropped due to partial writes
  2. # TYPE storage_writer_dropped_points histogram
  3. storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 0
  4. storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 0
  5. storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 0
  6. storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 0
  7. storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 0
  8. storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 0
  9. storage_writer_dropped_points_sum{path="/Users/me/.influxdbv2/engine"} 0
  10. storage_writer_dropped_points_count{path="/Users/me/.influxdbv2/engine"} 0
  11. --

Points in shard write requests with errors

Number of points in shard write requests with errors.

Example

  1. # HELP storage_writer_err_points Histogram of number of points in errored shard write requests
  2. # TYPE storage_writer_err_points histogram
  3. storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 0
  4. storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 0
  5. storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 0
  6. storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 0
  7. storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 0
  8. storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 0
  9. storage_writer_err_points_sum{path="/Users/me/.influxdbv2/engine"} 0
  10. storage_writer_err_points_count{path="/Users/me/.influxdbv2/engine"} 0
  11. --

Points in successful shard write requests

Number of points in successful shard write requests.

Example

  1. # HELP storage_writer_ok_points Histogram of number of points in successful shard write requests
  2. # TYPE storage_writer_ok_points histogram
  3. storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 6
  4. storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 6
  5. storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 8
  6. storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 20
  7. storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 24
  8. storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 24
  9. storage_writer_ok_points_sum{path="/Users/me/.influxdbv2/engine"} 125787
  10. storage_writer_ok_points_count{path="/Users/me/.influxdbv2/engine"} 24
  11. --

Points in write requests

Number of points in write requests.

Example

  1. # HELP storage_writer_req_points Histogram of number of points requested to be written
  2. # TYPE storage_writer_req_points histogram
  3. storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 6
  4. storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 6
  5. storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 6
  6. storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 14
  7. storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 18
  8. storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 18
  9. storage_writer_req_points_sum{path="/Users/me/.influxdbv2/engine"} 125787
  10. storage_writer_req_points_count{path="/Users/me/.influxdbv2/engine"} 18
  11. --

Shard write request timeouts

Cumulative number of shard write request timeouts.

Example

  1. # HELP storage_writer_timeouts Number of shard write request timeouts
  2. # TYPE storage_writer_timeouts counter
  3. storage_writer_timeouts{path="/Users/me/.influxdbv2/engine"} 0
  4. --

InfluxDB task statistics

Task executor errors

Number of errors thrown by the executor with the type of error (ex. Invalid, Internal, etc.)

Example

  1. # HELP task_executor_errors_counter The number of errors thrown by the executor with the type of error (ex. Invalid, Internal, etc.)
  2. # TYPE task_executor_errors_counter counter
  3. task_executor_errors_counter{errorType="internal error",task_type="system"} 1183
  4. --

Task executor promise queue usage

Percent of the promise queue that is currently full.

Example

  1. # HELP task_executor_promise_queue_usage Percent of the promise queue that is currently full
  2. # TYPE task_executor_promise_queue_usage gauge
  3. task_executor_promise_queue_usage 0

Task executor run duration

Duration (in seconds) between a task run starting and finishing.

Example

  1. # HELP task_executor_run_duration The duration in seconds between a run starting and finishing.
  2. # TYPE task_executor_run_duration summary
  4. task_executor_run_duration{taskID="08017725990f6000",task_type="",quantile="0.5"} 0.865043855
  5. task_executor_run_duration{taskID="08017725990f6000",task_type="",quantile="0.9"} 0.865043855
  6. task_executor_run_duration{taskID="08017725990f6000",task_type="",quantile="0.99"} 0.865043855
  7. task_executor_run_duration_sum{taskID="08017725990f6000",task_type=""} 1.524920552
  8. task_executor_run_duration_count{taskID="08017725990f6000",task_type=""} 2
  9. --

Task executor run latency seconds

Latency between the task run’s scheduled start time and the execution time, by task type.

Example

  1. # HELP task_executor_run_latency_seconds Records the latency between the time the run was due to run and the time the task started execution, by task type
  2. # TYPE task_executor_run_latency_seconds histogram
  3. task_executor_run_latency_seconds_bucket{task_type="system",le="0.005"} 0
  4. task_executor_run_latency_seconds_bucket{task_type="system",le="0.01"} 0
  5. task_executor_run_latency_seconds_bucket{task_type="system",le="0.025"} 0
  6. task_executor_run_latency_seconds_bucket{task_type="system",le="0.05"} 0
  7. task_executor_run_latency_seconds_bucket{task_type="system",le="0.1"} 0
  8. task_executor_run_latency_seconds_bucket{task_type="system",le="0.25"} 2
  9. task_executor_run_latency_seconds_bucket{task_type="system",le="0.5"} 6
  10. task_executor_run_latency_seconds_bucket{task_type="system",le="1"} 6
  11. task_executor_run_latency_seconds_bucket{task_type="system",le="2.5"} 6
  12. task_executor_run_latency_seconds_bucket{task_type="system",le="5"} 6
  13. task_executor_run_latency_seconds_bucket{task_type="system",le="10"} 6
  14. task_executor_run_latency_seconds_bucket{task_type="system",le="+Inf"} 6
  15. task_executor_run_latency_seconds_sum{task_type="system"} 2.237636
  16. task_executor_run_latency_seconds_count{task_type="system"} 6
  17. --

Task executor run queue delta

Duration (in seconds) between the task run’s scheduled start time and the execution time.

Example

  1. # HELP task_executor_run_queue_delta The duration in seconds between a run being due to start and actually starting.
  2. # TYPE task_executor_run_queue_delta summary
  3. task_executor_run_queue_delta{taskID="08017725990f6000",task_type="",quantile="0.5"} 0.324742
  4. task_executor_run_queue_delta{taskID="08017725990f6000",task_type="",quantile="0.9"} 0.324742
  5. task_executor_run_queue_delta{taskID="08017725990f6000",task_type="",quantile="0.99"} 0.324742
  6. task_executor_run_queue_delta_sum{taskID="08017725990f6000",task_type=""} 0.674875
  7. task_executor_run_queue_delta_count{taskID="08017725990f6000",task_type=""} 2
  8. --

Task executor total runs active

Number of workers currently running tasks.

Example

  1. # HELP task_executor_total_runs_active Total number of workers currently running tasks
  2. # TYPE task_executor_total_runs_active gauge
  3. task_executor_total_runs_active 0

Task executor total runs complete

Number of task runs completed across all tasks, split out by success or failure.

Example

  1. # HELP task_executor_total_runs_complete Total number of runs completed across all tasks, split out by success or failure.
  2. # TYPE task_executor_total_runs_complete counter
  3. task_executor_total_runs_complete{status="failed",task_type="system"} 1384
  4. task_executor_total_runs_complete{status="success",task_type="system"} 6
  5. --

Task executor workers busy

Percent of total available workers that are currently busy.

Example

  1. # HELP task_executor_workers_busy Percent of total available workers that are currently busy
  2. # TYPE task_executor_workers_busy gauge
  3. task_executor_workers_busy 0

Task scheduler current execution

Number of tasks currently being executed.

Example

  1. # HELP task_scheduler_current_execution Number of tasks currently being executed
  2. # TYPE task_scheduler_current_execution gauge
  3. task_scheduler_current_execution 128

Task scheduler execute delta

Duration (in seconds) between a task run starting and finishing.

Example

  1. # HELP task_scheduler_execute_delta The duration in seconds between a run starting and finishing.
  2. # TYPE task_scheduler_execute_delta summary
  3. task_scheduler_execute_delta{quantile="0.5"} NaN
  4. --

Task scheduler schedule delay

Summary of the delay between when a task is scheduled to run and when it is told to execute.

Example

  1. # HELP task_scheduler_schedule_delay The duration between when a Item should be scheduled and when it is told to execute.
  2. # TYPE task_scheduler_schedule_delay summary
  3. task_scheduler_schedule_delay{quantile="0.5"} 120.001036
  4. task_scheduler_schedule_delay{quantile="0.9"} 120.001074
  5. task_scheduler_schedule_delay{quantile="0.99"} 120.001074
  6. task_scheduler_schedule_delay_sum 720.0033010000001
  7. task_scheduler_schedule_delay_count 6
  8. --

Task scheduler total execute failure

Number of times a scheduled task execution has failed.

Example

  1. # HELP task_scheduler_total_execute_failure Total number of times an execution has failed.
  2. # TYPE task_scheduler_total_execute_failure counter
  3. task_scheduler_total_execute_failure 0

Task scheduler total execution calls

Number of scheduled executions across all tasks.

Example

  1. # HELP task_scheduler_total_execution_calls Total number of executions across all tasks.
  2. # TYPE task_scheduler_total_execution_calls counter
  3. task_scheduler_total_execution_calls 4806

Task scheduler total release calls

Number of release requests.

Example

  1. # HELP task_scheduler_total_release_calls Total number of release requests.
  2. # TYPE task_scheduler_total_release_calls counter
  3. task_scheduler_total_release_calls 0

Task scheduler total schedule calls

Number of schedule requests.

Example

  1. # HELP task_scheduler_total_schedule_calls Total number of schedule requests.
  2. # TYPE task_scheduler_total_schedule_calls counter
  3. task_scheduler_total_schedule_calls 6

Task scheduler total schedule fails

Number of schedule requests that fail to schedule.

Example

  1. # HELP task_scheduler_total_schedule_fails Total number of schedule requests that fail to schedule.
  2. # TYPE task_scheduler_total_schedule_fails counter
  3. task_scheduler_total_schedule_fails 0

cpu memory metrics performance Prometheus storage usage