Resource recommendations

This section describes the compute and disk requirements that are recommended for Promscale, based on the ingest rate and retention.

Disk size per day: disk consumption per day based on the ingest rate.

Uncompressed buffer: disk consumed by uncompressed data before compression.

Total disk size: size of disk required to store the data based on the ingest rate and retention.

note

You can calculate the total disk size based on retention and ingest rates with this formula:

Total disk size = (Disk size per day based on the ingest rate * Retention in days) + Uncompressed buffer based on the ingest rate.

Metrics

Resource recommendation for ingestion using Prometheus remote-write.

Prometheus remote write

For optimal performance of remote_write to Promscale, use this Prometheus remote_write configuration:

remote_write:
  remote_timeout: 100s
  queue_config:
    capacity: 100000
    max_samples_per_send: 10000
    batch_send_deadline: 30s
    min_shards: 20
    max_shards: 20
    min_backoff: 100ms
    max_backoff: 10s

Compute recommendations for the Promscale connector and TimescaleDB are:

Disk recommendations for TimescaleDB are:

The default chunk interval is 8h

Traces

Resource recommendation for ingestion through OTLP (OpenTelemetry Line Procotol) gRPC endpoint.

OpenTelemetry Line Protocol

We recommend using the OpenTelemetry collector for ingesting the spans to Promscale. Use this configuration with the OTLP exporter and batch processor to help with retries for failed writes, and to batch the write requests to Promscale:

exporters:
  logging:
  otlp:
    endpoint: "<PROMSCALE_HOST>:<gRPC_PORT>"
    tls:
      insecure: true
    sending_queue:
      queue_size: 1000000
    timeout: 10s
processors:
  batch:
    send_batch_size: 4000
    send_batch_max_size: 4000
    timeout: 10s

Where:

• <PROMSCALE_HOST>: hostname of Promscale
• <gRPC_PORT>: gRPC port of Promscale. The default port is 9202.

Compute recommendations for the Promscale connector and TimescaleDB are:

Disk recommendations for TimescaleDB are:

The default chunk interval is 1h