InfluxDB frequently asked questions

This page addresses frequent sources of confusion and places where InfluxDB behaves in an unexpected way relative to other database systems. Where applicable, it links to outstanding issues on GitHub.

Administration

Command line interface (CLI)

Data types

InfluxQL functions

Querying data

Series and series cardinality

Writing data

How do I include a single quote in a password?

Escape the single quote with a backslash (\) both when creating the password and when sending authentication requests.

How can I identify my version of InfluxDB?

There a number of ways to identify the version of InfluxDB that you’re using:

Run influxd version in your terminal:

  1. $ influxd version
  3. InfluxDB ✨ v1.4.0 ✨ (git: master b7bb7e8359642b6e071735b50ae41f5eb343fd42)

curl the /ping endpoint:

  1. $ curl -i 'http://localhost:8086/ping'
  3. HTTP/1.1 204 No Content
  4. Content-Type: application/json
  5. Request-Id: 1e08aeb6-fec0-11e6-8486-000000000000
  6. ✨ X-Influxdb-Version: 1.4.x ✨
  7. Date: Wed, 01 Mar 2017 20:46:17 GMT

Launch the InfluxDB Command Line Interface:

  1. $ influx
  3. Connected to http://localhost:8086✨ version 1.4.x ✨
  4. InfluxDB shell version: 1.4.x

Check the HTTP response in your logs:

  1. $ journalctl -u influxdb.service
  3. Mar 01 20:49:45 rk-api influxd[29560]: [httpd] 127.0.0.1 - - [01/Mar/2017:20:49:45 +0000] "POST /query?db=&epoch=ns&q=SHOW+DATABASES HTTP/1.1" 200 151 "-" ✨ "InfluxDBShell/1.4.x" ✨ 9a4371a1-fec0-11e6-84b6-000000000000 1709

Where can I find InfluxDB logs?

On System V operating systems logs are stored under /var/log/influxdb/.

On systemd operating systems you can access the logs using journalctl. Use journalctl -u influxdb to view the logs in the journal or journalctl -u influxdb > influxd.log to print the logs to a text file. With systemd, log retention depends on your system’s journald settings.

What is the relationship between shard group durations and retention policies?

InfluxDB stores data in shard groups. A single shard group covers a specific time interval; InfluxDB determines that time interval by looking at the DURATION of the relevant retention policy (RP). The table below outlines the default relationship between the DURATION of an RP and the time interval of a shard group:

RP durationShard group interval
< 2 days1 hour
>= 2 days and <= 6 months1 day
> 6 months7 days

Users can also configure the shard group duration with the CREATE RETENTION POLICY and ALTER RETENTION POLICY statements. Check your retention policy’s shard group duration with the SHOW RETENTION POLICIES statement.

Why aren’t data dropped after I’ve altered a retention policy?

Several factors explain why data may not be immediately dropped after a retention policy (RP) change.

The first and most likely cause is that, by default, InfluxDB checks to enforce an RP every 30 minutes. You may need to wait for the next RP check for InfluxDB to drop data that are outside the RP’s new DURATION setting. The 30 minute interval is configurable.

Second, altering both the DURATION and SHARD DURATION of an RP can result in unexpected data retention. InfluxDB stores data in shard groups which cover a specific RP and time interval. When InfluxDB enforces an RP it drops entire shard groups, not individual data points. InfluxDB cannot divide shard groups.

If the RP’s new DURATION is less than the old SHARD DURATION and InfluxDB is currently writing data to one of the old, longer shard groups, the system is forced to keep all of the data in that shard group. This occurs even if some of the data in that shard group are outside of the new DURATION. InfluxDB will drop that shard group once all of its data is outside the new DURATION. The system will then begin writing data to shard groups that have the new, shorter SHARD DURATION preventing any further unexpected data retention.

Why does InfluxDB fail to parse microsecond units in the configuration file?

The syntax for specifying microsecond duration units differs for configuration settings, writes, queries, and setting the precision in the InfluxDB Command Line Interface (CLI). The table below shows the supported syntax for each category:

Configuration FileInfluxDB API WritesAll QueriesCLI Precision Command
u❌👍👍👍
us👍❌❌❌
µ❌❌👍❌
µs👍❌❌❌

If a configuration option specifies the u or µ syntax, InfluxDB fails to start and reports the following error in the logs:

  1. run: parse config: time: unknown unit [µ|u] in duration [<integer>µ|<integer>u]

Does InfluxDB have a file system size limit?

InfluxDB works within file system size restrictions for Linux and Windows POSIX. Some storage providers and distributions have size restrictions; for example:

  • Amazon EBS volume limits size to ~16TB
  • Linux ext3 file system limits size ~16TB
  • Linux ext4 file system limits size to ~1EB (with file size limit ~16TB)

If you anticipate growing over 16TB per volume/file system, we recommend finding a provider and distribution that supports your storage requirements.

How do I use the InfluxDB CLI to return human readable timestamps?

When you first connect to the CLI, specify the rfc3339 precision:

  1. influx -precision rfc3339

Alternatively, specify the precision once you’ve already connected to the CLI:

  1. $ influx
  2. Connected to http://localhost:8086 version 0.xx.x
  3. InfluxDB shell 0.xx.x
  4. > precision rfc3339
  5. >

Check out CLI/Shell for more useful CLI options.

How can a non-admin user USE a database in the InfluxDB CLI?

In versions prior to v1.3, non-admin users could not execute a USE <database_name> query in the CLI even if they had READ and/or WRITE permissions on that database.

Starting with version 1.3, non-admin users can execute the USE <database_name> query for databases on which they have READ and/or WRITE permissions. If a non-admin user attempts to USE a database on which the user doesn’t have READ and/or WRITE permissions, the system returns an error:

  1. ERR: Database <database_name> doesn't exist. Run SHOW DATABASES for a list of existing databases.

Note that the SHOW DATABASES query returns only those databases on which the non-admin user has READ and/or WRITE permissions.

How do I write to a non-DEFAULT retention policy with the InfluxDB CLI?

Use the syntax INSERT INTO [<database>.]<retention_policy> <line_protocol> to write data to a non-DEFAULT retention policy using the CLI. (Specifying the database and retention policy this way is only allowed with the CLI. Writes over HTTP must specify the database and optionally the retention policy with the db and rp query parameters.)

For example:

  1. > INSERT INTO one_day mortality bool=true
  2. Using retention policy one_day
  3. > SELECT * FROM "mydb"."one_day"."mortality"
  4. name: mortality
  5. ---------------
  6. time                             bool
  7. 2016-09-13T22:29:43.229530864Z   true

Note that you will need to fully qualify the measurement to query data in the non-DEFAULT retention policy. Fully qualify the measurement with the syntax:

  1. "<database>"."<retention_policy>"."<measurement>"

How do I cancel a long-running query?

You can cancel a long-running interactive query from the CLI using Ctrl+C. To stop other long-running query that you see when using the SHOW QUERIES command, you can use the KILL QUERY command to stop it.

Why can’t I query Boolean field values?

Acceptable Boolean syntax differs for data writes and data queries.

Boolean syntaxWritesQueries
t,f👍❌
T,F👍❌
true,false👍👍
True,False👍👍
TRUE,FALSE👍👍

For example, SELECT * FROM "hamlet" WHERE "bool"=True returns all points with bool set to TRUE, but SELECT * FROM "hamlet" WHERE "bool"=T returns nothing.

GitHub Issue #3939

How does InfluxDB handle field type discrepancies across shards?

Field values can be floats, integers, strings, or Booleans. Field value types cannot differ within a shard, but they can differ across shards.

The SELECT statement

The SELECT statement returns all field values if all values have the same type. If field value types differ across shards, InfluxDB first performs any applicable cast operations and then returns all values with the type that occurs first in the following list: float, integer, string, Boolean.

If your data have field value type discrepancies, use the syntax <field_key>::<type> to query the different data types.

Example

The measurement just_my_type has a single field called my_field. my_field has four field values across four different shards, and each value has a different data type (float, integer, string, and Boolean).

SELECT * returns only the float and integer field values. Note that InfluxDB casts the integer value to a float in the response.

  1. SELECT * FROM just_my_type
  3. name: just_my_type
  4. ------------------
  5. time                            my_field
  6. 2016-06-03T15:45:00Z      9.87034
  7. 2016-06-03T16:45:00Z      7

SELECT <field_key>::<type> [...] returns all value types. InfluxDB outputs each value type in its own column with incremented column names. Where possible, InfluxDB casts field values to another type; it casts the integer 7 to a float in the first column, and it casts the float 9.879034 to an integer in the second column. InfluxDB cannot cast floats or integers to strings or Booleans.

  1. SELECT "my_field"::float,"my_field"::integer,"my_field"::string,"my_field"::boolean FROM just_my_type
  3. name: just_my_type
  4. ------------------
  5. time                           my_field     my_field_1     my_field_2         my_field_3
  6. 2016-06-03T15:45:00Z     9.87034      9
  7. 2016-06-03T16:45:00Z     7            7
  8. 2016-06-03T17:45:00Z                                 a string
  9. 2016-06-03T18:45:00Z                                                    true

The SHOW FIELD KEYS query

SHOW FIELD KEYS returns every data type, across every shard, associated with the field key.

Example

The measurement just_my_type has a single field called my_field. my_field has four field values across four different shards, and each value has a different data type (float, integer, string, and Boolean). SHOW FIELD KEYS returns all four data types:

  1. > SHOW FIELD KEYS
  3. name: just_my_type
  4. fieldKey   fieldType
  5. --------   ---------
  6. my_field   float
  7. my_field   string
  8. my_field   integer
  9. my_field   boolean

What are the minimum and maximum integers that InfluxDB can store?

InfluxDB stores all integers as signed int64 data types. The minimum and maximum valid values for int64 are -9023372036854775808 and 9023372036854775807. See Go builtins for more information.

Values close to but within those limits may lead to unexpected results; some functions and operators convert the int64 data type to float64 during calculation which can cause overflow issues.

What are the minimum and maximum timestamps that InfluxDB can store?

The minimum timestamp is -9223372036854775806 or 1677-09-21T00:12:43.145224194Z. The maximum timestamp is 9223372036854775806 or 2262-04-11T23:47:16.854775806Z.

Timestamps outside that range return a parsing error.

How can I tell what type of data is stored in a field?

The SHOW FIELD KEYS query also returns the field’s type.

Example

  1. > SHOW FIELD KEYS FROM all_the_types
  2. name: all_the_types
  3. -------------------
  4. fieldKey  fieldType
  5. blue      string
  6. green     boolean
  7. orange    integer
  8. yellow    float

Can I change a field’s data type?

Currently, InfluxDB offers very limited support for changing a field’s data type.

The <field_key>::<type> syntax supports casting field values from integers to floats or from floats to integers. See Cast Operations for an example. There is no way to cast a float or integer to a string or Boolean (or vice versa).

We list possible workarounds for changing a field’s data type below. Note that these workarounds will not update data that have already been written to the database.

Write the data to a different field

The simplest workaround is to begin writing the new data type to a different field in the same series.

Work the shard system

Field value types cannot differ within a shard but they can differ across shards.

Users looking to change a field’s data type can use the SHOW SHARDS query to identify the end_time of the current shard. InfluxDB will accept writes with a different data type to an existing field if the point has a timestamp that occurs after that end_time.

Note that this will not change the field’s data type on prior shards. For how this will affect your queries, please see How does InfluxDB handle field type discrepancies across shards.

How do I perform mathematical operations within a function?

Currently, InfluxDB does not support mathematical operations within functions. We recommend using InfluxQL’s subqueries as a workaround.

Example

InfluxQL does not support the following syntax:

  1. SELECT MEAN("dogs" - "cats") from "pet_daycare"

Instead, use a subquery to get the same result:

  1. > SELECT MEAN("difference") FROM (SELECT "dogs" - "cat" AS "difference" FROM "pet_daycare")

See the Data Exploration page for more information.

Why does my query return epoch 0 as the timestamp?

In InfluxDB, epoch 0 (1970-01-01T00:00:00Z) is often used as a null timestamp equivalent. If you request a query that has no timestamp to return, such as an aggregation function with an unbounded time range, InfluxDB returns epoch 0 as the timestamp.

Which InfluxQL functions support nesting?

The following InfluxQL functions support nesting:

For information on how to use a subquery as a substitute for nested functions, see Data exploration.

What determines the time intervals returned by GROUP BY time() queries?

The time intervals returned by GROUP BY time() queries conform to the InfluxDB database’s preset time buckets or to the user-specified offset interval.

Example

Preset time buckets

The following query calculates the average value of sunflowers between 6:15pm and 7:45pm and groups those averages into one hour intervals:

  1. SELECT mean("sunflowers")
  2. FROM "flower_orders"
  3. WHERE time >= '2016-08-29T18:15:00Z' AND time <= '2016-08-29T19:45:00Z' GROUP BY time(1h)

The results below show how InfluxDB maintains its preset time buckets.

In this example, the 6pm hour is a preset bucket and the 7pm hour is a preset bucket. The average for the 6pm time bucket does not include data prior to 6:15pm because of the WHERE time clause, but any data included in the average for the 6pm time bucket must occur in the 6pm hour. The same goes for the 7pm time bucket; any data included in the average for the 7pm time bucket must occur in the 7pm hour. The dotted lines show the points that make up each average.

Note that while the first timestamp in the results is 2016-08-29T18:00:00Z, the query results in that bucket do not include data with timestamps that occur before the start of the WHERE time clause (2016-08-29T18:15:00Z).

Raw data:

Results:

  1. name: flower_orders                                name: flower_orders
  2. —————————                                          -------------------
  3. time                    sunflowers                 time                  mean
  4. 2016-08-29T18:00:00Z    34                         2016-08-29T18:00:00Z  22.332
  5.                        |--|                        2016-08-29T19:00:00Z  62.75
  6. 2016-08-29T18:15:00Z   |28|
  7. 2016-08-29T18:30:00Z   |19|
  8. 2016-08-29T18:45:00Z   |20|
  9.                        |--|
  10.                        |--|
  11. 2016-08-29T19:00:00Z   |56|
  12. 2016-08-29T19:15:00Z   |76|
  13. 2016-08-29T19:30:00Z   |29|
  14. 2016-08-29T19:45:00Z   |90|
  15.                        |--|
  16. 2016-08-29T20:00:00Z    70
Offset interval

The following query calculates the average value of sunflowers between 6:15pm and 7:45pm and groups those averages into one hour intervals. It also offsets the InfluxDB database’s preset time buckets by 15 minutes.

  1. SELECT mean("sunflowers")
  2. FROM "flower_orders"
  3. WHERE time >= '2016-08-29T18:15:00Z' AND time <= '2016-08-29T19:45:00Z' GROUP BY time(1h,15m)
  4.                                                                                          ---
  5.                                                                                           |
  6.                                                                                    offset interval

In this example, the user-specified offset interval shifts the InfluxDB database’s preset time buckets forward by 15 minutes. The average for the 6pm time bucket now includes data between 6:15pm and 7pm, and the average for the 7pm time bucket includes data between 7:15pm and 8pm. The dotted lines show the points that make up each average.

Note that the first timestamp in the result is 2016-08-29T18:15:00Z instead of 2016-08-29T18:00:00Z.

Raw data:

Results:

  1. name: flower_orders                                name: flower_orders
  2. —————————                                          -------------------
  3. time                    sunflowers                 time                  mean
  4. 2016-08-29T18:00:00Z    34                         2016-08-29T18:15:00Z  30.75
  5.                        |--|                        2016-08-29T19:15:00Z  65
  6. 2016-08-29T18:15:00Z   |28|
  7. 2016-08-29T18:30:00Z   |19|
  8. 2016-08-29T18:45:00Z   |20|
  9. 2016-08-29T19:00:00Z   |56|
  10.                        |--|
  11.                        |--|
  12. 2016-08-29T19:15:00Z   |76|
  13. 2016-08-29T19:30:00Z   |29|
  14. 2016-08-29T19:45:00Z   |90|
  15. 2016-08-29T20:00:00Z   |70|
  16.                        |--|

Why do my queries return no data or partial data?

The most common reasons why your query returns no data or partial data:

Querying the wrong retention policy

InfluxDB automatically queries data in a database’s DEFAULT retention policy](/influxdb/v1.8/concepts/glossary/#retention-policy-rp) (RP). If your data is stored in another RP, you must specify the RP in your query to get results.

No field key in the SELECT clause

A query requires at least one field key in the SELECT clause. If the SELECT clause includes only tag keys, the query returns an empty response. For more information, see Data exploration.

SELECT query includes GROUP BY time()

If your SELECT query includes a GROUP BY time() clause, only data points between 1677-09-21 00:12:43.145224194 and now() are returned. Therefore, if any of your data points occur after now(), specify an alternative upper bound in your time interval.

(By default, most SELECT queries query data with timestamps between 1677-09-21 00:12:43.145224194 and 2262-04-11T23:47:16.854775806Z UTC.)

Tag and field key with the same name

Avoid using the same name for a tag and field key. If you inadvertently add the same name for a tag and field key, and then query both keys together, the query results show the second key queried (tag or field) appended with _1 (also visible as the column header in Chronograf). To query a tag or field key appended with _1, you must drop the appended _1 and include the syntax ::tag or ::field.

Example

  1. Launch influx.

  2. Write the following points to create both a field and tag key with the same name leaves:

    1. # create the `leaves` tag key
    2. INSERT grape,leaves=species leaves=6
    4. #create the `leaves` field key
    5. INSERT grape leaves=5

  3. If you view both keys, you’ll notice that neither key includes _1:

    1. # show the `leaves` tag key
    2. SHOW TAG KEYS
    4. name: grape
    5. tagKey
    6. ------
    7. leaves
    9. # create the `leaves` field key
    10. SHOW FIELD KEYS
    12. name: grape
    13. fieldKey   fieldType
    14. ------     ---------
    15. leaves     float

  4. If you query the grape measurement, you’ll see the leaves tag key has an appended _1:

    1. # query the `grape` measurement
    2. SELECT * FROM <database_name>.<retention_policy>."grape"
    4. name: grape
    5. time                leaves      leaves_1
    6. ----                --------    ----------
    7. 1574128162128468000 6.00        species
    8. 1574128238044155000 5.00

  5. To query a duplicate key name, you must drop _1 and include ::tag or ::field after the key:

    1. # query duplicate keys using the correct syntax
    2. SELECT "leaves"::tag, "leaves"::field FROM <database_name>.<retention_policy>."grape"
    4. name: grape
    5. time                leaves     leaves_1
    6. ----                --------   ----------
    7. 1574128162128468000 species    6.00
    8. 1574128238044155000            5.00

    Therefore, queries that reference leaves_1 don’t return values.

Warning: If you inadvertently add a duplicate key name, follow the steps below to remove a duplicate key. Because of memory requirements, if you have large amounts of data, we recommend chunking your data (while selecting it) by a specified interval (for example, date range) to fit the allotted memory.

Remove a duplicate key

  1. Launch influx.

  2. Use the following queries to remove a duplicate key.

    1. /* select each field key to keep in the original measurement and send to a temporary
    2.    measurement; then, group by the tag keys to keep (leave out the duplicate key) */
    4. SELECT "field_key","field_key2","field_key3"
    5. INTO <temporary_measurement> FROM <original_measurement>
    6. WHERE <date range> GROUP BY "tag_key","tag_key2","tag_key3"
    8. /* verify the field keys and tags keys were successfully moved to the temporary
    9. measurement */
    10. SELECT * FROM "temporary_measurement"
    12. /* drop original measurement (with the duplicate key) */
    13. DROP MEASUREMENT "original_measurement"
    15. /* move data from temporary measurement back to original measurement you just dropped */
    16. SELECT * INTO "original_measurement" FROM "temporary_measurement" GROUP BY *
    18. /* verify the field keys and tags keys were successfully moved back to the original
    19.  measurement */
    20. SELECT * FROM "original_measurement"
    22. /* drop temporary measurement */
    23. DROP MEASUREMENT "temporary_measurement"

Why don’t my GROUP BY time() queries return timestamps that occur after now()?

Most SELECT statements have a default time range between 1677-09-21 00:12:43.145224194 and 2262-04-11T23:47:16.854775806Z UTC. For SELECT statements with a GROUP BY time() clause, the default time range is between 1677-09-21 00:12:43.145224194 UTC and now().

To query data with timestamps that occur after now(), SELECT statements with a GROUP BY time() clause must provide an alternative upper bound in the WHERE clause.

In the following example, the first query covers data with timestamps between 2015-09-18T21:30:00Z and now(). The second query covers data with timestamps between 2015-09-18T21:30:00Z and 180 weeks from now().

  1. > SELECT MEAN("boards") FROM "hillvalley" WHERE time >= '2015-09-18T21:30:00Z' GROUP BY time(12m) fill(none)
  4. > SELECT MEAN("boards") FROM "hillvalley" WHERE time >= '2015-09-18T21:30:00Z' AND time <= now() + 180w GROUP BY time(12m) fill(none)

Note that the WHERE clause must provide an alternative upper bound to override the default now() upper bound. The following query merely resets the lower bound to now() such that the query’s time range is between now() and now():

  1. > SELECT MEAN("boards") FROM "hillvalley" WHERE time >= now() GROUP BY time(12m) fill(none)
  2. >

For for more on time syntax in queries, see Data Exploration.

Can I perform mathematical operations against timestamps?

Currently, it is not possible to execute mathematical operators against timestamp values in InfluxDB. Most time calculations must be carried out by the client receiving the query results.

There is limited support for using InfluxQL functions against timestamp values. The function ELAPSED() returns the difference between subsequent timestamps in a single field.

Can I identify write precision from returned timestamps?

InfluxDB stores all timestamps as nanosecond values, regardless of the write precision supplied. It is important to note that when returning query results, the database silently drops trailing zeros from timestamps which obscures the initial write precision.

In the example below, the tags precision_supplied and timestamp_supplied show the time precision and timestamp that the user provided at the write. Because InfluxDB silently drops trailing zeros on returned timestamps, the write precision is not recognizable in the returned timestamps.

  1. name: trails
  2. -------------
  3. time                  value  precision_supplied  timestamp_supplied
  4. 1970-01-01T01:00:00Z  3      n                   3600000000000
  5. 1970-01-01T01:00:00Z  5      h                   1
  6. 1970-01-01T02:00:00Z  4      n                   7200000000000
  7. 1970-01-01T02:00:00Z  6      h                   2

GitHub Issue #2977

When should I single quote and when should I double quote in queries?

Single quote string values (for example, tag values) but do not single quote identifiers (database names, retention policy names, user names, measurement names, tag keys, and field keys).

Double quote identifiers if they start with a digit, contain characters other than [A-z,0-9,_], or if they are an InfluxQL keyword. Double quotes are not required for identifiers if they don’t fall into one of those categories but we recommend double quoting them anyway.

Examples:

Yes: SELECT bikes_available FROM bikes WHERE station_id='9'

Yes: SELECT "bikes_available" FROM "bikes" WHERE "station_id"='9'

Yes: SELECT MIN("avgrq-sz") AS "min_avgrq-sz" FROM telegraf

Yes: SELECT * from "cr@zy" where "p^e"='2'

No: SELECT 'bikes_available' FROM 'bikes' WHERE 'station_id'="9"

No: SELECT * from cr@zy where p^e='2'

Single quote date time strings. InfluxDB returns an error (ERR: invalid operation: time and *influxql.VarRef are not compatible) if you double quote a date time string.

Examples:

Yes: SELECT "water_level" FROM "h2o_feet" WHERE time > '2015-08-18T23:00:01.232000000Z' AND time < '2015-09-19'

No: SELECT "water_level" FROM "h2o_feet" WHERE time > "2015-08-18T23:00:01.232000000Z" AND time < "2015-09-19"

See Data Exploration for more on time syntax in queries.

Why am I missing data after creating a new DEFAULT retention policy?

When you create a new DEFAULT retention policy (RP) on a database, the data written to the old DEFAULT RP remain in the old RP. Queries that do not specify an RP automatically query the new DEFAULT RP so the old data may appear to be missing. To query the old data you must fully qualify the relevant data in the query.

Example:

All of the data in the measurement fleeting fall under the DEFAULT RP called one_hour:

  1. > SELECT count(flounders) FROM fleeting
  2. name: fleeting
  3. --------------
  4. time                           count
  5. 1970-01-01T00:00:00Z     8

We create a new DEFAULT RP (two_hour) and perform the same query:

  1. > SELECT count(flounders) FROM fleeting
  2. >

To query the old data, we must specify the old DEFAULT RP by fully qualifying fleeting:

  1. > SELECT count(flounders) FROM fish.one_hour.fleeting
  2. name: fleeting
  3. --------------
  4. time                           count
  5. 1970-01-01T00:00:00Z     8

Why is my query with a WHERE OR time clause returning empty results?

Currently, InfluxDB does not support using OR in the WHERE clause to specify multiple time ranges. InfluxDB returns an empty response if the query’s WHERE clause uses OR with time intervals.

Example:

  1. > SELECT * FROM "absolutismus" WHERE time = '2016-07-31T20:07:00Z' OR time = '2016-07-31T23:07:17Z'
  2. >

GitHub Issue #7530

Why does fill(previous) return empty results?

fill(previous) doesn’t fill the result for a time bucket if the previous value is outside the query’s time range.

In the following example, InfluxDB doesn’t fill the 2016-07-12T16:50:20Z-2016-07-12T16:50:30Z time bucket with the results from the 2016-07-12T16:50:00Z-2016-07-12T16:50:10Z time bucket because the query’s time range does not include the earlier time bucket.

Raw data:

  1. > SELECT * FROM "cupcakes"
  2. name: cupcakes
  3. --------------
  4. time                   chocolate
  5. 2016-07-12T16:50:00Z   3
  6. 2016-07-12T16:50:10Z   2
  7. 2016-07-12T16:50:40Z   12
  8. 2016-07-12T16:50:50Z   11

GROUP BY time() query:

  1. > SELECT max("chocolate") FROM "cupcakes" WHERE time >= '2016-07-12T16:50:20Z' AND time <= '2016-07-12T16:51:10Z' GROUP BY time(20s) fill(previous)
  2. name: cupcakes
  3. --------------
  4. time                   max
  5. 2016-07-12T16:50:20Z
  6. 2016-07-12T16:50:40Z   12
  7. 2016-07-12T16:51:00Z   12

While this is the expected behavior of fill(previous), an open feature request on GitHub proposes that fill(previous) should fill results even when previous values fall outside the query’s time range.

Why are my INTO queries missing data?

By default, INTO queries convert any tags in the initial data to fields in the newly written data. This can cause InfluxDB to overwrite points that were previously differentiated by a tag. Include GROUP BY * in all INTO queries to preserve tags in the newly written data.

Note that this behavior does not apply to queries that use the TOP() or BOTTOM() functions. See the TOP() and BOTTOM() documentation for more information.

Example

Initial data

The french_bulldogs measurement includes the color tag and the name field.

  1. > SELECT * FROM "french_bulldogs"
  2. name: french_bulldogs
  3. ---------------------
  4. time                  color  name
  5. 2016-05-25T00:05:00Z  peach  nugget
  6. 2016-05-25T00:05:00Z  grey   rumple
  7. 2016-05-25T00:10:00Z  black  prince
INTO query without GROUP BY *

An INTO query without a GROUP BY * clause turns the color tag into a field in the newly written data. In the initial data the nugget point and the rumple points are differentiated only by the color tag. Once color becomes a field, InfluxDB assumes that the nugget point and the rumple point are duplicate points and it overwrites the nugget point with the rumple point.

  1. > SELECT * INTO "all_dogs" FROM "french_bulldogs"
  2. name: result
  3. ------------
  4. time                  written
  5. 1970-01-01T00:00:00Z  3
  7. > SELECT * FROM "all_dogs"
  8. name: all_dogs
  9. --------------
  10. time                  color  name
  11. 2016-05-25T00:05:00Z  grey   rumple                <---- no more nugget 🐶
  12. 2016-05-25T00:10:00Z  black  prince
INTO query with GROUP BY *

An INTO query with a GROUP BY * clause preserves color as a tag in the newly written data. In this case, the nugget point and the rumple point remain unique points and InfluxDB does not overwrite any data.

  1. > SELECT "name" INTO "all_dogs" FROM "french_bulldogs" GROUP BY *
  2. name: result
  3. ------------
  4. time                  written
  5. 1970-01-01T00:00:00Z  3
  7. > SELECT * FROM "all_dogs"
  8. name: all_dogs
  9. --------------
  10. time                  color  name
  11. 2016-05-25T00:05:00Z  peach  nugget
  12. 2016-05-25T00:05:00Z  grey   rumple
  13. 2016-05-25T00:10:00Z  black  prince

How do I query data with an identical tag key and field key?

Use the :: syntax to specify if the key is a field key or tag key.

Examples

Sample data
  1. > INSERT candied,almonds=true almonds=50,half_almonds=51 1465317610000000000
  2. > INSERT candied,almonds=true almonds=55,half_almonds=56 1465317620000000000
  4. > SELECT * FROM "candied"
  5. name: candied
  6. -------------
  7. time                   almonds  almonds_1  half_almonds
  8. 2016-06-07T16:40:10Z   50       true       51
  9. 2016-06-07T16:40:20Z   55       true       56
Specify that the key is a field:
  1. > SELECT * FROM "candied" WHERE "almonds"::field > 51
  2. name: candied
  3. -------------
  4. time                   almonds  almonds_1  half_almonds
  5. 2016-06-07T16:40:20Z   55       true       56
Specify that the key is a tag:
  1. > SELECT * FROM "candied" WHERE "almonds"::tag='true'
  2. name: candied
  3. -------------
  4. time                   almonds  almonds_1  half_almonds
  5. 2016-06-07T16:40:10Z   50       true       51
  6. 2016-06-07T16:40:20Z   55       true       56

How do I query data across measurements?

Currently, there is no way to perform cross-measurement math or grouping. All data must be under a single measurement to query it together. InfluxDB is not a relational database and mapping data across measurements is not currently a recommended schema. See GitHub Issue #3552 for a discussion of implementing JOIN in InfluxDB.

Does the order of the timestamps matter?

No. Our tests indicate that there is a only a negligible difference between the times it takes InfluxDB to complete the following queries:

  1. SELECT ... FROM ... WHERE time > 'timestamp1' AND time < 'timestamp2'
  2. SELECT ... FROM ... WHERE time < 'timestamp2' AND time > 'timestamp1'

How do I SELECT data with a tag that has no value?

Specify an empty tag value with ''. For example:

  1. > SELECT * FROM "vases" WHERE priceless=''
  2. name: vases
  3. -----------
  4. time                   origin   priceless
  5. 2016-07-20T18:42:00Z   8

Why does series cardinality matter?

InfluxDB maintains an in-memory index of every series in the system. As the number of unique series grows, so does the RAM usage. High series cardinality can lead to the operating system killing the InfluxDB process with an out of memory (OOM) exception. See SHOW CARDINALITY to learn about the InfluxSQL commands for series cardinality.

How can I remove series from the index?

To reduce series cardinality, series must be dropped from the index. DROP DATABASE, DROP MEASUREMENT, and DROP SERIES will all remove series from the index and reduce the overall series cardinality.

Note: DROP commands are usually CPU-intensive, as they frequently trigger a TSM compaction. Issuing DROP queries at a high frequency may significantly impact write and other query throughput.

How do I write integer field values?

Add a trailing i to the end of the field value when writing an integer. If you do not provide the i, InfluxDB will treat the field value as a float.

Writes an integer: value=100i Writes a float: value=100

How does InfluxDB handle duplicate points?

A point is uniquely identified by the measurement name, tag set, and timestamp. If you submit a new point with the same measurement, tag set, and timestamp as an existing point, the field set becomes the union of the old field set and the new field set, where any ties go to the new field set. This is the intended behavior.

For example:

Old point: cpu_load,hostname=server02,az=us_west val_1=24.5,val_2=7 1234567890000000

New point: cpu_load,hostname=server02,az=us_west val_1=5.24 1234567890000000

After you submit the new point, InfluxDB overwrites val_1 with the new field value and leaves the field val_2 alone:

  1. > SELECT * FROM "cpu_load" WHERE time = 1234567890000000
  2. name: cpu_load
  3. --------------
  4. time                      az        hostname   val_1   val_2
  5. 1970-01-15T06:56:07.89Z   us_west   server02   5.24    7

To store both points:

  • Introduce an arbitrary new tag to enforce uniqueness.

    Old point: cpu_load,hostname=server02,az=us_west,uniq=1 val_1=24.5,val_2=7 1234567890000000

    New point: cpu_load,hostname=server02,az=us_west,uniq=2 val_1=5.24 1234567890000000

    After writing the new point to InfluxDB:

    1. > SELECT * FROM "cpu_load" WHERE time = 1234567890000000
    2. name: cpu_load
    3. --------------
    4. time                      az        hostname   uniq   val_1   val_2
    5. 1970-01-15T06:56:07.89Z   us_west   server02   1      24.5    7
    6. 1970-01-15T06:56:07.89Z   us_west   server02   2      5.24

  • Increment the timestamp by a nanosecond.

    Old point: cpu_load,hostname=server02,az=us_west val_1=24.5,val_2=7 1234567890000000

    New point: cpu_load,hostname=server02,az=us_west val_1=5.24 1234567890000001

    After writing the new point to InfluxDB:

    1. > SELECT * FROM "cpu_load" WHERE time >= 1234567890000000 and time <= 1234567890000001
    2. name: cpu_load
    3. --------------
    4. time                             az        hostname   val_1   val_2
    5. 1970-01-15T06:56:07.89Z          us_west   server02   24.5    7
    6. 1970-01-15T06:56:07.890000001Z   us_west   server02   5.24

What newline character does the InfluxDB API require?

The InfluxDB line protocol relies on line feed (\n, which is ASCII 0x0A) to indicate the end of a line and the beginning of a new line. Files or data that use a newline character other than \n will result in the following errors: bad timestamp, unable to parse.

Note that Windows uses carriage return and line feed (\r\n) as the newline character.

What words and characters should I avoid when writing data to InfluxDB?

InfluxQL keywords

If you use an InfluxQL keyword as an identifier you will need to double quote that identifier in every query. This can lead to non-intuitive errors. Identifiers are continuous query names, database names, field keys, measurement names, retention policy names, subscription names, tag keys, and user names.

time

The keyword time is a special case. time can be a continuous query name, database name, measurement name, retention policy name, subscription name, and user name. In those cases, time does not require double quotes in queries. time cannot be a field key or tag key; InfluxDB rejects writes with time as a field key or tag key and returns an error.

Examples

Write time as a measurement and query it
  1. > INSERT time value=1
  3. > SELECT * FROM time
  5. name: time
  6. time                            value
  7. ----                            -----
  8. 2017-02-07T18:28:27.349785384Z  1

time is a valid measurement name in InfluxDB.

Write time as a field key and attempt to query it
  1. > INSERT mymeas time=1
  2. ERR: {"error":"partial write: invalid field name: input field \"time\" on measurement \"mymeas\" is invalid dropped=1"}

time is not a valid field key in InfluxDB. The system does does not write the point and returns a 400.

Write time as a tag key and attempt to query it
  1. > INSERT mymeas,time=1 value=1
  2. ERR: {"error":"partial write: invalid tag key: input tag \"time\" on measurement \"mymeas\" is invalid dropped=1"}

time is not a valid tag key in InfluxDB. The system does does not write the point and returns a 400.

Characters

To keep regular expressions and quoting simple, avoid using the following characters in identifiers:

\ backslash ^ circumflex accent $ dollar sign ' single quotation mark " double quotation mark = equal sign , comma

When should I single quote and when should I double quote when writing data?

  • Avoid single quoting and double quoting identifiers when writing data via the line protocol; see the examples below for how writing identifiers with quotes can complicate queries. Identifiers are database names, retention policy names, user names, measurement names, tag keys, and field keys.

Write with a double-quoted measurement: INSERT "bikes" bikes_available=3 Applicable query: SELECT * FROM "\"bikes\""

Write with a single-quoted measurement: INSERT 'bikes' bikes_available=3 Applicable query: SELECT * FROM "\'bikes\'"

Write with an unquoted measurement: INSERT bikes bikes_available=3 Applicable query: SELECT * FROM "bikes"

  • Double quote field values that are strings.

Write: INSERT bikes happiness="level 2" Applicable query: SELECT * FROM "bikes" WHERE "happiness"='level 2'

  • Special characters should be escaped with a backslash and not placed in quotes.

Write: INSERT wacky va\"ue=4 Applicable query: SELECT "va\"ue" FROM "wacky"

For more information , see Line protocol.

Does the precision of the timestamp matter?

Yes. To maximize performance, use the coarsest possible timestamp precision when writing data to InfluxDB.

In the following two examples, the first request uses a default precision of nanoseconds while the second example sets the precision to seconds:

  1. curl -i -XPOST "http://localhost:8086/write?db=weather" --data-binary 'temperature,location=1 value=90 1472666050000000000'
  3. curl -i -XPOST "http://localhost:8086/write?db=weather&precision=s" --data-binary 'temperature,location=1 value=90 1472666050'

The tradeoff is that identical points with duplicate timestamps, more likely to occur as precision gets coarser, may overwrite other points.

What are the configuration recommendations and schema guidelines for writing sparse, historical data?

For users who want to write sparse, historical data to InfluxDB, InfluxData recommends:

First, lengthening your retention policy‘s shard group duration to cover several years. The default shard group duration is one week and if your data cover several hundred years – well, that’s a lot of shards! Having an extremely high number of shards is inefficient for InfluxDB. Increase the shard group duration for your data’s retention policy with the ALTER RETENTION POLICY query.

Second, temporarily lowering the cache-snapshot-write-cold-duration configuration setting. If you’re writing a lot of historical data, the default setting (10m) can cause the system to hold all of your data in cache for every shard. Temporarily lowering the cache-snapshot-write-cold-duration setting to 10s while you write the historical data makes the process more efficient.