Linux/TimescaleDB: Difference between revisions

From Wiki
mNo edit summary
 
(14 intermediate revisions by the same user not shown)
Line 1: Line 1:
* [[Linux/Postgres|Postgres]]
== Setup ==
== Setup ==
<blockquote>
<blockquote>
Line 19: Line 21:
<blockquote>
<blockquote>
<pre>
<pre>
INSERT INTO sensor_data (time, topic, value)
INSERT INTO sensor_data (time, topic, value) VALUES (
VALUES (
     now(),
     now(),
     '{{{ msg.topic }}}',
     '{{{ msg.topic }}}',
Line 27: Line 28:
</pre>
</pre>
</blockquote>
</blockquote>


== Get table size ==
== Get table size ==
Line 35: Line 37:
</blockquote>
</blockquote>


 
= Query =
== List all databases ==
== Grafana timefilter macro ==
* limits query to timeframe selected in grafana
<blockquote>
<pre>
SELECT *
FROM sensor_data
WHERE (topic = 'home/modbus-meter/sensor/total_system_power_w/state'
AND $__timeFilter("time"))
</pre>
</blockquote>
== Time buckets ==
* https://docs.timescale.com/use-timescale/latest/time-buckets/about-time-buckets/
* https://docs.timescale.com/use-timescale/latest/time-buckets/use-time-buckets/
* 15min average time_buckets
<blockquote>
<blockquote>
<pre>
<pre>
SELECT datname FROM pg_database
SELECT time_bucket('1 hour', timestamp) as time,
WHERE datistemplate = false;
  avg(value) AS avg_value
FROM sensor_data
WHERE
  topic = 'home/modbus-meter/sensor/total_system_power_w/state'
  AND
  $__timeFilter("timestamp")
GROUP by time
</pre>
</pre>
</blockquote>
</blockquote>


== List all tables ==
== Meter / increasing counter ==
* https://github.com/timescale/timescaledb-toolkit/blob/main/docs/counter_agg.md
* https://stackoverflow.com/questions/76774353/get-complete-hours-time-buckets-with-timescaledb
* https://docs.timescale.com/use-timescale/latest/query-data/advanced-analytic-queries/#calculate-the-increase-in-a-value
<blockquote>
<blockquote>
<pre>
<pre>
SELECT table_catalog,table_schema,table_name FROM information_schema.tables
SELECT time_bucket('1 hour', time) as bucket,
WHERE table_type = 'BASE TABLE' AND table_schema = 'public'
first(time,time) as period_begin,
ORDER BY table_type, table_name
last(time,time) as period_end,
MAX(counter) - MIN(counter) as total_consumption
FROM  
GROUP BY 1;
</pre>
</pre>
</blockquote>
</blockquote>


== first() + last () ==
*
== Grafana > Dashboards > Settings > Variables ==
* topic = SELECT DISTINCT topic FROM "sensor_data"
== Continuous aggregates ==
* https://docs.timescale.com/tutorials/latest/energy-data/dataset-energy/


== Links ==
* https://docs.timescale.com/
* https://www.timescale.com/learn/time-series-basics
* https://www.timescale.com/learn/timescale-basics


[[Category:Linux/Services]]
[[Category:Linux/Services]]
[[Category:Linux]]
[[Category:Linux]]
[[Category:Programming]]
[[Category:Programming]]

Latest revision as of 19:42, 23 November 2024

Setup

CREATE TABLE sensor_data (
        time TIMESTAMPTZ NOT NULL,
        topic TEXT,
        value DOUBLE PRECISION
);
SELECT create_hypertable('sensor_data', 'time');

Insert data via Node-RED

INSERT INTO sensor_data (time, topic, value) VALUES (
    now(),
    '{{{ msg.topic }}}',
    '{{{ msg.payload }}}'
);


Get table size

SELECT hypertable_size('sensor_data');

Query

Grafana timefilter macro

  • limits query to timeframe selected in grafana
SELECT * 
FROM sensor_data 
WHERE (topic = 'home/modbus-meter/sensor/total_system_power_w/state' 
AND $__timeFilter("time")) 

Time buckets

SELECT time_bucket('1 hour', timestamp) as time,
  avg(value) AS avg_value
FROM sensor_data
WHERE
  topic = 'home/modbus-meter/sensor/total_system_power_w/state'
  AND 
  $__timeFilter("timestamp")
GROUP by time

Meter / increasing counter

SELECT time_bucket('1 hour', time) as bucket,
 first(time,time) as period_begin,
 last(time,time) as period_end,
 MAX(counter) - MIN(counter) as total_consumption
FROM 
GROUP BY 1;

first() + last ()

Grafana > Dashboards > Settings > Variables

  • topic = SELECT DISTINCT topic FROM "sensor_data"

Continuous aggregates

Links