Commit graph

432 commits

Author SHA1 Message Date
Matteo Biscosi
0f6b0bbdd0 Fixes rrd paths with incorrect interface 2026-10-30 12:57:13 +01:00
Matteo Biscosi
365e74137b Optimized modules loading 2026-10-22 12:20:16 +02:00
Alfredo Cardigliano
68a90c54ad Add execTSQuery which is not requiring historical data permission to aaccess CH timeseries
Some checks are pending
Build / build (push) Waiting to run
CIFuzz / Fuzzing (address) (push) Waiting to run
CIFuzz / Fuzzing (undefined) (push) Waiting to run
CodeQL / Analyze (push) Waiting to run
CodeQL / Analyze-1 (push) Waiting to run
2026-10-05 11:20:23 +02:00
Manuel Ceroni
218c45246a
Fixed RRD path dropping entities whose id matches the interface id (#11034)
Some checks are pending
Build / build (push) Waiting to run
CIFuzz / Fuzzing (address) (push) Waiting to run
CIFuzz / Fuzzing (undefined) (push) Waiting to run
CodeQL / Analyze (push) Waiting to run
CodeQL / Analyze-1 (push) Waiting to run
2026-10-02 11:07:53 +02:00
Matteo Biscosi
1d23c1a99a Fixes top timeseries alwais returning null in case of value at 0 2026-10-01 11:35:08 +02:00
Matteo Biscosi
6c3b8885f5 Fixes top timeseries labels 2026-10-01 10:48:56 +02:00
Matteo Biscosi
09c132aa8d Fixes influxdb query not working, also added support to influxdb 3
Some checks are pending
Build / build (push) Waiting to run
CIFuzz / Fuzzing (address) (push) Waiting to run
CIFuzz / Fuzzing (undefined) (push) Waiting to run
CodeQL / Analyze (push) Waiting to run
CodeQL / Analyze-1 (push) Waiting to run
2026-09-30 19:05:15 +02:00
Manuel Ceroni
8ab997f628
Fixed ASN RRD path when the ASN matches the interface id (#11022) 2026-09-30 10:48:39 +02:00
Matteo Biscosi
b58c57eb67 Added active flows and added all probes timeseries (#11001)
Some checks are pending
Build / build (push) Waiting to run
CIFuzz / Fuzzing (undefined) (push) Waiting to run
CIFuzz / Fuzzing (address) (push) Waiting to run
CodeQL / Analyze (push) Waiting to run
CodeQL / Analyze-1 (push) Waiting to run
2026-09-29 16:20:24 +02:00
Alfredo Cardigliano
a1fffe1e9a CH ancillary code rework to avoid access to system tables requiring user grants 2026-09-28 17:58:39 +02:00
Alfredo Cardigliano
7b0af49a00 Fix unneeded access to system tables 2026-09-28 16:37:28 +02:00
Manuel Ceroni
2be0628dc8
Fixed the schema path for site ts (#10985)
Some checks are pending
Build / build (push) Waiting to run
CIFuzz / Fuzzing (address) (push) Waiting to run
CIFuzz / Fuzzing (undefined) (push) Waiting to run
CodeQL / Analyze (push) Waiting to run
CodeQL / Analyze-1 (push) Waiting to run
2026-09-23 11:57:46 +02:00
Alfredo Cardigliano
9349c98699 Introduce queryTotalByTag to avoid one full scan query per L7 protocol (#10965) 2026-09-23 10:51:20 +02:00
Alfredo Cardigliano
e798e2a461 Fix queries on CH counter timeseries (fix the initial point) 2026-09-03 11:41:28 +02:00
Alfredo Cardigliano
6d91db0262 Update queries in clickhousehr 2026-08-12 16:21:24 +02:00
Alfredo Cardigliano
1fc8cab288 Add ifid and ntopng_instance_name to CH timeseries table. Add ifid migration from tags for old data. 2026-08-11 15:59:46 +02:00
GabrieleDeri
402f0f9e8a
Fixes menu highlight on network entries (#10743)
Some checks are pending
Build / build (push) Waiting to run
CIFuzz / Fuzzing (address) (push) Waiting to run
CIFuzz / Fuzzing (undefined) (push) Waiting to run
CodeQL / Analyze-1 (push) Waiting to run
CodeQL / Analyze (push) Waiting to run
2026-08-11 01:02:13 +02:00
Alfredo Cardigliano
e8c7ac67d3 Add pref for CH ts queue/batch size 2026-08-10 16:40:54 +02:00
Alfredo Cardigliano
f74fa714dd Add ts engine name to column names 2026-08-10 16:00:16 +02:00
Alfredo Cardigliano
1e6045d4a2 Rework clickhouse timeseries dump queue (use C++ struct rather than strings, native CH block insert, increase batch size) 2026-07-23 17:24:33 +02:00
Luca Deri
c3cdb6bd70 Added timeseries drops
Some checks are pending
Build / build (push) Waiting to run
CIFuzz / Fuzzing (address) (push) Waiting to run
CodeQL / Analyze (push) Waiting to run
CodeQL / Analyze-1 (push) Waiting to run
E2E Tests / e2e (push) Waiting to run
2026-07-18 07:51:04 +02:00
Luca Deri
dcc8b5395f Fixed usge stats: TS written and SNMP devices polled 2026-07-17 19:23:42 +02:00
Luca Deri
5c65a0ac93 Timeseries fixes 2026-07-15 15:47:55 +02:00
Matteo Biscosi
fd8679058c Fixes incorrect epoch begin when fetching an rrd 2026-07-15 12:34:29 +00:00
Luca Deri
5ea2daee42 Reworked timeseries upload 2026-07-14 21:42:01 +02:00
Alfredo Cardigliano
8b009ac2f1 Move is<model> Lua functions to pro 2026-06-25 11:33:55 +02:00
Alfredo Cardigliano
c92e0cd8bb Implement grou by in observability dashboard
Some checks are pending
Build / build (push) Waiting to run
CIFuzz / Fuzzing (address) (push) Waiting to run
CodeQL / Analyze (push) Waiting to run
CodeQL / Analyze-1 (push) Waiting to run
2026-06-12 13:35:03 +02:00
Matteo Biscosi
d823c814e4 Possible fix for incorrect values formatted (#10453)
Some checks are pending
Build / build (push) Waiting to run
CIFuzz / Fuzzing (address) (push) Waiting to run
CodeQL / Analyze (push) Waiting to run
CodeQL / Analyze-1 (push) Waiting to run
2026-06-11 15:20:42 +00:00
Alfredo Cardigliano
5ca863e989 Move clickhousehr back to the folder containing all drivers
Some checks are pending
Build / build (push) Waiting to run
CIFuzz / Fuzzing (address) (push) Waiting to run
CodeQL / Analyze (push) Waiting to run
CodeQL / Analyze-1 (push) Waiting to run
2026-05-29 17:56:19 +02:00
Alfredo Cardigliano
31bbd4e4eb Use logic from historical flows for building conditions in clickhousehr timeseries. Move clickhousehr.lua 2026-05-29 15:19:17 +02:00
Alfredo Cardigliano
28ae1e11e5 Add HR Chart page with ability to filter/aggregate data. Extend clickhouse HR driver to handle wildcard/aggregation. Extend range picker to show filters only, hide snapshots, etc. 2026-05-29 12:16:30 +02:00
Alfredo Cardigliano
2596f28c44 Add HR timeseries in historical flow details
Some checks are pending
Build / build (push) Waiting to run
CIFuzz / Fuzzing (address) (push) Waiting to run
CodeQL / Analyze (push) Waiting to run
CodeQL / Analyze-1 (push) Waiting to run
2026-05-27 10:30:06 +02:00
Alfredo Cardigliano
5ae7bd7cd3 Add HR charts for hosts
Some checks are pending
Build / build (push) Waiting to run
CIFuzz / Fuzzing (address) (push) Waiting to run
CodeQL / Analyze (push) Waiting to run
CodeQL / Analyze-1 (push) Waiting to run
2026-05-26 16:45:09 +02:00
Alfredo Cardigliano
c4bb58f054 Implement a Clickhouse High-Resolution driver for timeseries. Add a sample HR traffic chart on the interface. 2026-05-26 12:26:52 +02:00
Matteo Biscosi
0b0d971853 Added missing check on query total causing missing ts (#10228) 2026-05-04 10:24:42 +00:00
Matteo Biscosi
873c879626 Fixes host pools timeseries not working 2026-04-13 14:29:36 +00:00
Alfredo Cardigliano
8bfd8a7653 Using standard literal format rather than map as the latter conficts with nullable due to LowCardinality 2026-04-09 10:24:51 +02:00
Luca
d8bf334ea7 Added missing return code in interface.execSQLQuery 2026-04-08 14:11:37 +02:00
Alfredo Cardigliano
bc5fc911cd Rework ntop.httpPost to accept optional parameters in a table. Also rework Utils::httpGetPostPutPatch to reduce the number of parameters. 2026-04-02 10:18:24 +02:00
Alfredo Cardigliano
258b10382e Change clickhouse map serialization to avoid parsing issues 2026-03-27 16:24:51 +01:00
Alfredo Cardigliano
395c29ee23 Handle ts retention on CH by deleting partitions rather than usint TTL to handle changes to retention preferences 2026-03-16 19:32:31 +01:00
Alfredo Cardigliano
fc5c7a0dfd Implement queryLastValues for clickhouse ts 2026-03-16 10:34:15 +01:00
Alfredo Cardigliano
d57d85642c Fix labels and points with no data for clickhouse ts 2026-03-11 10:04:04 +01:00
Alfredo Cardigliano
352a21a70d Fix append on metrics like iface:ndpi to clickhouse ts 2026-03-11 09:25:14 +01:00
Alfredo Cardigliano
05aebd586d Fix line_protocol_parse 2026-03-11 09:16:30 +01:00
Matteo Biscosi
d91411db91 Fixes clickhouse timeseries incorrect naming 2026-03-10 11:44:26 +00:00
Alfredo Cardigliano
a53b3ba3d8 Rework CH ts batch queue. Implement CHTimeseriesExporter similar to RRD/Influx. Add periodic ts export per interface (it was global running on system) 2026-03-09 16:02:48 +01:00
Alfredo Cardigliano
84654a6ec5 Fix ch ts charts with 1s resolution 2026-03-06 17:33:14 +00:00
Alfredo Cardigliano
6da58b19f4 Optimize ts schema on CH 2026-03-06 11:13:52 +00:00
Alfredo Cardigliano
b8c65c4b86 Add checks on CH enabled/disabled when enabling TS 2026-03-05 15:43:46 +00:00