Projects:Energy Data Collection Stack

Stages

Pyramid

		Open source option	HA options	Alternatives
↑	Visualization	Grafana
	Reports	Carbone? Jupyter?
	Complex Calculations	Jupyter
↑	Database	TimescaleDB		InfluxDB, Postgres
↑	Kafka to database	Debezium, Benthos, Node-RED
↑	MQTT to Kafka	Benthos, Node-RED		Telegraf
↑	MQTT Broker	Mosquitto	HAProxy, keepalived	HiveMQ, EMQX
↑	Data Collection Equipment	ESPHome

Other Tools

• MQTT Load testing
  • https://github.com/inovex/mqtt-stresser (2020, 233 *)
  • https://github.com/takanorig/mqtt-bench (2015, 139*)
  • https://github.com/emqx/emqtt-bench (2024, 489*)
    • https://hub.docker.com/r/emqx/emqtt-bench
  • https://github.com/halfgaar/MqttLoadSimulator (2024, 13*)
• MQTT to Database
  • https://xaviergeerinck.com/2023/07/27/sinking-events-from-mqtt-to-timescale/
  • https://github.com/tobymurray/mqtt-to-timescaledb
• Reports
  • https://www.reddit.com/r/Jupyter/comments/qk5zee/using_jupyter_as_a_document_pdf_generator/