no data shown in reports / Belchertown skin #147

Daniel-WW · 2022-02-20T19:11:32Z

Daniel-WW
Feb 20, 2022

Hello,
I'm using the WeeWX-MQTTSubscribe extension on my first WeeWX-Server, running in a docker container. So I'm still a newbie in stuff like this.

I can aready receive data from my MQTT-Broker, but I can see no results in the Report. I use the Belchertown skin.

Did I do a wrong configuration? Here is a part of the Debug-Logs:

Feb 20 11:07:43 weewx[19] DEBUG user.MQTTSubscribe: (Driver) MessageCallbackProvider data-> incoming topic: zigbee2mqtt/temp_balkon_02, QOS: 0, retain: 0, payload: b'{"battery":68,"humidity":77.48,"linkquality":143,"pressure":1001.4,"temperature":9.41,"voltage":2945}'
Feb 20 11:07:43 weewx[19] DEBUG user.MQTTSubscribe: (Driver) TopicManager data-> incoming zigbee2mqtt/temp_balkon_02: battery: 68.0, humidity: 77.48, linkquality: 143.0, pressure: 1001.4, temperature: 9.41, voltage: 2945.0
Feb 20 11:07:43 weewx[19] DEBUG user.MQTTSubscribe: (Driver) MessageCallbackProvider data-> incoming topic: zigbee2mqtt/temp_balkon_02, QOS: 0, retain: 0, payload: b'{"battery":68,"humidity":77.18,"linkquality":127,"pressure":1001.4,"temperature":9.41,"voltage":2945}'
Feb 20 11:07:43 weewx[19] DEBUG user.MQTTSubscribe: (Driver) TopicManager data-> incoming zigbee2mqtt/temp_balkon_02: battery: 68.0, humidity: 77.18, linkquality: 127.0, pressure: 1001.4, temperature: 9.41, voltage: 2945.0
Feb 20 11:07:43 weewx[19] DEBUG user.MQTTSubscribe: (Driver) MessageCallbackProvider data-> incoming topic: zigbee2mqtt/temp_balkon_02, QOS: 0, retain: 0, payload: b'{"battery":68,"humidity":77.18,"linkquality":151,"pressure":1001,"temperature":9.41,"voltage":2945}'
Feb 20 11:07:43 weewx[19] DEBUG user.MQTTSubscribe: (Driver) TopicManager data-> incoming zigbee2mqtt/temp_balkon_02: battery: 68.0, humidity: 77.18, linkquality: 151.0, pressure: 1001.0, temperature: 9.41, voltage: 2945.0
Feb 20 11:07:45 weewx[19] DEBUG user.MQTTSubscribe: (Driver) TopicManager data-> outgoing zigbee2mqtt/temp_balkon_02: battery: 68.0, dateTime: 1645351663.7800632, humidity: 77.48, linkquality: 143.0, pressure: 1001.4, temperature: 9.41, usUnits: 16, voltage: 2945.0
Feb 20 11:07:45 weewx[19] DEBUG user.MQTTSubscribe: (Driver) data-> final loop packet is zigbee2mqtt/temp_balkon_02 2022-02-20 11:07:43 CET (1645351663): battery: 68.0, dateTime: 1645351663.7800632, humidity: 77.48, linkquality: 143.0, pressure: 1001.4, temperature: 9.41, usUnits: 16, voltage: 2945.0
Feb 20 11:07:45 weewx[19] DEBUG user.MQTTSubscribe: (Driver) TopicManager data-> outgoing zigbee2mqtt/temp_balkon_02: battery: 68.0, dateTime: 1645351663.7851195, humidity: 77.18, linkquality: 127.0, pressure: 1001.4, temperature: 9.41, usUnits: 16, voltage: 2945.0
Feb 20 11:07:45 weewx[19] DEBUG user.MQTTSubscribe: (Driver) data-> final loop packet is zigbee2mqtt/temp_balkon_02 2022-02-20 11:07:43 CET (1645351663): battery: 68.0, dateTime: 1645351663.7851195, humidity: 77.18, linkquality: 127.0, pressure: 1001.4, temperature: 9.41, usUnits: 16, voltage: 2945.0
Feb 20 11:07:45 weewx[19] DEBUG user.MQTTSubscribe: (Driver) TopicManager data-> outgoing zigbee2mqtt/temp_balkon_02: battery: 68.0, dateTime: 1645351663.7914526, humidity: 77.18, linkquality: 151.0, pressure: 1001.0, temperature: 9.41, usUnits: 16, voltage: 2945.0
Feb 20 11:07:45 weewx[19] DEBUG user.MQTTSubscribe: (Driver) data-> final loop packet is zigbee2mqtt/temp_balkon_02 2022-02-20 11:07:43 CET (1645351663): battery: 68.0, dateTime: 1645351663.7914526, humidity: 77.18, linkquality: 151.0, pressure: 1001.0, temperature: 9.41, usUnits: 16, voltage: 2945.0
Feb 20 11:29:42 weewx[19] DEBUG user.MQTTSubscribe: (Driver) MessageCallbackProvider data-> incoming topic: zigbee2mqtt/temp_balkon_02, QOS: 0, retain: 0, payload: b'{"battery":68,"humidity":76.25,"linkquality":239,"pressure":1001.19,"temperature":9.59,"voltage":2945}'
Feb 20 11:29:42 weewx[19] DEBUG user.MQTTSubscribe: (Driver) TopicManager data-> incoming zigbee2mqtt/temp_balkon_02: battery: 68.0, humidity: 76.25, linkquality: 239.0, pressure: 1001.19, temperature: 9.59, voltage: 2945.0
Feb 20 11:29:44 weewx[19] DEBUG user.MQTTSubscribe: (Driver) TopicManager data-> outgoing zigbee2mqtt/temp_balkon_02: battery: 68.0, dateTime: 1645352982.6237662, humidity: 76.25, linkquality: 239.0, pressure: 1001.19, temperature: 9.59, usUnits: 16, voltage: 2945.0
Feb 20 11:29:44 weewx[19] DEBUG user.MQTTSubscribe: (Driver) data-> final loop packet is zigbee2mqtt/temp_balkon_02 2022-02-20 11:29:42 CET (1645352982): battery: 68.0, dateTime: 1645352982.6237662, humidity: 76.25, linkquality: 239.0, pressure: 1001.19, temperature: 9.59, usUnits: 16, voltage: 2945.0
Feb 20 11:29:44 weewx[19] DEBUG user.MQTTSubscribe: (Driver) No archive topic configured.
Feb 20 11:29:44 weewx[19] INFO weewx.manager: Added record 2022-02-20 11:10:00 CET (1645351800) to database 'weewx.sdb'
Feb 20 11:29:44 weewx[19] INFO weewx.manager: Added record 2022-02-20 11:10:00 CET (1645351800) to daily summary in 'weewx.sdb'
Feb 20 11:29:45 weewx[19] DEBUG weewx.reportengine: Running reports for latest time in the database.
Feb 20 11:29:45 weewx[19] DEBUG weewx.reportengine: Report 'SeasonsReport' not enabled. Skipping.
Feb 20 11:29:45 weewx[19] DEBUG weewx.reportengine: Report 'SmartphoneReport' not enabled. Skipping.
Feb 20 11:29:45 weewx[19] DEBUG weewx.reportengine: Report 'MobileReport' not enabled. Skipping.
Feb 20 11:29:45 weewx[19] DEBUG weewx.reportengine: Report 'StandardReport' not enabled. Skipping.
Feb 20 11:29:45 weewx[19] DEBUG weewx.reportengine: Running report 'Belchertown'
Feb 20 11:29:45 weewx[19] DEBUG weewx.reportengine: Found configuration file /home/weewx/skins/Belchertown/skin.conf for report 'Belchertown'
Feb 20 11:29:45 weewx[19] DEBUG weewx.cheetahgenerator: Using search list ['weewx.cheetahgenerator.Almanac', 'weewx.cheetahgenerator.Station', 'weewx.cheetahgenerator.Current', 'weewx.cheetahgenerator.Stats', 'weewx.cheetahgenerator.UnitInfo', 'weewx.cheetahgenerator.Extras', 'weewx.cheetahgenerator.JSONHelpers', 'user.belchertown.getData']
Feb 20 11:29:45 weewx[19] DEBUG weewx.manager: Daily summary version is 4.0
Feb 20 11:29:45 weewx[19] INFO weewx.cheetahgenerator: Generated 11 files for report Belchertown in 0.80 seconds
Feb 20 11:29:45 weewx[19] INFO weewx.reportengine: Copied 2 files to /home/weewx/public_html/belchertown
Feb 20 11:29:46 weewx[19] DEBUG weewx.manager: Daily summary version is 4.0
Feb 20 11:29:46 weewx[19] DEBUG weewx.reportengine: Report 'FTP' not enabled. Skipping.
Feb 20 11:29:46 weewx[19] DEBUG weewx.reportengine: Report 'RSYNC' not enabled. Skipping.

An here the configuration in weewx.conf:

[MQTTSubscribeDriver]
    # This section is for the MQTTSubscribe driver.
    
    # The driver to use:
    driver = user.MQTTSubscribe
    
    # The MQTT server.
    # Default is localhost.
    host = 192.168.xxx.xxx
    
    # The port to connect to.
    # Default is 1883.
    port = 1883
    
    # Maximum period in seconds allowed between communications with the broker.
    # Default is 60.
    keepalive = 60
    
    # username for broker authentication.
    # Default is None.
    username = None
    
    # password for broker authentication.
    # Default is None.
    password = None
    
    # Configuration for the message callback.
    [[message_callback]]
        type = json
    
    # The topics to subscribe to.
    [[topics]]
        unit_system = METRIC
        [[[zigbee2mqtt/temp_balkon_02]]]
        [[[Battery]]]
            ignore = True
        [[[linkquality]]]
            ignore = True
        [[[temperature]]]
            name = outTemp
            ignore = False
            contains_total = False
            conversion_type = float
            units = degree_C
        [[[humidity]]]
            name = outHumidity
            ignore = False
        [[[pressure]]]
            name = pressure
            ignore = False
        [[[voltage]]]
            ignore = True

and

[StdReport]
    
    # Where the skins reside, relative to WEEWX_ROOT
    SKIN_ROOT = skins
    
    # Where the generated reports should go, relative to WEEWX_ROOT
    HTML_ROOT = public_html
    
    # The database binding indicates which data should be used in reports.
    data_binding = wx_binding
    
    # Whether to log a successful operation
    log_success = True
    
    # Whether to log an unsuccessful operation
    log_failure = True
    
    # Each of the following subsections defines a report that will be run.
    # See the customizing guide to change the units, plot types and line
    # colors, modify the fonts, display additional sensor data, and other
    # customizations. Many of those changes can be made here by overriding
    # parameters, or by modifying templates within the skin itself.
    
    [[SeasonsReport]]
        # The SeasonsReport uses the 'Seasons' skin, which contains the
        # images, templates and plots for the report.
        skin = Seasons
        enable = false
    
    [[SmartphoneReport]]
        # The SmartphoneReport uses the 'Smartphone' skin, and the images and
        # files are placed in a dedicated subdirectory.
        skin = Smartphone
        enable = false
        HTML_ROOT = public_html/smartphone
    
    [[MobileReport]]
        # The MobileReport uses the 'Mobile' skin, and the images and files
        # are placed in a dedicated subdirectory.
        skin = Mobile
        enable = false
        HTML_ROOT = public_html/mobile
    
    [[StandardReport]]
        # This is the old "Standard" skin. By default, it is not enabled.
        skin = Standard
        enable = false
    [[Belchertown]]
        skin = Belchertown
        HTML_ROOT = public_html/belchertown
        enable = true

So can you help me with the configuration? Did I forget something important?

I testet my setup with the "Simulator" driver. With Simulator I coud find values in the graphs on the Belchertown-Skin.

Thanks for your help in advance and best regards - Daniel

bellrichm · 2022-02-21T12:38:39Z

bellrichm
Feb 21, 2022
Maintainer

I see that MQTTSubscribe is creating loop packets. The next thing to verify is the content of the archive records that WeeWX creates. The easiest way is to run WeeWX from the command line and look for lines that start with REC:
rich

1 reply

bellrichm Feb 24, 2022
Maintainer

Did you get this working?

Daniel-WW · 2022-03-02T10:01:56Z

Daniel-WW
Mar 2, 2022
Author

Hello rich, an thanks for your advice. From the commad line I got the following output. I can find REC, but I guess it doesn't work correctly:

LOOP:   2022-03-02 10:54:34 CET (1646214874) altimeter: 30.18889179101684, battery: 57.0, dateTime: 1646214874.5726442, humidity: 61.65, linkquality: 247.0, maxSolarRad: None, pressure: 29.94045432625, rainRate: 0.0, temperature: 7.78, usUnits: 1, voltage: 2925.0
LOOP:   2022-03-02 10:55:45 CET (1646214945) altimeter: 30.18889179101684, battery: 57.0, dateTime: 1646214945.3330455, humidity: 61.65, linkquality: 247.0, maxSolarRad: None, pressure: 29.94045432625, rainRate: 0.0, temperature: 7.26, usUnits: 1, voltage: 2925.0
REC:    2022-03-02 10:55:00 CET (1646214900) ET: None, altimeter: 30.188663102267146, battery: 57.0, dateTime: 1646214900, humidity: 61.649999999999984, interval: 5.0, linkquality: 244.53846153846155, maxSolarRad: None, pressure: 29.940227172500002, rainRate: 0.0, temperature: 8.227692307692308, usUnits: 1, voltage: 2925.0
Exception in thread MQTT:
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
    self.run()
  File "/home/weewx/bin/weewx/restx.py", line 354, in run
    self.run_loop(_manager)
  File "/home/weewx/bin/weewx/restx.py", line 381, in run_loop
    self.process_record(_record, dbmanager)
  File "/home/weewx/bin/user/mqtt.py", line 494, in process_record
    mc.connect(url.hostname, url.port)
  File "/opt/venv/lib/python3.10/site-packages/paho/mqtt/client.py", line 912, in connect
    self.connect_async(host, port, keepalive,
  File "/opt/venv/lib/python3.10/site-packages/paho/mqtt/client.py", line 978, in connect_async
    raise ValueError('Invalid host.')
ValueError: Invalid host.
LOOP:   2022-03-02 10:55:45 CET (1646214945) altimeter: 30.18591883763215, battery: 57.0, dateTime: 1646214945.366733, humidity: 61.65, linkquality: 239.0, maxSolarRad: None, pressure: 29.937501327499998, rainRate: 0.0, temperature: 7.26, usUnits: 1, voltage: 2925.0
/opt/venv/lib/python3.10/site-packages/Cheetah/Compiler.py:1629: UserWarning: 
You don't have the C version of NameMapper installed! I'm disabling Cheetah's useStackFrames option as it is painfully slow with the Python version of NameMapper. You should get a copy of Cheetah with compiled C version of NameMapper.
  warnings.warn(
Traceback (most recent call last):
  File "/home/weewx/bin/weewx/reportengine.py", line 196, in run
    obj.start()
  File "/home/weewx/bin/weewx/reportengine.py", line 281, in start
    self.run()
  File "/home/weewx/bin/weewx/cheetahgenerator.py", line 152, in run
    ngen = self.generate(gen_dict[section_name], self.gen_ts)
  File "/home/weewx/bin/weewx/cheetahgenerator.py", line 222, in generate
    ngen += self.generate(section[subsection], gen_ts)
  File "/home/weewx/bin/weewx/cheetahgenerator.py", line 222, in generate
    ngen += self.generate(section[subsection], gen_ts)
  File "/home/weewx/bin/weewx/cheetahgenerator.py", line 310, in generate
    searchList = self._getSearchList(encoding, timespan,
  File "/home/weewx/bin/weewx/cheetahgenerator.py", line 387, in _getSearchList
    searchList += obj.get_extension_list(timespan, db_lookup)
  File "/home/weewx/bin/user/belchertown.py", line 431, in get_extension_list
    at_outTemp_max_range_max_tuple = (at_outTemp_max_range_query[3], outTemp_unit, 'group_temperature')
TypeError: 'NoneType' object is not subscriptable
LOOP:   2022-03-02 10:58:06 CET (1646215086) altimeter: 30.18591883763215, battery: 57.0, dateTime: 1646215086.620869, humidity: 61.65, linkquality: 255.0, maxSolarRad: None, pressure: 29.937501327499998, rainRate: 0.0, temperature: 6.72, usUnits: 1, voltage: 2925.0
LOOP:   2022-03-02 10:58:06 CET (1646215086) altimeter: 30.18591883763215, battery: 57.0, dateTime: 1646215086.6447556, humidity: 61.65, linkquality: 247.0, maxSolarRad: None, pressure: 29.937501327499998, rainRate: 0.0, temperature: 6.72, usUnits: 1, voltage: 2925.0

Would be grateful for some further help! - Thanks and regards Daniel

0 replies

bellrichm · 2022-03-04T17:33:17Z

bellrichm
Mar 4, 2022
Maintainer

Thanks. I see three problems.

I’m not sure where this is coming from.

  File "/usr/local/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
    self.run()
  File "/home/weewx/bin/weewx/restx.py", line 354, in run
    self.run_loop(_manager)
  File "/home/weewx/bin/weewx/restx.py", line 381, in run_loop
    self.process_record(_record, dbmanager)
  File "/home/weewx/bin/user/mqtt.py", line 494, in process_record
    mc.connect(url.hostname, url.port)
  File "/opt/venv/lib/python3.10/site-packages/paho/mqtt/client.py", line 912, in connect
    self.connect_async(host, port, keepalive,
  File "/opt/venv/lib/python3.10/site-packages/paho/mqtt/client.py", line 978, in connect_async
    raise ValueError('Invalid host.')
ValueError: Invalid host.

This looks like a belchertown error.

Traceback (most recent call last):
  File "/home/weewx/bin/weewx/reportengine.py", line 196, in run
    obj.start()
  File "/home/weewx/bin/weewx/reportengine.py", line 281, in start
    self.run()
  File "/home/weewx/bin/weewx/cheetahgenerator.py", line 152, in run
    ngen = self.generate(gen_dict[section_name], self.gen_ts)
  File "/home/weewx/bin/weewx/cheetahgenerator.py", line 222, in generate
    ngen += self.generate(section[subsection], gen_ts)
  File "/home/weewx/bin/weewx/cheetahgenerator.py", line 222, in generate
    ngen += self.generate(section[subsection], gen_ts)
  File "/home/weewx/bin/weewx/cheetahgenerator.py", line 310, in generate
    searchList = self._getSearchList(encoding, timespan,
  File "/home/weewx/bin/weewx/cheetahgenerator.py", line 387, in _getSearchList
    searchList += obj.get_extension_list(timespan, db_lookup)
  File "/home/weewx/bin/user/belchertown.py", line 431, in get_extension_list
    at_outTemp_max_range_max_tuple = (at_outTemp_max_range_query[3], outTemp_unit, 'group_temperature')
TypeError: 'NoneType' object is not subscriptable

In your first post I did miss that there is a MQTTSubscribe error. Notice in the loop that the temperature not renamed to outTemp.

LOOP:   2022-03-02 10:54:34 CET (1646214874) altimeter: 30.18889179101684, battery: 57.0, dateTime: 1646214874.5726442, humidity: 61.65, linkquality: 247.0, maxSolarRad: None, pressure: 29.94045432625, rainRate: 0.0, temperature: 7.78, usUnits: 1, voltage: 2925.0

This is because the fields only have 3 [ They should have 4. It should look something like this.

    # The topics to subscribe to.
    [[topics]]
        unit_system = METRIC
        [[[zigbee2mqtt/temp_balkon_02]]]
            [[[[Battery]]]]
                ignore = True
            [[[[linkquality]]]]
                ignore = True
            [[[[temperature]]]]
                name = outTemp
                ignore = False
                contains_total = False
                conversion_type = float
                units = degree_C
            [[[[humidity]]]]
                name = outHumidity
                ignore = False
            [[[[pressure]]]]
                name = pressure
                ignore = False
            [[[[voltage]]]]
                ignore = True

We should get the MQTTSubscribe error fixed before you ask for help with the other two.
rich

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

no data shown in reports / Belchertown skin #147

{{title}}

Replies: 3 comments 1 reply

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

no data shown in reports / Belchertown skin #147

Daniel-WW Feb 20, 2022

Replies: 3 comments · 1 reply

bellrichm Feb 21, 2022 Maintainer

bellrichm Feb 24, 2022 Maintainer

Daniel-WW Mar 2, 2022 Author

bellrichm Mar 4, 2022 Maintainer

Daniel-WW
Feb 20, 2022

Replies: 3 comments 1 reply

bellrichm
Feb 21, 2022
Maintainer

bellrichm Feb 24, 2022
Maintainer

Daniel-WW
Mar 2, 2022
Author

bellrichm
Mar 4, 2022
Maintainer