ref(consumers): Remove ErrorsProcessor

[untitaker]

This processor has been implemented in
rust_snuba/src/processors/errors.rs for quite a while now, and deployed in US region since then. The python one should no longer be needed.

• Fix a user-facing bug where HTTP referers were no longer searchable, as the http_referer column would always hold an empty string. The new behavior is that any HTTP header like Referer or Referrer would be used.
• Apparently the rust processor uses different hyphenization in contexts[trace_id] than the python one. nobody noticed this as we use a top-level trace_id column.

[codecov]

❌ 1 Tests Failed:

Tests completed	Failed	Passed	Skipped
893	1	892	3

View the top 1 failed tests by shortest run time

tests.datasets.test_errors_processor.TestErrorsProcessor::test_errors_replayid_context

Stack Traces | 0.034s run time

Traceback (most recent call last):
  File ".../tests/datasets/test_errors_processor.py", line 479, in test_errors_replayid_context
    assert self.processor.process_message(payload, meta) == InsertBatch(
AssertionError: assert InsertBatch(rows=[{'contexts.key': ['geo.city', 'geo.country_code', 'geo.region', 'geo.subdivision', 'runtime.build', 'runtime.name', 'runtime.version', 'trace.span_id', 'trace.trace_id'], 'contexts.value': ['fake_city', 'XY', 'fake_region', 'fake_subdivision', '3.7.6', 'CPython', '3.7.6', 'deadbeef', 'ae3f5dcb0af34547b918679ca4610be8'], 'culprit': 'snuba.clickhouse.http in write', 'deleted': 0, 'dist': 'dist', 'environment': 'prod', 'event_id': 'dcb9d002-cac5-48c7-95d1-c9adbfc68040', 'exception_frames.abs_path': ['.../local/bin/snuba'], 'exception_frames.colno': [None], 'exception_frames.filename': ['snuba'], 'exception_frames.function': ['<module>'], 'exception_frames.in_app': [False], 'exception_frames.lineno': [11], 'exception_frames.module': ['__main__'], 'exception_frames.package': [None], 'exception_frames.stack_level': [0], 'exception_stacks.mechanism_handled': [0], 'exception_stacks.mechanism_type': ['excepthook'], 'exception_stacks.type': ['ClickHouseError'], 'exception_stacks.value': ['[171] DB::Exception: Block structure mismatch'], 'group_id': 100, 'http_method': 'POST', 'http_referer': 'tagstore.something', 'ip_address_v4': '127.0.0.1', 'level': 'error', 'location': 'snuba/clickhouse/http.py', 'message_timestamp': 1735836382, 'message': '', 'modules.name': ['cffi', 'ipython-genutils', 'isodate'], 'modules.version': ['1.13.2', '0.2.0', '0.6.0'], 'num_processing_errors': 0, 'offset': 2, 'partition': 2, 'platform': 'python', 'primary_hash': '04233d08-ac90-cf6f-c015-b1be5932e7e2', 'project_id': 2, 'received': 1735836377, 'release': '1.0.0', 'replay_id': '9147a4fd-8287-4ccb-a481-88b74fa19009', 'retention_days': 90, 'sdk_integrations': ['argv', 'atexit', 'dedupe', 'excepthook', 'logging', 'modules', 'stdlib', 'threading'], 'sdk_name': 'sentry.python', 'sdk_version': '0.0.0.0.1', 'span_id': 3735928559, 'tags.key': ['environment', 'handled', 'level', 'mechanism', 'runtime', 'runtime.name', 'sentry:dist', 'sentry:release', 'sentry:user', 'server_name'], 'tags.value': ['prod', 'no', 'error', 'excepthook', 'CPython 3.7.6', 'CPython', 'dist', '1.0.0', 'this_is_me', 'snuba'], 'timestamp': 1735836382, 'title': 'ClickHouseError: [171] DB::Exception: Block structure mismatch', 'trace_id': 'ae3f5dcb-0af3-4547-b918-679ca4610be8', 'transaction_name': '', 'type': 'error', 'user_email': '[email protected]', 'user_id': 'still_me', 'user_name': 'me', 'user': 'this_is_me', 'version': '7'}], origin_timestamp=None, sentry_received_timestamp=None) == InsertBatch(rows=[{'project_id': 2, 'timestamp': 1735836382, 'event_id': 'dcb9d002-cac5-48c7-95d1-c9adbfc68040', 'platform': 'python', 'dist': 'dist', 'environment': 'prod', 'release': '1.0.0', 'ip_address_v4': '127.0.0.1', 'user': 'this_is_me', 'user_name': 'me', 'user_id': 'still_me', 'user_email': '[email protected]', 'sdk_name': 'sentry.python', 'sdk_version': '0.0.0.0.1', 'http_method': 'POST', 'http_referer': 'tagstore.something', 'trace_id': 'ae3f5dcb-0af3-4547-b918-679ca4610be8', 'span_id': 3735928559, 'tags.key': ['environment', 'handled', 'level', 'mechanism', 'replayId', 'runtime', 'runtime.name', 'sentry:dist', 'sentry:release', 'sentry:user', 'server_name'], 'tags.value': ['prod', 'no', 'error', 'excepthook', '9147a4fd82874ccba48188b74fa19009', 'CPython 3.7.6', 'CPython', 'dist', '1.0.0', 'this_is_me', 'snuba'], 'contexts.key': ['geo.city', 'geo.country_code', 'geo.region', 'geo.subdivision', 'runtime.build', 'runtime.name', 'runtime.version', 'trace.span_id', 'trace.trace_id'], 'contexts.value': ['fake_city', 'XY', 'fake_region', 'fake_subdivision', '3.7.6', 'CPython', '3.7.6', 'deadbeef', 'ae3f5dcb0af34547b918679ca4610be8'], 'partition': 2, 'offset': 2, 'message_timestamp': 1735836382, 'retention_days': 90, 'deleted': 0, 'group_id': 100, 'primary_hash': '04233d08-ac90-cf6f-c015-b1be5932e7e2', 'received': 1735836377, 'message': '', 'title': 'ClickHouseError: [171] DB::Exception: Block structure mismatch', 'culprit': 'snuba.clickhouse.http in write', 'level': 'error', 'location': 'snuba/clickhouse/http.py', 'version': '7', 'type': 'error', 'exception_stacks.type': ['ClickHouseError'], 'exception_stacks.value': ['[171] DB::Exception: Block structure mismatch'], 'exception_stacks.mechanism_type': ['excepthook'], 'exception_stacks.mechanism_handled': [0], 'exception_frames.abs_path': ['.../local/bin/snuba'], 'exception_frames.colno': [None], 'exception_frames.filename': ['snuba'], 'exception_frames.lineno': [11], 'exception_frames.in_app': [False], 'exception_frames.package': [None], 'exception_frames.module': ['__main__'], 'exception_frames.function': ['<module>'], 'exception_frames.stack_level': [0], 'sdk_integrations': ['argv', 'atexit', 'dedupe', 'excepthook', 'logging', 'modules', 'stdlib', 'threading'], 'modules.name': ['cffi', 'ipython-genutils', 'isodate'], 'modules.version': ['1.13.2', '0.2.0', '0.6.0'], 'transaction_name': '', 'num_processing_errors': 0, 'replay_id': '9147a4fd-8287-4ccb-a481-88b74fa19009'}], origin_timestamp=<ANY>, sentry_received_timestamp=None)
  
  Matching attributes:
  ['origin_timestamp', 'sentry_received_timestamp']
  Differing attributes:
  ['rows']
  
  Drill down into differing attribute rows:
    rows: [{'contexts.key': ['geo.city', 'geo.country_code', 'geo.region', 'geo.subdivision', 'runtime.build', 'runtime.name', 'runtime.version', 'trace.span_id', 'trace.trace_id'], 'contexts.value': ['fake_city', 'XY', 'fake_region', 'fake_subdivision', '3.7.6', 'CPython', '3.7.6', 'deadbeef', 'ae3f5dcb0af34547b918679ca4610be8'], 'culprit': 'snuba.clickhouse.http in write', 'deleted': 0, 'dist': 'dist', 'environment': 'prod', 'event_id': 'dcb9d002-cac5-48c7-95d1-c9adbfc68040', 'exception_frames.abs_path': ['.../local/bin/snuba'], 'exception_frames.colno': [None], 'exception_frames.filename': ['snuba'], 'exception_frames.function': ['<module>'], 'exception_frames.in_app': [False], 'exception_frames.lineno': [11], 'exception_frames.module': ['__main__'], 'exception_frames.package': [None], 'exception_frames.stack_level': [0], 'exception_stacks.mechanism_handled': [0], 'exception_stacks.mechanism_type': ['excepthook'], 'exception_stacks.type': ['ClickHouseError'], 'exception_stacks.value': ['[171] DB::Exception: Block structure mismatch'], 'group_id': 100, 'http_method': 'POST', 'http_referer': 'tagstore.something', 'ip_address_v4': '127.0.0.1', 'level': 'error', 'location': 'snuba/clickhouse/http.py', 'message_timestamp': 1735836382, 'message': '', 'modules.name': ['cffi', 'ipython-genutils', 'isodate'], 'modules.version': ['1.13.2', '0.2.0', '0.6.0'], 'num_processing_errors': 0, 'offset': 2, 'partition': 2, 'platform': 'python', 'primary_hash': '04233d08-ac90-cf6f-c015-b1be5932e7e2', 'project_id': 2, 'received': 1735836377, 'release': '1.0.0', 'replay_id': '9147a4fd-8287-4ccb-a481-88b74fa19009', 'retention_days': 90, 'sdk_integrations': ['argv', 'atexit', 'dedupe', 'excepthook', 'logging', 'modules', 'stdlib', 'threading'], 'sdk_name': 'sentry.python', 'sdk_version': '0.0.0.0.1', 'span_id': 3735928559, 'tags.key': ['environment', 'handled', 'level', 'mechanism', 'runtime', 'runtime.name', 'sentry:dist', 'sentry:release', 'sentry:user', 'server_name'], 'tags.value': ['prod', 'no', 'error', 'excepthook', 'CPython 3.7.6', 'CPython', 'dist', '1.0.0', 'this_is_me', 'snuba'], 'timestamp': 1735836382, 'title': 'ClickHouseError: [171] DB::Exception: Block structure mismatch', 'trace_id': 'ae3f5dcb-0af3-4547-b918-679ca4610be8', 'transaction_name': '', 'type': 'error', 'user_email': '[email protected]', 'user_id': 'still_me', 'user_name': 'me', 'user': 'this_is_me', 'version': '7'}] != [{'project_id': 2, 'timestamp': 1735836382, 'event_id': 'dcb9d002-cac5-48c7-95d1-c9adbfc68040', 'platform': 'python', 'dist': 'dist', 'environment': 'prod', 'release': '1.0.0', 'ip_address_v4': '127.0.0.1', 'user': 'this_is_me', 'user_name': 'me', 'user_id': 'still_me', 'user_email': '[email protected]', 'sdk_name': 'sentry.python', 'sdk_version': '0.0.0.0.1', 'http_method': 'POST', 'http_referer': 'tagstore.something', 'trace_id': 'ae3f5dcb-0af3-4547-b918-679ca4610be8', 'span_id': 3735928559, 'tags.key': ['environment', 'handled', 'level', 'mechanism', 'replayId', 'runtime', 'runtime.name', 'sentry:dist', 'sentry:release', 'sentry:user', 'server_name'], 'tags.value': ['prod', 'no', 'error', 'excepthook', '9147a4fd82874ccba48188b74fa19009', 'CPython 3.7.6', 'CPython', 'dist', '1.0.0', 'this_is_me', 'snuba'], 'contexts.key': ['geo.city', 'geo.country_code', 'geo.region', 'geo.subdivision', 'runtime.build', 'runtime.name', 'runtime.version', 'trace.span_id', 'trace.trace_id'], 'contexts.value': ['fake_city', 'XY', 'fake_region', 'fake_subdivision', '3.7.6', 'CPython', '3.7.6', 'deadbeef', 'ae3f5dcb0af34547b918679ca4610be8'], 'partition': 2, 'offset': 2, 'message_timestamp': 1735836382, 'retention_days': 90, 'deleted': 0, 'group_id': 100, 'primary_hash': '04233d08-ac90-cf6f-c015-b1be5932e7e2', 'received': 1735836377, 'message': '', 'title': 'ClickHouseError: [171] DB::Exception: Block structure mismatch', 'culprit': 'snuba.clickhouse.http in write', 'level': 'error', 'location': 'snuba/clickhouse/http.py', 'version': '7', 'type': 'error', 'exception_stacks.type': ['ClickHouseError'], 'exception_stacks.value': ['[171] DB::Exception: Block structure mismatch'], 'exception_stacks.mechanism_type': ['excepthook'], 'exception_stacks.mechanism_handled': [0], 'exception_frames.abs_path': ['.../local/bin/snuba'], 'exception_frames.colno': [None], 'exception_frames.filename': ['snuba'], 'exception_frames.lineno': [11], 'exception_frames.in_app': [False], 'exception_frames.package': [None], 'exception_frames.module': ['__main__'], 'exception_frames.function': ['<module>'], 'exception_frames.stack_level': [0], 'sdk_integrations': ['argv', 'atexit', 'dedupe', 'excepthook', 'logging', 'modules', 'stdlib', 'threading'], 'modules.name': ['cffi', 'ipython-genutils', 'isodate'], 'modules.version': ['1.13.2', '0.2.0', '0.6.0'], 'transaction_name': '', 'num_processing_errors': 0, 'replay_id': '9147a4fd-8287-4ccb-a481-88b74fa19009'}]
    At index 0 diff: {'contexts.key': ['geo.city', 'geo.country_code', 'geo.region', 'geo.subdivision', 'runtime.build', 'runtime.name', 'runtime.version', 'trace.span_id', 'trace.trace_id'], 'contexts.value': ['fake_city', 'XY', 'fake_region', 'fake_subdivision', '3.7.6', 'CPython', '3.7.6', 'deadbeef', 'ae3f5dcb0af34547b918679ca4610be8'], 'culprit': 'snuba.clickhouse.http in write', 'deleted': 0, 'dist': 'dist', 'environment': 'prod', 'event_id': 'dcb9d002-cac5-48c7-95d1-c9adbfc68040', 'exception_frames.abs_path': ['.../local/bin/snuba'], 'exception_frames.colno': [None], 'exception_frames.filename': ['snuba'], 'exception_frames.function': ['<module>'], 'exception_frames.in_app': [False], 'exception_frames.lineno': [11], 'exception_frames.module': ['__main__'], 'exception_frames.package': [None], 'exception_frames.stack_level': [0], 'exception_stacks.mechanism_handled': [0], 'exception_stacks.mechanism_type': ['excepthook'], 'exception_stacks.type': ['ClickHouseError'], 'exception_stacks.value': ['[171] DB::Exception: Block structure mismatch'], 'group_id': 100, 'http_method': 'POST', 'http_referer': 'tagstore.something', 'ip_address_v4': '127.0.0.1', 'level': 'error', 'location': 'snuba/clickhouse/http.py', 'message_timestamp': 1735836382, 'message': '', 'modules.name': ['cffi', 'ipython-genutils', 'isodate'], 'modules.version': ['1.13.2', '0.2.0', '0.6.0'], 'num_processing_errors': 0, 'offset': 2, 'partition': 2, 'platform': 'python', 'primary_hash': '04233d08-ac90-cf6f-c015-b1be5932e7e2', 'project_id': 2, 'received': 1735836377, 'release': '1.0.0', 'replay_id': '9147a4fd-8287-4ccb-a481-88b74fa19009', 'retention_days': 90, 'sdk_integrations': ['argv', 'atexit', 'dedupe', 'excepthook', 'logging', 'modules', 'stdlib', 'threading'], 'sdk_name': 'sentry.python', 'sdk_version': '0.0.0.0.1', 'span_id': 3735928559, 'tags.key': ['environment', 'handled', 'level', 'mechanism', 'runtime', 'runtime.name', 'sentry:dist', 'sentry:release', 'sentry:user', 'server_name'], 'tags.value': ['prod', 'no', 'error', 'excepthook', 'CPython 3.7.6', 'CPython', 'dist', '1.0.0', 'this_is_me', 'snuba'], 'timestamp': 1735836382, 'title': 'ClickHouseError: [171] DB::Exception: Block structure mismatch', 'trace_id': 'ae3f5dcb-0af3-4547-b918-679ca4610be8', 'transaction_name': '', 'type': 'error', 'user_email': 'me@myself.org', 'user_id': 'still_me', 'user_name': 'me', 'user': 'this_is_me', 'version': '7'} != {'project_id': 2, 'timestamp': 1735836382, 'event_id': 'dcb9d002-cac5-48c7-95d1-c9adbfc68040', 'platform': 'python', 'dist': 'dist', 'environment': 'prod', 'release': '1.0.0', 'ip_address_v4': '127.0.0.1', 'user': 'this_is_me', 'user_name': 'me', 'user_id': 'still_me', 'user_email': 'me@myself.org', 'sdk_name': 'sentry.python', 'sdk_version': '0.0.0.0.1', 'http_method': 'POST', 'http_referer': 'tagstore.something', 'trace_id': 'ae3f5dcb-0af3-4547-b918-679ca4610be8', 'span_id': 3735928559, 'tags.key': ['environment', 'handled', 'level', 'mechanism', 'replayId', 'runtime', 'runtime.name', 'sentry:dist', 'sentry:release', 'sentry:user', 'server_name'], 'tags.value': ['prod', 'no', 'error', 'excepthook', '9147a4fd82874ccba48188b74fa19009', 'CPython 3.7.6', 'CPython', 'dist', '1.0.0', 'this_is_me', 'snuba'], 'contexts.key': ['geo.city', 'geo.country_code', 'geo.region', 'geo.subdivision', 'runtime.build', 'runtime.name', 'runtime.version', 'trace.span_id', 'trace.trace_id'], 'contexts.value': ['fake_city', 'XY', 'fake_region', 'fake_subdivision', '3.7.6', 'CPython', '3.7.6', 'deadbeef', 'ae3f5dcb0af34547b918679ca4610be8'], 'partition': 2, 'offset': 2, 'message_timestamp': 1735836382, 'retention_days': 90, 'deleted': 0, 'group_id': 100, 'primary_hash': '04233d08-ac90-cf6f-c015-b1be5932e7e2', 'received': 1735836377, 'message': '', 'title': 'ClickHouseError: [171] DB::Exception: Block structure mismatch', 'culprit': 'snuba.clickhouse.http in write', 'level': 'error', 'location': 'snuba/clickhouse/http.py', 'version': '7', 'type': 'error', 'exception_stacks.type': ['ClickHouseError'], 'exception_stacks.value': ['[171] DB::Exception: Block structure mismatch'], 'exception_stacks.mechanism_type': ['excepthook'], 'exception_stacks.mechanism_handled': [0], 'exception_frames.abs_path': ['.../local/bin/snuba'], 'exception_frames.colno': [None], 'exception_frames.filename': ['snuba'], 'exception_frames.lineno': [11], 'exception_frames.in_app': [False], 'exception_frames.package': [None], 'exception_frames.module': ['__main__'], 'exception_frames.function': ['<module>'], 'exception_frames.stack_level': [0], 'sdk_integrations': ['argv', 'atexit', 'dedupe', 'excepthook', 'logging', 'modules', 'stdlib', 'threading'], 'modules.name': ['cffi', 'ipython-genutils', 'isodate'], 'modules.version': ['1.13.2', '0.2.0', '0.6.0'], 'transaction_name': '', 'num_processing_errors': 0, 'replay_id': '9147a4fd-8287-4ccb-a481-88b74fa19009'}
    Full diff:
      [
       {'contexts.key': ['geo.city',
                         'geo.country_code',
                         'geo.region',
                         'geo.subdivision',
                         'runtime.build',
                         'runtime.name',
                         'runtime.version',
                         'trace.span_id',
                         'trace.trace_id'],
        'contexts.value': ['fake_city',
                           'XY',
                           'fake_region',
                           'fake_subdivision',
                           '3.7.6',
                           'CPython',
                           '3.7.6',
                           'deadbeef',
                           'ae3f5dcb0af34547b918679ca4610be8'],
        'culprit': 'snuba.clickhouse.http in write',
        'deleted': 0,
        'dist': 'dist',
        'environment': 'prod',
        'event_id': 'dcb9d002-cac5-48c7-95d1-c9adbfc68040',
        'exception_frames.abs_path': ['.../local/bin/snuba'],
        'exception_frames.colno': [None],
        'exception_frames.filename': ['snuba'],
        'exception_frames.function': ['<module>'],
        'exception_frames.in_app': [False],
        'exception_frames.lineno': [11],
        'exception_frames.module': ['__main__'],
        'exception_frames.package': [None],
        'exception_frames.stack_level': [0],
        'exception_stacks.mechanism_handled': [0],
        'exception_stacks.mechanism_type': ['excepthook'],
        'exception_stacks.type': ['ClickHouseError'],
        'exception_stacks.value': ['[171] DB::Exception: Block structure mismatch'],
        'group_id': 100,
        'http_method': 'POST',
        'http_referer': 'tagstore.something',
        'ip_address_v4': '127.0.0.1',
        'level': 'error',
        'location': 'snuba/clickhouse/http.py',
        'message': '',
        'message_timestamp': 1735836382,
        'modules.name': ['cffi',
                         'ipython-genutils',
                         'isodate'],
        'modules.version': ['1.13.2',
                            '0.2.0',
                            '0.6.0'],
        'num_processing_errors': 0,
        'offset': 2,
        'partition': 2,
        'platform': 'python',
        'primary_hash': '04233d08-ac90-cf6f-c015-b1be5932e7e2',
        'project_id': 2,
        'received': 1735836377,
        'release': '1.0.0',
        'replay_id': '9147a4fd-8287-4ccb-a481-88b74fa19009',
        'retention_days': 90,
        'sdk_integrations': ['argv',
                             'atexit',
                             'dedupe',
                             'excepthook',
                             'logging',
                             'modules',
                             'stdlib',
                             'threading'],
        'sdk_name': 'sentry.python',
        'sdk_version': '0.0.0.0.1',
        'span_id': 3735928559,
        'tags.key': ['environment',
                     'handled',
                     'level',
                     'mechanism',
    -                'replayId',
                     'runtime',
                     'runtime.name',
                     'sentry:dist',
                     'sentry:release',
                     'sentry:user',
                     'server_name'],
        'tags.value': ['prod',
                       'no',
                       'error',
                       'excepthook',
    -                  '9147a4fd82874ccba48188b74fa19009',
                       'CPython 3.7.6',
                       'CPython',
                       'dist',
                       '1.0.0',
                       'this_is_me',
                       'snuba'],
        'timestamp': 1735836382,
        'title': 'ClickHouseError: [171] DB::Exception: Block structure mismatch',
        'trace_id': 'ae3f5dcb-0af3-4547-b918-679ca4610be8',
        'transaction_name': '',
        'type': 'error',
        'user': 'this_is_me',
        'user_email': '[email protected]',
        'user_id': 'still_me',
        'user_name': 'me',
        'version': '7'},
      ]
  Full diff:
  - InsertBatch(rows=[{'project_id': 2, 'timestamp': 1735836382, 'event_id': 'dcb9d002-cac5-48c7-95d1-c9adbfc68040', 'platform': 'python', 'dist': 'dist', 'environment': 'prod', 'release': '1.0.0', 'ip_address_v4': '127.0.0.1', 'user': 'this_is_me', 'user_name': 'me', 'user_id': 'still_me', 'user_email': '[email protected]', 'sdk_name': 'sentry.python', 'sdk_version': '0.0.0.0.1', 'http_method': 'POST', 'http_referer': 'tagstore.something', 'trace_id': 'ae3f5dcb-0af3-4547-b918-679ca4610be8', 'span_id': 3735928559, 'tags.key': ['environment', 'handled', 'level', 'mechanism', 'replayId', 'runtime', 'runtime.name', 'sentry:dist', 'sentry:release', 'sentry:user', 'server_name'], 'tags.value': ['prod', 'no', 'error', 'excepthook', '9147a4fd82874ccba48188b74fa19009', 'CPython 3.7.6', 'CPython', 'dist', '1.0.0', 'this_is_me', 'snuba'], 'contexts.key': ['geo.city', 'geo.country_code', 'geo.region', 'geo.subdivision', 'runtime.build', 'runtime.name', 'runtime.version', 'trace.span_id', 'trace.trace_id'], 'contexts.value': ['fake_city', 'XY', 'fake_region', 'fake_subdivision', '3.7.6', 'CPython', '3.7.6', 'deadbeef', 'ae3f5dcb0af34547b918679ca4610be8'], 'partition': 2, 'offset': 2, 'message_timestamp': 1735836382, 'retention_days': 90, 'deleted': 0, 'group_id': 100, 'primary_hash': '04233d08-ac90-cf6f-c015-b1be5932e7e2', 'received': 1735836377, 'message': '', 'title': 'ClickHouseError: [171] DB::Exception: Block structure mismatch', 'culprit': 'snuba.clickhouse.http in write', 'level': 'error', 'location': 'snuba/clickhouse/http.py', 'version': '7', 'type': 'error', 'exception_stacks.type': ['ClickHouseError'], 'exception_stacks.value': ['[171] DB::Exception: Block structure mismatch'], 'exception_stacks.mechanism_type': ['excepthook'], 'exception_stacks.mechanism_handled': [0], 'exception_frames.abs_path': ['.../local/bin/snuba'], 'exception_frames.colno': [None], 'exception_frames.filename': ['snuba'], 'exception_frames.lineno': [11], 'exception_frames.in_app': [False], 'exception_frames.package': [None], 'exception_frames.module': ['__main__'], 'exception_frames.function': ['<module>'], 'exception_frames.stack_level': [0], 'sdk_integrations': ['argv', 'atexit', 'dedupe', 'excepthook', 'logging', 'modules', 'stdlib', 'threading'], 'modules.name': ['cffi', 'ipython-genutils', 'isodate'], 'modules.version': ['1.13.2', '0.2.0', '0.6.0'], 'transaction_name': '', 'num_processing_errors': 0, 'replay_id': '9147a4fd-8287-4ccb-a481-88b74fa19009'}], origin_timestamp=<ANY>, sentry_received_timestamp=None)
  + InsertBatch(rows=[{'contexts.key': ['geo.city', 'geo.country_code', 'geo.region', 'geo.subdivision', 'runtime.build', 'runtime.name', 'runtime.version', 'trace.span_id', 'trace.trace_id'], 'contexts.value': ['fake_city', 'XY', 'fake_region', 'fake_subdivision', '3.7.6', 'CPython', '3.7.6', 'deadbeef', 'ae3f5dcb0af34547b918679ca4610be8'], 'culprit': 'snuba.clickhouse.http in write', 'deleted': 0, 'dist': 'dist', 'environment': 'prod', 'event_id': 'dcb9d002-cac5-48c7-95d1-c9adbfc68040', 'exception_frames.abs_path': ['.../local/bin/snuba'], 'exception_frames.colno': [None], 'exception_frames.filename': ['snuba'], 'exception_frames.function': ['<module>'], 'exception_frames.in_app': [False], 'exception_frames.lineno': [11], 'exception_frames.module': ['__main__'], 'exception_frames.package': [None], 'exception_frames.stack_level': [0], 'exception_stacks.mechanism_handled': [0], 'exception_stacks.mechanism_type': ['excepthook'], 'exception_stacks.type': ['ClickHouseError'], 'exception_stacks.value': ['[171] DB::Exception: Block structure mismatch'], 'group_id': 100, 'http_method': 'POST', 'http_referer': 'tagstore.something', 'ip_address_v4': '127.0.0.1', 'level': 'error', 'location': 'snuba/clickhouse/http.py', 'message_timestamp': 1735836382, 'message': '', 'modules.name': ['cffi', 'ipython-genutils', 'isodate'], 'modules.version': ['1.13.2', '0.2.0', '0.6.0'], 'num_processing_errors': 0, 'offset': 2, 'partition': 2, 'platform': 'python', 'primary_hash': '04233d08-ac90-cf6f-c015-b1be5932e7e2', 'project_id': 2, 'received': 1735836377, 'release': '1.0.0', 'replay_id': '9147a4fd-8287-4ccb-a481-88b74fa19009', 'retention_days': 90, 'sdk_integrations': ['argv', 'atexit', 'dedupe', 'excepthook', 'logging', 'modules', 'stdlib', 'threading'], 'sdk_name': 'sentry.python', 'sdk_version': '0.0.0.0.1', 'span_id': 3735928559, 'tags.key': ['environment', 'handled', 'level', 'mechanism', 'runtime', 'runtime.name', 'sentry:dist', 'sentry:release', 'sentry:user', 'server_name'], 'tags.value': ['prod', 'no', 'error', 'excepthook', 'CPython 3.7.6', 'CPython', 'dist', '1.0.0', 'this_is_me', 'snuba'], 'timestamp': 1735836382, 'title': 'ClickHouseError: [171] DB::Exception: Block structure mismatch', 'trace_id': 'ae3f5dcb-0af3-4547-b918-679ca4610be8', 'transaction_name': '', 'type': 'error', 'user_email': '[email protected]', 'user_id': 'still_me', 'user_name': 'me', 'user': 'this_is_me', 'version': '7'}], origin_timestamp=None, sentry_received_timestamp=None)

To view more test analytics, go to the Test Analytics Dashboard
📢 Thoughts on this report? Let us know!