Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TiCDC example include wrong values #19006

Closed
choudharypankaj opened this issue Sep 25, 2024 · 4 comments · Fixed by #19110
Closed

TiCDC example include wrong values #19006

choudharypankaj opened this issue Sep 25, 2024 · 4 comments · Fixed by #19110
Assignees

Comments

@choudharypankaj
Copy link

File: /release-8.1/ticdc/ticdc-open-protocol.md

INSERT INTO test.t1(id, val) VALUES (1, 'aa');
INSERT INTO test.t1(id, val) VALUES (2, 'aa')

From the following Log 5 and Log 6, you can see that Row Changed Events on the same table might be sent to different partitions based on the primary key, but changes to the same row are sent to the same partition so that the downstream can easily process the Event concurrently.

The corresponding output is wrong:
5. [partition=0] [key="{"ts":415508878783938562,"scm":"test","tbl":"t1","t":1}"] [value="{"u":{"id":{"t":3,"h":true,"v":1},"val":{"t":15,"v":"YWE="}}}"]
6. [partition=1] [key="{"ts":415508878783938562,"scm":"test","tbl":"t1","t":1}"] [value="{"u":{"id":{"t":3,"h":true,"v":2},"val":{"t":15,"v":"YmI="}}}"]

and so are the remaining output values

@qiancai
Copy link
Collaborator

qiancai commented Sep 27, 2024

@3AceShowHand Would you please take a look at the following feedback and update the docs if necessary? Thanks.

@3AceShowHand
Copy link
Contributor

@choudharypankaj Can you explain in more detail, what's wrong with this example ?

@choudharypankaj
Copy link
Author

@3AceShowHand The value is wrong
INSERT INTO test.t1(id, val) VALUES (1, 'aa');

  1. [partition=0] [key="{"ts":415508878783938562,"scm":"test","tbl":"t1","t":1}"]
    [value="{"u":{"id":{"t":3,"h":true,"v":1},
    "val":{"t":15,"v":"YWE="}}}"]

shouldn't it be:

"val":{"t":15,"v":"aa"}}}"]

@qiancai qiancai linked a pull request Oct 14, 2024 that will close this issue
16 tasks
@3AceShowHand
Copy link
Contributor

This example data was copied from the logs, those value is encoded. we have proposed PR to fix this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants