Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mapper ignored silently #92

Open
visch opened this issue Jan 10, 2023 · 0 comments
Open

Mapper ignored silently #92

visch opened this issue Jan 10, 2023 · 0 comments

Comments

@visch
Copy link
Member

visch commented Jan 10, 2023

We expect the output of cat out_fail.txt | poetry run meltano-map-transform --config config.txt > out_mapped to have a 3rd stream of question_prod_1_test created. It isn't created.

Output (out_mapped) is the same as out_fail.txt

Now if you move the SCHEMA message for the User-* stream to the beginning of the file everything works as expected. out_success.txt is an example of this.

(Converted to .txt so it would upload to github, 🙄 )
out_fail.txt
out_success.txt
config.txt

{
    "stream_maps": {
        "question_prod_1_test": {
            "__source__": "User-pzjs3twtm2y4ip6uvfvy6ukhpa-prod"
        }
    }
}

config.txt

re: https://meltano.slack.com/archives/C01TCRBBJD7/p1671688563297449

Very hard to debug this for end meltano users, I think meltano/meltano#3232 would make life a lot easier for folks as you could play around with your mappers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant