Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Spec Proposal: BATCH message type (aka FASTSYNC) #2

Open
aaronsteers opened this issue Aug 11, 2021 · 4 comments
Open

Spec Proposal: BATCH message type (aka FASTSYNC) #2

aaronsteers opened this issue Aug 11, 2021 · 4 comments
Labels
Applies To::Taps Applies To::Targets Issue Type::Proposal Proposal Type::New Capability

Comments

@aaronsteers
Copy link
Contributor

aaronsteers commented Aug 11, 2021 •
edited
Loading

As inspired by the FASTSYNC spec in Pipelinewise and further described here: https://gitlab.com/meltano/sdk/-/issues/9

Meltano also has a WIP spec discussion and issue tracking this here: https://gitlab.com/meltano/sdk/-/issues/9
@aaronsteers aaronsteers changed the title Discuss and review BATCH message type proposal (aka FASTSYNC) Spec Proposal: BATCH message type (aka FASTSYNC) Aug 11, 2021
This was referenced Oct 25, 2021
Open
Open
@louis-pie
Copy link

I think this is a very important feature if someone is ever to migrate from PipelineWise to Meltano

@tayloramurphy tayloramurphy mentioned this issue Feb 18, 2022
Open
@judahrand
Copy link

I think this is a very important feature if someone is ever to migrate from PipelineWise to Meltano

Absolutely, it was a shame that we could not consider Meltano due to the initial size of our tables.

@hhcomply
Copy link

Hi @aaronsteers this is a great idea! Was this feature ever implemented?

@aaronsteers
Copy link
Contributor Author

@hhcomply re:

Hi @aaronsteers this is a great idea! Was this feature ever implemented?

Yes! We implement into the Meltano SDK:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Applies To::Taps Applies To::Targets Issue Type::Proposal Proposal Type::New Capability
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@judahrand @aaronsteers @louis-pie @hhcomply