Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[source-mysql] 3.9.0-rc.25 doesn't import view table anymore #49804

Open
1 task
oliviertassinari opened this issue Dec 15, 2024 · 4 comments
Open
1 task

[source-mysql] 3.9.0-rc.25 doesn't import view table anymore #49804

oliviertassinari opened this issue Dec 15, 2024 · 4 comments
Assignees
Labels
area/connectors Connector related issues autoteam community connectors/source/mysql team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/bug Something isn't working

Comments

@oliviertassinari
Copy link

oliviertassinari commented Dec 15, 2024

Connector Name

source-mysql

Connector Version

3.9.0-rc.25

What step the error happened?

During the sync

Relevant information

This logic is wrong:

val quickCount =
"SELECT GREATEST(10, table_rows) FROM information_schema.tables WHERE table_schema = '$namespace' AND table_name = '$name'"
val greatest = "GREATEST($greatestRate, $sampleSize / ($quickCount))"

SELECT GREATEST(null, 1);
-- returns `NULL`, MySQL v8.0.39-30.

Why does it happen? Because I'm syncing a view (TABLE_TYPE = VIEW), it's not a regular table:

SCR-20241210-nidm

So I believe #48035 is not correct.

Relevant log output

We used to sync all the records with:

SCR-20241210-nglt

https://cloud.airbyte.com/workspaces/9e090881-de2e-48c7-b268-2e86ad2525d9/connections/b46a92b8-8aa3-44e9-b17a-26067781a1cc/timeline

and now since https://cloud.airbyte.com/workspaces/9e090881-de2e-48c7-b268-2e86ad2525d9/connections/b46a92b8-8aa3-44e9-b17a-26067781a1cc/timeline

SCR-20241210-ngqb

It syncs 0 records.

Contribute

@marcosmarxm
Copy link
Member

Thank you for reporting the issue, @oliviertassinari. @xiaohansong and @rodireich, could someone have a look into this?

@marcosmarxm marcosmarxm added connectors/source/mysql team/db-dw-sources Backlog for Database and Data Warehouse Sources team and removed needs-triage team/connectors-python labels Dec 16, 2024
@rodireich
Copy link
Contributor

Thanks I'm taking a look.

@rodireich rodireich self-assigned this Dec 19, 2024
@rodireich
Copy link
Contributor

[connection]
Another workspace with the same issue.
We rolled them back to legacy mysql until we get Views working

thanks @yardencarmeli

@oliviertassinari
Copy link
Author

oliviertassinari commented Dec 21, 2024

Another workspace with the same issue.

@rodireich It's the same workplace, actually.

We rolled them back to legacy mysql until we get Views working

Thanks, I couldn't find how to do it with the UI. Seems impossible, maybe another feature request?

Why was it upgraded to an unstable version in the first place (RC)? Could this be another bug? It looks like https://docs.airbyte.com/managing-airbyte/connector-updates#airbyte-cloud is not how it behaves in practice. Minor, patch, aren't applied, e.g. MySQL. Major aren't applied e.g. PostgreSQL or not correctly, e.g. MySQL. The self-hosting path looks better than current Cloud behavior. Even better would be https://www.getdbt.com/blog/introducing-release-tracks-for-dbt-version-upgrades.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues autoteam community connectors/source/mysql team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants