You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I may have a pandas DataFrame containing data that is not in the form that SDV expects. For example, I may have a column of dtype object in which the column values are dictionaries. This is not really supported from SDV right now, as it only models data that is int, float, strings, etc.
In such a case, the detect_from_dataframes function crashes with an error such as:
TypeError: unhashable type: 'dict'
This isn't really helpful in telling me which particular column or table is having an issue.
Expected behavior
As we detect metadata from a DataFrame, column by column, it would be useful to wrap the detection code in a try/catch statement. That way, if there is an error, we can print out the table/column name (in addition to the original error).
Eg.
InvalidDataError: Unable to detect metadata for table 'users' column 'age' due to an invalid data format.
TypeError: unhashable type: 'dict'
It would be nice if the original stack trace were also provided.
The text was updated successfully, but these errors were encountered:
Problem Description
This problem was first observed in #2323.
I may have a pandas DataFrame containing data that is not in the form that SDV expects. For example, I may have a column of dtype
object
in which the column values are dictionaries. This is not really supported from SDV right now, as it only models data that is int, float, strings, etc.In such a case, the
detect_from_dataframes
function crashes with an error such as:This isn't really helpful in telling me which particular column or table is having an issue.
Expected behavior
As we detect metadata from a DataFrame, column by column, it would be useful to wrap the detection code in a try/catch statement. That way, if there is an error, we can print out the table/column name (in addition to the original error).
Eg.
It would be nice if the original stack trace were also provided.
The text was updated successfully, but these errors were encountered: