You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
General Question
I have about 10k csv files for edges and 16k files for vertices. They are organized under the same directories so for path in the importer config I used wildcard for csv file names. ./data/vertex/*.csv and ../data/edge/*.csv. The importer execution completed successfully, but records loaded was a lot smaller than expected. When I search for "add import source successfully", there's just 2527 occurrences, meaning only 2527 csv files were imported. I wonder if there's any limit on the number of csv files allowed for each import or this is a bug?
The text was updated successfully, but these errors were encountered:
I later tried repartition the data into bigger CSVs. I ended up with 100 edge files and 250 vertex files, this time all of them were imported. However, when I went further up with the data size (previously 15G, this time 150G), this time with 200 edge files and 500 vertex files, all the vertex files were loaded but only 133 edge files were loaded.
General Question
I have about 10k csv files for edges and 16k files for vertices. They are organized under the same directories so for path in the importer config I used wildcard for csv file names.
./data/vertex/*.csv
and../data/edge/*.csv.
The importer execution completed successfully, but records loaded was a lot smaller than expected. When I search for "add import source successfully", there's just 2527 occurrences, meaning only 2527 csv files were imported. I wonder if there's any limit on the number of csv files allowed for each import or this is a bug?The text was updated successfully, but these errors were encountered: