File tree 1 file changed +5
-4
lines changed
datafusion/datasource/src
1 file changed +5
-4
lines changed Original file line number Diff line number Diff line change @@ -864,10 +864,11 @@ impl FileScanConfig {
864
864
/// files within each partition maintain sort order based on their min/max statistics.
865
865
///
866
866
/// The algorithm works by:
867
- /// 1. Sorting all files by their minimum values
868
- /// 2. Trying to place each file into an existing group where it can maintain sort order
869
- /// 3. Creating new groups when necessary if a file cannot fit into existing groups
870
- /// 4. Prioritizing smaller groups when multiple suitable groups exist (for load balancing)
867
+ /// 1. Takes files sorted by minimum values
868
+ /// 2. For each file:
869
+ /// - Finds eligible groups (empty or where file's min > group's last max)
870
+ /// - Selects the smallest eligible group
871
+ /// - Creates a new group if needed
871
872
///
872
873
/// # Parameters
873
874
/// * `table_schema`: Schema containing information about the columns
You can’t perform that action at this time.
0 commit comments