Skip to content

Commit 413990b

Browse files
committed
refine doc
1 parent ecbd327 commit 413990b

File tree

1 file changed

+5
-4
lines changed

1 file changed

+5
-4
lines changed

datafusion/datasource/src/file_scan_config.rs

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -864,10 +864,11 @@ impl FileScanConfig {
864864
/// files within each partition maintain sort order based on their min/max statistics.
865865
///
866866
/// The algorithm works by:
867-
/// 1. Sorting all files by their minimum values
868-
/// 2. Trying to place each file into an existing group where it can maintain sort order
869-
/// 3. Creating new groups when necessary if a file cannot fit into existing groups
870-
/// 4. Prioritizing smaller groups when multiple suitable groups exist (for load balancing)
867+
/// 1. Takes files sorted by minimum values
868+
/// 2. For each file:
869+
/// - Finds eligible groups (empty or where file's min > group's last max)
870+
/// - Selects the smallest eligible group
871+
/// - Creates a new group if needed
871872
///
872873
/// # Parameters
873874
/// * `table_schema`: Schema containing information about the columns

0 commit comments

Comments
 (0)