Skip to content

Commit

Permalink
Merge pull request #819 from cal-itp/filter-speeds-avgs
Browse files Browse the repository at this point in the history 
Filter speeds avgs
  • Loading branch information
@tiffanychu90
tiffanychu90 authored Jul 27, 2023
2 parents a08c8f6 + 63ff566 commit ea1eca8
Show file tree
Hide file tree
Showing 9 changed files with 1,143 additions and 1,089 deletions.
1,003 changes: 1,003 additions & 0 deletions rt_segment_speeds/18_speed_distribution.ipynb
View file

Large diffs are not rendered by default.

141 changes: 0 additions & 141 deletions rt_segment_speeds/ca_segment_speeds.ipynb
View file

This file was deleted.

24 changes: 24 additions & 0 deletions rt_segment_speeds/logs/cut_stop_segments.log
View file
Original file line number Diff line number Diff line change
Expand Up @@ -37,3 +37,27 @@
2023-07-25 15:31:25.425 | INFO | __main__:<module>:313 - Cut special stop segments: 0:28:46.570691
2023-07-25 15:31:26.518 | INFO | __main__:<module>:332 - export results: 0:00:01.093220
2023-07-25 15:31:26.520 | INFO | __main__:<module>:333 - execution time: 0:28:47.663911
2023-07-25 16:07:13.609 | INFO | __main__:<module>:198 - Analysis date: 2023-07-12
2023-07-25 16:08:07.369 | INFO | __main__:<module>:240 - Cut normal stop segments: 0:00:53.759088
2023-07-25 16:19:44.770 | INFO | __main__:<module>:252 - Export results: 0:11:37.401262
2023-07-25 16:19:44.770 | INFO | __main__:<module>:255 - execution time: 0:12:31.160955
2023-07-25 16:20:26.164 | INFO | __main__:<module>:293 - Analysis date: 2023-07-12
2023-07-25 16:48:16.067 | INFO | __main__:<module>:313 - Cut special stop segments: 0:27:49.863811
2023-07-25 16:48:17.367 | INFO | __main__:<module>:332 - export results: 0:00:01.299823
2023-07-25 16:48:17.369 | INFO | __main__:<module>:333 - execution time: 0:27:51.163634
2023-07-26 12:20:36.330 | INFO | __main__:<module>:198 - Analysis date: 2023-04-12
2023-07-26 12:21:45.345 | INFO | __main__:<module>:240 - Cut normal stop segments: 0:01:08.999538
2023-07-26 12:38:38.885 | INFO | __main__:<module>:252 - Export results: 0:16:53.539426
2023-07-26 12:38:38.887 | INFO | __main__:<module>:255 - execution time: 0:18:02.541602
2023-07-26 12:39:04.242 | INFO | __main__:<module>:293 - Analysis date: 2023-04-12
2023-07-26 13:24:15.235 | INFO | __main__:<module>:313 - Cut special stop segments: 0:45:10.983686
2023-07-26 13:24:16.470 | INFO | __main__:<module>:332 - export results: 0:00:01.234829
2023-07-26 13:24:16.474 | INFO | __main__:<module>:333 - execution time: 0:45:12.218515
2023-07-26 13:47:14.875 | INFO | __main__:<module>:198 - Analysis date: 2023-03-15
2023-07-26 13:48:21.112 | INFO | __main__:<module>:240 - Cut normal stop segments: 0:01:06.234095
2023-07-26 14:04:28.944 | INFO | __main__:<module>:252 - Export results: 0:16:07.832295
2023-07-26 14:04:28.946 | INFO | __main__:<module>:255 - execution time: 0:17:14.068003
2023-07-26 14:04:55.833 | INFO | __main__:<module>:293 - Analysis date: 2023-03-15
2023-07-26 14:45:50.780 | INFO | __main__:<module>:313 - Cut special stop segments: 0:40:54.937581
2023-07-26 14:45:52.168 | INFO | __main__:<module>:332 - export results: 0:00:01.388009
2023-07-26 14:45:52.170 | INFO | __main__:<module>:333 - execution time: 0:40:56.325590
7 changes: 7 additions & 0 deletions rt_segment_speeds/logs/prep_stop_segments.log
View file
Original file line number Diff line number Diff line change
Expand Up @@ -18,3 +18,10 @@
2023-07-25 14:39:19.717 | INFO | __main__:<module>:290 - Analysis date: 2023-06-14
2023-07-25 14:49:25.861 | INFO | __main__:<module>:297 - Prep stop segment df: 0:10:06.141854
2023-07-25 14:50:12.947 | INFO | __main__:<module>:307 - execution time: 0:10:53.228185
2023-07-25 15:55:48.582 | INFO | __main__:<module>:290 - Analysis date: 2023-07-12
2023-07-26 12:01:47.353 | INFO | __main__:<module>:290 - Analysis date: 2023-04-12
2023-07-26 12:19:11.448 | INFO | __main__:<module>:297 - Prep stop segment df: 0:17:24.080713
2023-07-26 12:20:13.208 | INFO | __main__:<module>:307 - execution time: 0:18:25.839838
2023-07-26 13:31:19.892 | INFO | __main__:<module>:290 - Analysis date: 2023-03-15
2023-07-26 13:45:57.782 | INFO | __main__:<module>:297 - Prep stop segment df: 0:14:37.886934
2023-07-26 13:46:51.502 | INFO | __main__:<module>:307 - execution time: 0:15:31.607489
40 changes: 24 additions & 16 deletions rt_segment_speeds/logs/sjoin_vp_segments.log
View file
Original file line number Diff line number Diff line change
Expand Up @@ -75,19 +75,27 @@
2023-06-30 13:41:14.364 | INFO | __main__:<module>:298 - attach vp to stop-to-stop segments: 0:46:03.991197
2023-06-30 13:42:25.427 | INFO | __main__:<module>:308 - compiled parquets: 0:01:11.062989
2023-06-30 13:42:25.430 | INFO | __main__:<module>:309 - execution time: 0:47:15.054186
2023-07-21 15:14:18.352 | INFO | __main__:<module>:286 - Analysis date: 2023-07-12
2023-07-21 16:00:08.511 | INFO | __main__:<module>:298 - attach vp to stop-to-stop segments: 0:45:50.129886
2023-07-21 16:01:13.055 | INFO | __main__:<module>:308 - compiled parquets: 0:01:04.543964
2023-07-21 16:01:13.056 | INFO | __main__:<module>:309 - execution time: 0:46:54.673850
2023-07-24 15:17:47.583 | INFO | __main__:<module>:286 - Analysis date: 2023-05-17
2023-07-24 15:59:43.505 | INFO | __main__:<module>:298 - attach vp to stop-to-stop segments: 0:41:55.910214
2023-07-24 16:00:43.071 | INFO | __main__:<module>:308 - compiled parquets: 0:00:59.566345
2023-07-24 16:00:43.072 | INFO | __main__:<module>:309 - execution time: 0:42:55.476559
2023-07-24 20:46:21.403 | INFO | __main__:<module>:286 - Analysis date: 2023-06-14
2023-07-24 21:26:37.726 | INFO | __main__:<module>:298 - attach vp to stop-to-stop segments: 0:40:16.322554
2023-07-24 21:27:37.057 | INFO | __main__:<module>:308 - compiled parquets: 0:00:59.331107
2023-07-24 21:27:37.058 | INFO | __main__:<module>:309 - execution time: 0:41:15.653661
2023-07-25 10:03:02.972 | INFO | __main__:<module>:286 - Analysis date: 2023-07-12
2023-07-25 10:47:55.030 | INFO | __main__:<module>:298 - attach vp to stop-to-stop segments: 0:44:52.057560
2023-07-25 10:48:51.630 | INFO | __main__:<module>:308 - compiled parquets: 0:00:56.599756
2023-07-25 10:48:51.630 | INFO | __main__:<module>:309 - execution time: 0:45:48.657316
2023-07-25 16:52:12.138 | INFO | __main__:<module>:286 - Analysis date: 2023-05-17
2023-07-25 17:34:09.962 | INFO | __main__:<module>:298 - attach vp to stop-to-stop segments: 0:41:57.812287
2023-07-25 17:35:06.440 | INFO | __main__:<module>:308 - compiled parquets: 0:00:56.477889
2023-07-25 17:35:06.441 | INFO | __main__:<module>:309 - execution time: 0:42:54.290176
2023-07-25 19:29:22.771 | INFO | __main__:<module>:286 - Analysis date: 2023-06-14
2023-07-25 20:10:03.035 | INFO | __main__:<module>:298 - attach vp to stop-to-stop segments: 0:40:40.263436
2023-07-25 20:11:00.673 | INFO | __main__:<module>:308 - compiled parquets: 0:00:57.637347
2023-07-25 20:11:00.675 | INFO | __main__:<module>:309 - execution time: 0:41:37.900783
2023-07-25 21:27:52.866 | INFO | __main__:<module>:286 - Analysis date: 2023-07-12
2023-07-25 22:11:55.296 | INFO | __main__:<module>:298 - attach vp to stop-to-stop segments: 0:44:02.429077
2023-07-25 22:13:11.709 | INFO | __main__:<module>:308 - compiled parquets: 0:01:16.412710
2023-07-25 22:13:11.713 | INFO | __main__:<module>:309 - execution time: 0:45:18.841787
2023-07-26 15:09:54.854 | INFO | __main__:<module>:286 - Analysis date: 2023-03-15
2023-07-26 16:14:01.117 | INFO | __main__:<module>:298 - attach vp to stop-to-stop segments: 1:04:06.237100
2023-07-26 16:15:04.057 | INFO | __main__:<module>:308 - compiled parquets: 0:01:02.939853
2023-07-26 16:15:04.058 | INFO | __main__:<module>:309 - execution time: 1:05:09.176953
2023-07-26 18:23:50.016 | INFO | __main__:<module>:286 - Analysis date: 2023-03-15
2023-07-26 19:31:45.629 | INFO | __main__:<module>:298 - attach vp to stop-to-stop segments: 1:07:55.611782
2023-07-26 19:32:43.933 | INFO | __main__:<module>:308 - compiled parquets: 0:00:58.304490
2023-07-26 19:32:43.944 | INFO | __main__:<module>:309 - execution time: 1:08:53.916272
2023-07-26 21:21:05.389 | INFO | __main__:<module>:286 - Analysis date: 2023-04-12
2023-07-26 22:22:19.205 | INFO | __main__:<module>:298 - attach vp to stop-to-stop segments: 1:01:13.776816
2023-07-26 22:23:14.796 | INFO | __main__:<module>:308 - compiled parquets: 0:00:55.591754
2023-07-26 22:23:14.798 | INFO | __main__:<module>:309 - execution time: 1:02:09.368570
40 changes: 25 additions & 15 deletions rt_segment_speeds/logs/speeds_by_segment_trip.log
View file
Original file line number Diff line number Diff line change
Expand Up @@ -31,18 +31,28 @@
2023-05-20 10:56:10.880 | INFO | __main__:linear_referencing_and_speed_by_segment:78 - calculate speeds: 0:00:00.000678
2023-05-20 11:50:39.921 | INFO | __main__:<module>:115 - speeds for stop segments: 0:54:29.046501
2023-05-20 11:50:39.924 | INFO | __main__:<module>:116 - execution time: 0:54:29.049154
2023-07-24 16:22:19.702 | INFO | __main__:<module>:116 - Analysis date: 2023-05-17
2023-07-24 16:52:00.420 | INFO | __main__:linear_referencing_and_speed_by_segment:84 - linear referencing: 0:29:40.696934
2023-07-24 16:52:00.426 | INFO | __main__:linear_referencing_and_speed_by_segment:96 - calculate speeds: 0:00:00.006454
2023-07-24 17:19:08.400 | INFO | __main__:<module>:127 - speeds for stop segments: 0:56:48.681858
2023-07-24 17:19:08.401 | INFO | __main__:<module>:128 - execution time: 0:56:48.682781
2023-07-24 21:48:17.827 | INFO | __main__:<module>:116 - Analysis date: 2023-06-14
2023-07-24 22:17:10.701 | INFO | __main__:linear_referencing_and_speed_by_segment:84 - linear referencing: 0:28:52.868856
2023-07-24 22:17:10.707 | INFO | __main__:linear_referencing_and_speed_by_segment:96 - calculate speeds: 0:00:00.005970
2023-07-24 22:43:17.406 | INFO | __main__:<module>:127 - speeds for stop segments: 0:54:59.578336
2023-07-24 22:43:17.407 | INFO | __main__:<module>:128 - execution time: 0:54:59.579301
2023-07-25 11:12:28.456 | INFO | __main__:<module>:116 - Analysis date: 2023-07-12
2023-07-25 11:49:17.338 | INFO | __main__:linear_referencing_and_speed_by_segment:84 - linear referencing: 0:36:48.876648
2023-07-25 11:49:17.344 | INFO | __main__:linear_referencing_and_speed_by_segment:96 - calculate speeds: 0:00:00.006385
2023-07-25 12:16:28.698 | INFO | __main__:<module>:127 - speeds for stop segments: 1:04:00.240843
2023-07-25 12:16:28.699 | INFO | __main__:<module>:128 - execution time: 1:04:00.241659
2023-07-25 17:55:40.998 | INFO | __main__:<module>:116 - Analysis date: 2023-05-17
2023-07-25 18:25:17.498 | INFO | __main__:linear_referencing_and_speed_by_segment:84 - linear referencing: 0:29:36.467955
2023-07-25 18:25:17.508 | INFO | __main__:linear_referencing_and_speed_by_segment:96 - calculate speeds: 0:00:00.009634
2023-07-25 18:51:59.936 | INFO | __main__:<module>:127 - speeds for stop segments: 0:56:18.910904
2023-07-25 18:51:59.937 | INFO | __main__:<module>:128 - execution time: 0:56:18.911558
2023-07-25 20:31:00.338 | INFO | __main__:<module>:116 - Analysis date: 2023-06-14
2023-07-25 20:59:50.907 | INFO | __main__:linear_referencing_and_speed_by_segment:84 - linear referencing: 0:28:50.563683
2023-07-25 20:59:50.913 | INFO | __main__:linear_referencing_and_speed_by_segment:96 - calculate speeds: 0:00:00.006050
2023-07-25 21:26:12.883 | INFO | __main__:<module>:127 - speeds for stop segments: 0:55:12.544803
2023-07-25 21:26:12.884 | INFO | __main__:<module>:128 - execution time: 0:55:12.545554
2023-07-25 22:48:46.313 | INFO | __main__:<module>:116 - Analysis date: 2023-07-12
2023-07-25 23:31:55.464 | INFO | __main__:linear_referencing_and_speed_by_segment:84 - linear referencing: 0:43:09.123043
2023-07-25 23:31:55.493 | INFO | __main__:linear_referencing_and_speed_by_segment:96 - calculate speeds: 0:00:00.028630
2023-07-26 00:00:04.530 | INFO | __main__:<module>:127 - speeds for stop segments: 1:11:18.196214
2023-07-26 00:00:04.531 | INFO | __main__:<module>:128 - execution time: 1:11:18.197170
2023-07-26 20:02:52.083 | INFO | __main__:<module>:116 - Analysis date: 2023-03-15
2023-07-26 20:34:36.201 | INFO | __main__:linear_referencing_and_speed_by_segment:84 - linear referencing: 0:31:44.113095
2023-07-26 20:34:36.209 | INFO | __main__:linear_referencing_and_speed_by_segment:96 - calculate speeds: 0:00:00.007907
2023-07-26 21:12:55.949 | INFO | __main__:<module>:127 - speeds for stop segments: 1:10:03.865319
2023-07-26 21:12:55.950 | INFO | __main__:<module>:128 - execution time: 1:10:03.866321
2023-07-26 22:48:56.041 | INFO | __main__:<module>:116 - Analysis date: 2023-04-12
2023-07-26 23:21:16.317 | INFO | __main__:linear_referencing_and_speed_by_segment:84 - linear referencing: 0:32:20.261839
2023-07-26 23:21:16.327 | INFO | __main__:linear_referencing_and_speed_by_segment:96 - calculate speeds: 0:00:00.009498
2023-07-26 23:50:59.023 | INFO | __main__:<module>:127 - speeds for stop segments: 1:02:02.972239
2023-07-26 23:50:59.024 | INFO | __main__:<module>:128 - execution time: 1:02:02.973670
6 changes: 6 additions & 0 deletions rt_segment_speeds/logs/usable_rt_vp.log
View file
Original file line number Diff line number Diff line change
Expand Up @@ -16,3 +16,9 @@
2023-07-14 13:40:47.502 | INFO | __main__:<module>:151 - Analysis date: 2023-07-12
2023-07-14 13:42:34.741 | INFO | __main__:<module>:164 - pare down vp
2023-07-14 13:42:34.742 | INFO | __main__:<module>:167 - execution time: 0:01:47.239089
2023-07-26 18:18:52.727 | INFO | __main__:<module>:151 - Analysis date: 2023-03-15
2023-07-26 18:23:25.887 | INFO | __main__:<module>:164 - pare down vp
2023-07-26 18:23:25.901 | INFO | __main__:<module>:167 - execution time: 0:04:33.151084
2023-07-26 21:16:48.752 | INFO | __main__:<module>:151 - Analysis date: 2023-04-12
2023-07-26 21:20:41.866 | INFO | __main__:<module>:164 - pare down vp
2023-07-26 21:20:41.895 | INFO | __main__:<module>:167 - execution time: 0:03:53.140859
Loading

0 comments on commit ea1eca8

Please sign in to comment.