Swap gtfs_funnel vp preprocessing with fct_vehicle_locations_grouped

[tiffanychu90]

gtfs_funnel

stop_times

• notebook recommendation: since we can't actually get a trip_instance_key from scheduled trips table, we can only dedupe for now.
  • This only affects 1 operator, Victor Valley GMV, 2 routes, and 8 trips. Deduping leaves us with 4 trips, and we will have to drop 4 trips, since they have a first trip arrival (based on stop_times) that's not found in fct_scheduled_trips
• Backfill 2025 dates, since it was Dec refactor where the sorting was removed. git blame myself for this commit, so only going forward do we need to overwrite files
• Add logs
• Resolves Bug: stop_times_with_direction: use trip's start time for join dim_stop_times with fct_scheduled_trips #1385

vehicle positions

• New mart_gtfs table is created - use this as our new upstream starting point in gtfs_funnel
  • Add mart_gtfs.fct_vehicle_locations_grouped data-infra#3660
  • mart_gtfs.fct_vehicle_locations_grouped - incremental settings like fct_vehicle_locations data-infra#3672
• Remove those scripts from gtfs_funnel/Makefile and remove vp_keep_usable.py, cleanup.py, and vp_dwell_time.py
• Clean up logs, remove anything before Oct 2024
• Epic - Refactor scripts to use new mart_gtfs tables #1345
• Run this through pipeline for Sep 2024 - Feb 2025
  • TODO: exploratory checks in notebook to make sure summary stats look ok
  • TODO: columns are renamed in mart table, make sure that scripts reflect that
  • TODO: there is a dwell_sec column that is not in the mart table, if we need it, we should create it

segment_speed_utils

• Allow sorting to be done within creating vp linestring

[github-actions]

nbviewer URLs for impacted notebooks:

• gtfs_funnel/03_incorrect_stop_pairs.ipynb

[github-actions]

nbviewer URLs for impacted notebooks:

• gtfs_funnel/03_incorrect_stop_pairs.ipynb

[github-actions]

nbviewer URLs for impacted notebooks:

• gtfs_funnel/03_incorrect_stop_pairs.ipynb

[github-actions]

nbviewer URLs for impacted notebooks:

• gtfs_funnel/03_incorrect_stop_pairs.ipynb

[github-actions]

nbviewer URLs for impacted notebooks:

• gtfs_funnel/03_incorrect_stop_pairs.ipynb

[github-actions]

nbviewer URLs for impacted notebooks:

• gtfs_funnel/03_incorrect_stop_pairs.ipynb

[github-actions]

nbviewer URLs for impacted notebooks:

• gtfs_funnel/03_incorrect_stop_pairs.ipynb