Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
138 commits
Select commit Hold shift + click to select a range
858f5cc
solved merge conflicts with tracking into pipeline branch
carolinewang01 Aug 1, 2019
4b5f8ec
made traffic analyser a passable param, so that run_pipeline is more …
carolinewang01 Aug 2, 2019
d653ce1
resolve conflicts with frame level eval
carolinewang01 Aug 5, 2019
cf0c20f
edited params
carolinewang01 Aug 6, 2019
4128ed6
changed create_dev_tables.py to accept args, began writing eval_pipel…
carolinewang01 Aug 7, 2019
8806990
changed paths and parameters
carolinewang01 Aug 7, 2019
ed1e9c2
fixed merge conflicts with dev
carolinewang01 Aug 7, 2019
5b151e5
under advise of code reviewers, created dictionary for creating tracker
carolinewang01 Aug 7, 2019
b6575b0
finished writing eval pipeline, no debugging yet
carolinewang01 Aug 7, 2019
1587cce
solved minor compilation errors
carolinewang01 Aug 7, 2019
3beda22
added print statements, corrected more minor bugs, ready to move to e…
carolinewang01 Aug 7, 2019
493ca8b
resolved minor typos, first tests of eval in pipeline
carolinewang01 Aug 7, 2019
e35915a
incorporated sams naming bug fixes, added safety to ensure pipeline c…
carolinewang01 Aug 8, 2019
76e2287
got annotations and videos to load properly, video_level_eval is runn…
carolinewang01 Aug 8, 2019
a9436e1
fixed merge conflicst with dev caused by merging pr 64 (Frame level e…
carolinewang01 Aug 8, 2019
462db08
solved merge conflicts
carolinewang01 Aug 8, 2019
8cf5d08
added verbosity statements, refactored eval_pipeline so that it doesn…
carolinewang01 Aug 8, 2019
f0ea566
debugging tracking analyser fumi changes
carolinewang01 Aug 8, 2019
43230b5
added fixed detect_and_track_objects function
carolinewang01 Aug 8, 2019
ee39733
corrected spacing issues
carolinewang01 Aug 8, 2019
075f226
solved import errors
carolinewang01 Aug 8, 2019
b62f9ca
begun adding column orders for eval tbls
carolinewang01 Aug 8, 2019
bcb6bbf
Merge branch 'ec2_eval_pipeline' of https://github.com/dssg/air_pollu…
carolinewang01 Aug 8, 2019
1c32fa6
added col orders for eval tables
carolinewang01 Aug 8, 2019
fc7b85a
got eval pipeline to run on one type of tracker
carolinewang01 Aug 8, 2019
bf350dd
added tracking runtime code
carolinewang01 Aug 8, 2019
16eccee
fixed merge conflicts with dev + funmi's bugfix
carolinewang01 Aug 8, 2019
101d6e4
removed chunk stopping'
carolinewang01 Aug 8, 2019
0c6c037
added np import
carolinewang01 Aug 8, 2019
f165a75
Merge branch 'ec2_eval_pipeline' of https://github.com/dssg/air_pollu…
carolinewang01 Aug 8, 2019
34ee0d3
minor bug fix in update_eval_tables
carolinewang01 Aug 8, 2019
ee7fc4c
ran pipeline successfully to get eval for 1 chunk
carolinewang01 Aug 9, 2019
bc169f0
added debug statements
carolinewang01 Aug 9, 2019
251964d
added functionality to map annotations to video names and print state…
carolinewang01 Aug 9, 2019
4d85757
added print statements
carolinewang01 Aug 9, 2019
69bb6fc
stripped microseconds in parse_annotations_video_names function
carolinewang01 Aug 9, 2019
15ed513
carried changes to datetime parsing through to other functions in pip…
carolinewang01 Aug 9, 2019
8e8ad1b
Revert "carried changes to datetime parsing through to other function…
carolinewang01 Aug 11, 2019
ae1c950
publishing revert
carolinewang01 Aug 11, 2019
0283cba
Revert "stripped microseconds in parse_annotations_video_names function"
carolinewang01 Aug 11, 2019
f74c603
added ms stripping to datetime parsing fcn
carolinewang01 Aug 11, 2019
d86b81e
used string parsing to strip ms instead
carolinewang01 Aug 11, 2019
862ede0
added debug print statements, trying to solve problem where no frames…
carolinewang01 Aug 11, 2019
f37bf64
added try catch blocks around assertions
carolinewang01 Aug 11, 2019
28c6491
added start_frame stop_frame to ground truth dfs in frame level eval
carolinewang01 Aug 11, 2019
240abe6
successfully got eval pipeline running on 2 tracking types, 10 videos
carolinewang01 Aug 11, 2019
7c53292
removed force exit
carolinewang01 Aug 11, 2019
0d864db
Merge branch 'ec2_eval_pipeline' of https://github.com/dssg/air_pollu…
carolinewang01 Aug 11, 2019
57dae2c
added int typecasting to correct dictionary creation
carolinewang01 Aug 11, 2019
6bb7027
minor debug statements
carolinewang01 Aug 12, 2019
5e74d72
debug print statements to parse df to dict fcn
carolinewang01 Aug 12, 2019
840c50b
remove print statements
carolinewang01 Aug 12, 2019
162dbb5
put the creation of traffic analysers into sep file
carolinewang01 Aug 12, 2019
e036626
minor parentheses fix
carolinewang01 Aug 12, 2019
02a1281
Merge branch 'ec2_eval_pipeline' of https://github.com/dssg/air_pollu…
carolinewang01 Aug 12, 2019
6eb4179
further formatting changes and debug statements
carolinewang01 Aug 12, 2019
1a4a798
Merge branch 'ec2_eval_pipeline' of https://github.com/dssg/air_pollu…
carolinewang01 Aug 12, 2019
62a8102
minor debug changes
carolinewang01 Aug 12, 2019
4970720
resolve merge conflicts
carolinewang01 Aug 12, 2019
54629ba
removed annotation video name mapper
carolinewang01 Aug 12, 2019
d7d14ec
trying to figure out why video level diff and frame level map tables …
carolinewang01 Aug 12, 2019
3ccb71f
pep8, corrected unresolved ref to column names
carolinewang01 Aug 12, 2019
10bb949
changed analyser to analyser_type in eval reporting
carolinewang01 Aug 12, 2019
82aaece
added support for goturn
carolinewang01 Aug 12, 2019
f16e9e8
removed print statements, added runtimes to psql dbs, added tracking …
carolinewang01 Aug 12, 2019
7fc4107
removed more debug print statements
carolinewang01 Aug 12, 2019
492be45
resolved merge conflicts with dev
carolinewang01 Aug 12, 2019
9f1eb22
changed tracking to more conservative number of trackers, fixed param…
carolinewang01 Aug 12, 2019
1ea2edb
minor bug fixes
carolinewang01 Aug 12, 2019
0505a7d
added support for evaluating different detection types
carolinewang01 Aug 12, 2019
cd42a77
made detection model passable to all of tf stuff
carolinewang01 Aug 12, 2019
49e1625
tracking analyser minor bug fix
carolinewang01 Aug 13, 2019
24bcea0
fixed comma error in sql tbl declaration, added bbox format handling
carolinewang01 Aug 13, 2019
3588fa5
Merge branch 'get_eval_res' of https://github.com/dssg/air_pollution_…
carolinewang01 Aug 13, 2019
fed2206
replaced hyphens by underscores in psql table decl
carolinewang01 Aug 13, 2019
5203139
tested boosting tracker
carolinewang01 Aug 13, 2019
8a54384
need to move back to local
carolinewang01 Aug 13, 2019
48f9696
put bbox handling code into function, added to second location in tra…
carolinewang01 Aug 13, 2019
9d21c85
made exception handler in vehicle fleet more general
carolinewang01 Aug 13, 2019
d007339
added code to correct tf bbox formattign
carolinewang01 Aug 13, 2019
62f3621
Merge branch 'get_eval_res' of https://github.com/dssg/air_pollution_…
carolinewang01 Aug 13, 2019
16de96c
removed comments
carolinewang01 Aug 13, 2019
62e1860
minor debugs
carolinewang01 Aug 13, 2019
c3bd8fa
Merge branch 'get_eval_res' of https://github.com/dssg/air_pollution_…
carolinewang01 Aug 13, 2019
2f26a43
added support for tuning other parameters
carolinewang01 Aug 13, 2019
4801c4f
Merge branch 'get_eval_res' of https://github.com/dssg/air_pollution_…
carolinewang01 Aug 13, 2019
337e661
merged from ec2, also changed chunk size to be smaller
carolinewang01 Aug 13, 2019
bb9260b
removed unused jupyter nb
carolinewang01 Aug 13, 2019
a31d1de
moving back to local for debug
carolinewang01 Aug 13, 2019
ffb25c6
fixed tracking bug
carolinewang01 Aug 13, 2019
d5800c7
fixed merge conflicts
carolinewang01 Aug 13, 2019
fc708c5
need to move back to local
carolinewang01 Aug 13, 2019
aeeedbe
moved traffic analyser creation into for loop
carolinewang01 Aug 14, 2019
62e3ca9
added try catch loop
carolinewang01 Aug 14, 2019
b2945e7
set params for ec2 cpu instance running eval and fixed minor bug in e…
carolinewang01 Aug 14, 2019
7c4528a
stopped dropping eval/frame/video stats stables
carolinewang01 Aug 14, 2019
cec168a
added gpu cleanup code
carolinewang01 Aug 14, 2019
1ebad26
updated params to tune
carolinewang01 Aug 14, 2019
3032cb8
Detecting loss of tracking
SamBlakeman Aug 14, 2019
5ccd4b1
recording of when vehicles are lost from the tracking
SamBlakeman Aug 14, 2019
6dfd600
Recording of bboxes that are lost
SamBlakeman Aug 14, 2019
4682f08
Recording video id and date time for indexing purposes
SamBlakeman Aug 14, 2019
913c62f
Trying to account for leaving the frame in the video-level stats
SamBlakeman Aug 14, 2019
2f44087
Recording of type
SamBlakeman Aug 14, 2019
8b22248
Recording type of vehicle that has exited the frame
SamBlakeman Aug 15, 2019
3fc5493
Still fixing bug
SamBlakeman Aug 15, 2019
fe20a27
Working Fix!
SamBlakeman Aug 15, 2019
4305dcc
Removing print statements
SamBlakeman Aug 15, 2019
b8a0ab9
resolved merge conflicts with sam's bug fix
carolinewang01 Aug 15, 2019
5d5e4e0
gpu fix
carolinewang01 Aug 15, 2019
ecef5f8
Removal of assert
SamBlakeman Aug 15, 2019
1933bb8
Merge branch 'get_eval_res' of https://github.com/dssg/air_pollution_…
SamBlakeman Aug 15, 2019
38136b6
CPU settings
SamBlakeman Aug 15, 2019
139445a
printing assertions
carolinewang01 Aug 16, 2019
3844ed6
corrected return values for frame level and video level eval
carolinewang01 Aug 16, 2019
4e5b7b2
removed try except
carolinewang01 Aug 16, 2019
7e9ed82
printing statements to try and fix stop-tracking boxes fix
carolinewang01 Aug 16, 2019
e42f6d5
bug fix to deal with if prev bboxes tracked is empty
carolinewang01 Aug 16, 2019
d444979
changed bool to checking for size of np array
carolinewang01 Aug 16, 2019
0b77982
deleted prints
carolinewang01 Aug 16, 2019
d5d279d
added try except back
carolinewang01 Aug 16, 2019
ce8feff
added error handling for when the multitracker returns negative bbox …
carolinewang01 Aug 17, 2019
93ea1d3
added more bbox formatting ocrrections, addedd looping thru param sets
carolinewang01 Aug 17, 2019
4e8517d
solved merge conflicts
carolinewang01 Aug 17, 2019
65a1127
resolved merge conflicts with dev
carolinewang01 Aug 19, 2019
73e37f9
added a needed import
carolinewang01 Aug 19, 2019
78ec9de
jupyter notebooks that walk through model selection for evaluation
jackattack1415 Aug 20, 2019
980ea41
added data to run eval ipynbs
jackattack1415 Aug 20, 2019
fbf3fe8
resolved merge conflicts with dev
carolinewang01 Aug 20, 2019
1ba6049
changed default eval psql table names to include test in case it is r…
carolinewang01 Aug 20, 2019
49cdb8e
solved bugs introduced by merging
carolinewang01 Aug 20, 2019
f73ccd5
patching
jackattack1415 Aug 21, 2019
72100f7
maren changes
carolinewang01 Aug 22, 2019
87e74dc
print statemnets to investigate negative stop issues
jackattack1415 Aug 22, 2019
7b073f5
Merge branch 'CPU_eval2' of https://github.com/dssg/air_pollution_est…
jackattack1415 Aug 22, 2019
22d9b1e
removed print statements
jackattack1415 Aug 22, 2019
814d055
created clearer names for eval data files
carolinewang01 Aug 24, 2019
87c2aab
put verbose setting in params
carolinewang01 Aug 24, 2019
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,9 @@ plots/**
# also keep all .gitkeep files
!.gitkeep


# ignore goturn caffe model
src/goturn.caffemodel
src/goturn.prototxt
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why would these files and up here?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Funmi told me that to run the goturn tracker, you need these 2 files to be in the same directory as the module you're running.

##########################
# Common files

Expand Down
21 changes: 16 additions & 5 deletions conf/base/parameters.yml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ static_pipeline:
load_ref_file: False
ref_file_name: "example_dataset"
camera_list:
[
[
"00001.03601",
"00001.07591",
"00001.01252",
Expand All @@ -33,19 +33,31 @@ static_pipeline:
"00001.04336",
"00001.09560"
]
from_date: "2019-07-17"
from_date: "2019-07-17"
to_date: "2019-07-17"
from_time: "00-00-00"
to_time: "23-59-59"
chunk_size: 10

data_renaming: # TODO: remove later when renaming finished
old_path: "raw/video_data_new"
new_path: "raw/videos"
date_format: "%Y%m%d-%H%M%S"

eval_pipeline_settings:
eval_ref_name: "annotated_videos"
eval_chunk_size: 5
eval_verbosity: True
eval_params_order: ['tracker_type', 'detection_model', "detection_frequency", "detection_iou_threshold", "stop_start_iou_threshold"]
eval_tracker_types: ['kcf', 'mosse', 'csrt', 'tld', 'boosting', 'mil']
eval_detection_models: ['yolov3-tiny', 'yolov3']
eval_detection_frequency: [4, 6]
eval_detection_iou_threshold: [0.2, 0.3, 0.4, 0.5]
eval_stop_start_iou_threshold: [0.75, 0.80, 0.85, 0.90]

modelling:
# obj detection
detection_model: "yolov3-tiny"
default_detection_model: "yolov3_tf"
detection_implementation: "cvlib"
detection_iou_threshold: 0.05
detection_confidence_threshold: 0.2
Expand All @@ -54,7 +66,7 @@ modelling:

# tracking
selected_labels: ["car", "truck", "bus", "motorbike"]
opencv_tracker_type: "csrt"
default_tracker_type: "csrt"
iou_threshold: 0.05 #controls how much two objects' bboxes must overlap to be considered the "same"
detection_frequency: 4
skip_no_of_frames: 3
Expand All @@ -65,7 +77,6 @@ modelling:
stop_start_iou_threshold: 0.80

reporting:
chunk_size: 10
dtype:
camera_id: 'category'
video_level_column_order: ["camera_id", "video_upload_datetime", "vehicle_type", "counts", "starts", "stops", "parked"]
Expand Down
10 changes: 8 additions & 2 deletions conf/base/paths.yml
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
s3_paths:
bucket_name: "air-pollution-uk" #s3 bucket name
s3_video: "raw/videos/" #path to video data in s3 bucket
s3_annotations: "ref/annotations/"
s3_cvat_annotations: "ref/annotations/cvat/"
s3_video_names: "ref/video_names/"
s3_camera_details: "ref/camera_details/camera_details.json"

s3_frame_level: "frame_level/" # TODO DELETE THIS
s3_profile: "dssg" # TODO: change this for user?
s3_profile: "dssg" # TODO: change this for user?
s3_creds: "dev_s3" # TODO: CHANGE TO JUST S3
s3_detection_model: "ref/model_conf/"

Expand All @@ -29,3 +29,9 @@ db_paths:
db_name: "airquality"
db_frame_level: 'frame_stats'
db_video_level: 'video_stats'

eval_db_frame_level_prefix: 'frame_stats'
eval_db_video_level_prefix: 'video_stats'
eval_db_video_stats: "eval_video_performance_test"
eval_db_video_diffs: "eval_video_diffs_test"
eval_db_frame_stats: "eval_frame_stats_test"
22,273 changes: 22,273 additions & 0 deletions data/eval/eval_frame_stats_cpu.csv

Large diffs are not rendered by default.

90,945 changes: 90,945 additions & 0 deletions data/eval/eval_frame_stats_gpu.csv

Large diffs are not rendered by default.

24,193 changes: 24,193 additions & 0 deletions data/eval/eval_video_diffs_cpu.csv

Large diffs are not rendered by default.

101,961 changes: 101,961 additions & 0 deletions data/eval/eval_video_diffs_gpu.csv

Large diffs are not rendered by default.

1,153 changes: 1,153 additions & 0 deletions data/eval/eval_video_performance_cpu.csv

Large diffs are not rendered by default.

5,161 changes: 5,161 additions & 0 deletions data/eval/eval_video_performance_gpu.csv

Large diffs are not rendered by default.

50 changes: 24 additions & 26 deletions notebooks/20190617-jch-exploring-folium.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -11,15 +11,13 @@
{
"cell_type": "code",
"execution_count": 2,
"metadata": {
"collapsed": true
},
"metadata": {},
"outputs": [],
"source": [
"import folium\n",
"import boto3\n",
"import pandas as pd\n",
"% matplotlib inline"
"%matplotlib inline"
]
},
{
Expand All @@ -37,10 +35,10 @@
{
"data": {
"text/html": [
"<div style=\"width:100%;\"><div style=\"position:relative;width:100%;height:0;padding-bottom:60%;\"><iframe src=\"data:text/html;charset=utf-8;base64,PCFET0NUWVBFIGh0bWw+CjxoZWFkPiAgICAKICAgIDxtZXRhIGh0dHAtZXF1aXY9ImNvbnRlbnQtdHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PVVURi04IiAvPgogICAgCiAgICAgICAgPHNjcmlwdD4KICAgICAgICAgICAgTF9OT19UT1VDSCA9IGZhbHNlOwogICAgICAgICAgICBMX0RJU0FCTEVfM0QgPSBmYWxzZTsKICAgICAgICA8L3NjcmlwdD4KICAgIAogICAgPHNjcmlwdCBzcmM9Imh0dHBzOi8vY2RuLmpzZGVsaXZyLm5ldC9ucG0vbGVhZmxldEAxLjQuMC9kaXN0L2xlYWZsZXQuanMiPjwvc2NyaXB0PgogICAgPHNjcmlwdCBzcmM9Imh0dHBzOi8vY29kZS5qcXVlcnkuY29tL2pxdWVyeS0xLjEyLjQubWluLmpzIj48L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL21heGNkbi5ib290c3RyYXBjZG4uY29tL2Jvb3RzdHJhcC8zLjIuMC9qcy9ib290c3RyYXAubWluLmpzIj48L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2NkbmpzLmNsb3VkZmxhcmUuY29tL2FqYXgvbGlicy9MZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy8yLjAuMi9sZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy5qcyI+PC9zY3JpcHQ+CiAgICA8bGluayByZWw9InN0eWxlc2hlZXQiIGhyZWY9Imh0dHBzOi8vY2RuLmpzZGVsaXZyLm5ldC9ucG0vbGVhZmxldEAxLjQuMC9kaXN0L2xlYWZsZXQuY3NzIi8+CiAgICA8bGluayByZWw9InN0eWxlc2hlZXQiIGhyZWY9Imh0dHBzOi8vbWF4Y2RuLmJvb3RzdHJhcGNkbi5jb20vYm9vdHN0cmFwLzMuMi4wL2Nzcy9ib290c3RyYXAubWluLmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL21heGNkbi5ib290c3RyYXBjZG4uY29tL2Jvb3RzdHJhcC8zLjIuMC9jc3MvYm9vdHN0cmFwLXRoZW1lLm1pbi5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9mb250LWF3ZXNvbWUvNC42LjMvY3NzL2ZvbnQtYXdlc29tZS5taW4uY3NzIi8+CiAgICA8bGluayByZWw9InN0eWxlc2hlZXQiIGhyZWY9Imh0dHBzOi8vY2RuanMuY2xvdWRmbGFyZS5jb20vYWpheC9saWJzL0xlYWZsZXQuYXdlc29tZS1tYXJrZXJzLzIuMC4yL2xlYWZsZXQuYXdlc29tZS1tYXJrZXJzLmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL3Jhd2Nkbi5naXRoYWNrLmNvbS9weXRob24tdmlzdWFsaXphdGlvbi9mb2xpdW0vbWFzdGVyL2ZvbGl1bS90ZW1wbGF0ZXMvbGVhZmxldC5hd2Vzb21lLnJvdGF0ZS5jc3MiLz4KICAgIDxzdHlsZT5odG1sLCBib2R5IHt3aWR0aDogMTAwJTtoZWlnaHQ6IDEwMCU7bWFyZ2luOiAwO3BhZGRpbmc6IDA7fTwvc3R5bGU+CiAgICA8c3R5bGU+I21hcCB7cG9zaXRpb246YWJzb2x1dGU7dG9wOjA7Ym90dG9tOjA7cmlnaHQ6MDtsZWZ0OjA7fTwvc3R5bGU+CiAgICAKICAgICAgICAgICAgPG1ldGEgbmFtZT0idmlld3BvcnQiIGNvbnRlbnQ9IndpZHRoPWRldmljZS13aWR0aCwKICAgICAgICAgICAgICAgIGluaXRpYWwtc2NhbGU9MS4wLCBtYXhpbXVtLXNjYWxlPTEuMCwgdXNlci1zY2FsYWJsZT1ubyIgLz4KICAgICAgICAgICAgPHN0eWxlPgogICAgICAgICAgICAgICAgI21hcF9kMDhhODZmMmFkOWY0NThjODhlNDc1MWNkY2RjYzJjNCB7CiAgICAgICAgICAgICAgICAgICAgcG9zaXRpb246IHJlbGF0aXZlOwogICAgICAgICAgICAgICAgICAgIHdpZHRoOiA1MDAuMHB4OwogICAgICAgICAgICAgICAgICAgIGhlaWdodDogNTAwLjBweDsKICAgICAgICAgICAgICAgICAgICBsZWZ0OiAwLjAlOwogICAgICAgICAgICAgICAgICAgIHRvcDogMC4wJTsKICAgICAgICAgICAgICAgIH0KICAgICAgICAgICAgPC9zdHlsZT4KICAgICAgICAKPC9oZWFkPgo8Ym9keT4gICAgCiAgICAKICAgICAgICAgICAgPGRpdiBjbGFzcz0iZm9saXVtLW1hcCIgaWQ9Im1hcF9kMDhhODZmMmFkOWY0NThjODhlNDc1MWNkY2RjYzJjNCIgPjwvZGl2PgogICAgICAgIAo8L2JvZHk+CjxzY3JpcHQ+ICAgIAogICAgCiAgICAgICAgICAgIHZhciBtYXBfZDA4YTg2ZjJhZDlmNDU4Yzg4ZTQ3NTFjZGNkY2MyYzQgPSBMLm1hcCgKICAgICAgICAgICAgICAgICJtYXBfZDA4YTg2ZjJhZDlmNDU4Yzg4ZTQ3NTFjZGNkY2MyYzQiLAogICAgICAgICAgICAgICAgewogICAgICAgICAgICAgICAgICAgIGNlbnRlcjogWzUxLjUwNjk0OSwgLTAuMTIyODc2XSwKICAgICAgICAgICAgICAgICAgICBjcnM6IEwuQ1JTLkVQU0czODU3LAogICAgICAgICAgICAgICAgICAgIHpvb206IDEyLAogICAgICAgICAgICAgICAgICAgIHpvb21Db250cm9sOiB0cnVlLAogICAgICAgICAgICAgICAgICAgIHByZWZlckNhbnZhczogZmFsc2UsCiAgICAgICAgICAgICAgICB9CiAgICAgICAgICAgICk7CgogICAgICAgICAgICAKCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHRpbGVfbGF5ZXJfNGI1MTBjMThkYjUyNDNhYTk2NTliMDk3ZmM5NGExYmIgPSBMLnRpbGVMYXllcigKICAgICAgICAgICAgICAgICJodHRwczovL3N0YW1lbi10aWxlcy17c30uYS5zc2wuZmFzdGx5Lm5ldC90b25lci97en0ve3h9L3t5fS5wbmciLAogICAgICAgICAgICAgICAgeyJhdHRyaWJ1dGlvbiI6ICJNYXAgdGlsZXMgYnkgXHUwMDNjYSBocmVmPVwiaHR0cDovL3N0YW1lbi5jb21cIlx1MDAzZVN0YW1lbiBEZXNpZ25cdTAwM2MvYVx1MDAzZSwgdW5kZXIgXHUwMDNjYSBocmVmPVwiaHR0cDovL2NyZWF0aXZlY29tbW9ucy5vcmcvbGljZW5zZXMvYnkvMy4wXCJcdTAwM2VDQyBCWSAzLjBcdTAwM2MvYVx1MDAzZS4gRGF0YSBieSBcdTAwMjZjb3B5OyBcdTAwM2NhIGhyZWY9XCJodHRwOi8vb3BlbnN0cmVldG1hcC5vcmdcIlx1MDAzZU9wZW5TdHJlZXRNYXBcdTAwM2MvYVx1MDAzZSwgdW5kZXIgXHUwMDNjYSBocmVmPVwiaHR0cDovL3d3dy5vcGVuc3RyZWV0bWFwLm9yZy9jb3B5cmlnaHRcIlx1MDAzZU9EYkxcdTAwM2MvYVx1MDAzZS4iLCAiZGV0ZWN0UmV0aW5hIjogZmFsc2UsICJtYXhOYXRpdmVab29tIjogMTgsICJtYXhab29tIjogMTgsICJtaW5ab29tIjogMCwgIm5vV3JhcCI6IGZhbHNlLCAib3BhY2l0eSI6IDEsICJzdWJkb21haW5zIjogImFiYyIsICJ0bXMiOiBmYWxzZX0KICAgICAgICAgICAgKS5hZGRUbyhtYXBfZDA4YTg2ZjJhZDlmNDU4Yzg4ZTQ3NTFjZGNkY2MyYzQpOwogICAgICAgIAo8L3NjcmlwdD4=\" style=\"position:absolute;width:100%;height:100%;left:0;top:0;border:none !important;\" allowfullscreen webkitallowfullscreen mozallowfullscreen></iframe></div></div>"
"<div style=\"width:100%;\"><div style=\"position:relative;width:100%;height:0;padding-bottom:60%;\"><iframe src=\"data:text/html;charset=utf-8;base64,PCFET0NUWVBFIGh0bWw+CjxoZWFkPiAgICAKICAgIDxtZXRhIGh0dHAtZXF1aXY9ImNvbnRlbnQtdHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PVVURi04IiAvPgogICAgCiAgICAgICAgPHNjcmlwdD4KICAgICAgICAgICAgTF9OT19UT1VDSCA9IGZhbHNlOwogICAgICAgICAgICBMX0RJU0FCTEVfM0QgPSBmYWxzZTsKICAgICAgICA8L3NjcmlwdD4KICAgIAogICAgPHNjcmlwdCBzcmM9Imh0dHBzOi8vY2RuLmpzZGVsaXZyLm5ldC9ucG0vbGVhZmxldEAxLjUuMS9kaXN0L2xlYWZsZXQuanMiPjwvc2NyaXB0PgogICAgPHNjcmlwdCBzcmM9Imh0dHBzOi8vY29kZS5qcXVlcnkuY29tL2pxdWVyeS0xLjEyLjQubWluLmpzIj48L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL21heGNkbi5ib290c3RyYXBjZG4uY29tL2Jvb3RzdHJhcC8zLjIuMC9qcy9ib290c3RyYXAubWluLmpzIj48L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2NkbmpzLmNsb3VkZmxhcmUuY29tL2FqYXgvbGlicy9MZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy8yLjAuMi9sZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy5qcyI+PC9zY3JpcHQ+CiAgICA8bGluayByZWw9InN0eWxlc2hlZXQiIGhyZWY9Imh0dHBzOi8vY2RuLmpzZGVsaXZyLm5ldC9ucG0vbGVhZmxldEAxLjUuMS9kaXN0L2xlYWZsZXQuY3NzIi8+CiAgICA8bGluayByZWw9InN0eWxlc2hlZXQiIGhyZWY9Imh0dHBzOi8vbWF4Y2RuLmJvb3RzdHJhcGNkbi5jb20vYm9vdHN0cmFwLzMuMi4wL2Nzcy9ib290c3RyYXAubWluLmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL21heGNkbi5ib290c3RyYXBjZG4uY29tL2Jvb3RzdHJhcC8zLjIuMC9jc3MvYm9vdHN0cmFwLXRoZW1lLm1pbi5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9mb250LWF3ZXNvbWUvNC42LjMvY3NzL2ZvbnQtYXdlc29tZS5taW4uY3NzIi8+CiAgICA8bGluayByZWw9InN0eWxlc2hlZXQiIGhyZWY9Imh0dHBzOi8vY2RuanMuY2xvdWRmbGFyZS5jb20vYWpheC9saWJzL0xlYWZsZXQuYXdlc29tZS1tYXJrZXJzLzIuMC4yL2xlYWZsZXQuYXdlc29tZS1tYXJrZXJzLmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL3Jhd2Nkbi5naXRoYWNrLmNvbS9weXRob24tdmlzdWFsaXphdGlvbi9mb2xpdW0vbWFzdGVyL2ZvbGl1bS90ZW1wbGF0ZXMvbGVhZmxldC5hd2Vzb21lLnJvdGF0ZS5jc3MiLz4KICAgIDxzdHlsZT5odG1sLCBib2R5IHt3aWR0aDogMTAwJTtoZWlnaHQ6IDEwMCU7bWFyZ2luOiAwO3BhZGRpbmc6IDA7fTwvc3R5bGU+CiAgICA8c3R5bGU+I21hcCB7cG9zaXRpb246YWJzb2x1dGU7dG9wOjA7Ym90dG9tOjA7cmlnaHQ6MDtsZWZ0OjA7fTwvc3R5bGU+CiAgICAKICAgICAgICAgICAgPG1ldGEgbmFtZT0idmlld3BvcnQiIGNvbnRlbnQ9IndpZHRoPWRldmljZS13aWR0aCwKICAgICAgICAgICAgICAgIGluaXRpYWwtc2NhbGU9MS4wLCBtYXhpbXVtLXNjYWxlPTEuMCwgdXNlci1zY2FsYWJsZT1ubyIgLz4KICAgICAgICAgICAgPHN0eWxlPgogICAgICAgICAgICAgICAgI21hcF83ZWQ0ZWY5ZTUzZTE0NTQ3YWVkNTI2ZTVkMWNlMmFhNSB7CiAgICAgICAgICAgICAgICAgICAgcG9zaXRpb246IHJlbGF0aXZlOwogICAgICAgICAgICAgICAgICAgIHdpZHRoOiA1MDAuMHB4OwogICAgICAgICAgICAgICAgICAgIGhlaWdodDogNTAwLjBweDsKICAgICAgICAgICAgICAgICAgICBsZWZ0OiAwLjAlOwogICAgICAgICAgICAgICAgICAgIHRvcDogMC4wJTsKICAgICAgICAgICAgICAgIH0KICAgICAgICAgICAgPC9zdHlsZT4KICAgICAgICAKPC9oZWFkPgo8Ym9keT4gICAgCiAgICAKICAgICAgICAgICAgPGRpdiBjbGFzcz0iZm9saXVtLW1hcCIgaWQ9Im1hcF83ZWQ0ZWY5ZTUzZTE0NTQ3YWVkNTI2ZTVkMWNlMmFhNSIgPjwvZGl2PgogICAgICAgIAo8L2JvZHk+CjxzY3JpcHQ+ICAgIAogICAgCiAgICAgICAgICAgIHZhciBtYXBfN2VkNGVmOWU1M2UxNDU0N2FlZDUyNmU1ZDFjZTJhYTUgPSBMLm1hcCgKICAgICAgICAgICAgICAgICJtYXBfN2VkNGVmOWU1M2UxNDU0N2FlZDUyNmU1ZDFjZTJhYTUiLAogICAgICAgICAgICAgICAgewogICAgICAgICAgICAgICAgICAgIGNlbnRlcjogWzUxLjUwNjk0OSwgLTAuMTIyODc2XSwKICAgICAgICAgICAgICAgICAgICBjcnM6IEwuQ1JTLkVQU0czODU3LAogICAgICAgICAgICAgICAgICAgIHpvb206IDEyLAogICAgICAgICAgICAgICAgICAgIHpvb21Db250cm9sOiB0cnVlLAogICAgICAgICAgICAgICAgICAgIHByZWZlckNhbnZhczogZmFsc2UsCiAgICAgICAgICAgICAgICB9CiAgICAgICAgICAgICk7CgogICAgICAgICAgICAKCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHRpbGVfbGF5ZXJfYjg3NDY0MTQ5MTIzNDBmMjg2ZGNjNjhkYWE5Yzg5ODUgPSBMLnRpbGVMYXllcigKICAgICAgICAgICAgICAgICJodHRwczovL3N0YW1lbi10aWxlcy17c30uYS5zc2wuZmFzdGx5Lm5ldC90b25lci97en0ve3h9L3t5fS5wbmciLAogICAgICAgICAgICAgICAgeyJhdHRyaWJ1dGlvbiI6ICJNYXAgdGlsZXMgYnkgXHUwMDNjYSBocmVmPVwiaHR0cDovL3N0YW1lbi5jb21cIlx1MDAzZVN0YW1lbiBEZXNpZ25cdTAwM2MvYVx1MDAzZSwgdW5kZXIgXHUwMDNjYSBocmVmPVwiaHR0cDovL2NyZWF0aXZlY29tbW9ucy5vcmcvbGljZW5zZXMvYnkvMy4wXCJcdTAwM2VDQyBCWSAzLjBcdTAwM2MvYVx1MDAzZS4gRGF0YSBieSBcdTAwMjZjb3B5OyBcdTAwM2NhIGhyZWY9XCJodHRwOi8vb3BlbnN0cmVldG1hcC5vcmdcIlx1MDAzZU9wZW5TdHJlZXRNYXBcdTAwM2MvYVx1MDAzZSwgdW5kZXIgXHUwMDNjYSBocmVmPVwiaHR0cDovL3d3dy5vcGVuc3RyZWV0bWFwLm9yZy9jb3B5cmlnaHRcIlx1MDAzZU9EYkxcdTAwM2MvYVx1MDAzZS4iLCAiZGV0ZWN0UmV0aW5hIjogZmFsc2UsICJtYXhOYXRpdmVab29tIjogMTgsICJtYXhab29tIjogMTgsICJtaW5ab29tIjogMCwgIm5vV3JhcCI6IGZhbHNlLCAib3BhY2l0eSI6IDEsICJzdWJkb21haW5zIjogImFiYyIsICJ0bXMiOiBmYWxzZX0KICAgICAgICAgICAgKS5hZGRUbyhtYXBfN2VkNGVmOWU1M2UxNDU0N2FlZDUyNmU1ZDFjZTJhYTUpOwogICAgICAgIAo8L3NjcmlwdD4=\" style=\"position:absolute;width:100%;height:100%;left:0;top:0;border:none !important;\" allowfullscreen webkitallowfullscreen mozallowfullscreen></iframe></div></div>"
],
"text/plain": [
"<folium.folium.Map at 0x160ce299b70>"
"<folium.folium.Map at 0x26f33705b38>"
]
},
"execution_count": 3,
Expand All @@ -53,7 +51,7 @@
"londonmap = folium.Map(\n",
" width=500, height=500,\n",
" location = London,\n",
" zoom_start = 12, \n",
" zoom_start = 12, t\n",
" tiles = 'stamentoner')\n",
"\n",
"londonmap"
Expand All @@ -68,7 +66,7 @@
},
{
"cell_type": "code",
"execution_count": 4,
"execution_count": 11,
"metadata": {},
"outputs": [
{
Expand Down Expand Up @@ -159,7 +157,7 @@
"4 4 00/006 531648.94 180896.39 -0.104276 51.511665"
]
},
"execution_count": 4,
"execution_count": 11,
"metadata": {},
"output_type": "execute_result"
}
Expand Down Expand Up @@ -217,7 +215,7 @@
},
{
"cell_type": "code",
"execution_count": 8,
"execution_count": 9,
"metadata": {},
"outputs": [
{
Expand Down Expand Up @@ -290,7 +288,7 @@
"4 Cromwell_Rd/Earls_Court_Rd 51.4946 -0.19570"
]
},
"execution_count": 8,
"execution_count": 9,
"metadata": {},
"output_type": "execute_result"
}
Expand All @@ -307,7 +305,7 @@
},
{
"cell_type": "code",
"execution_count": 9,
"execution_count": 7,
"metadata": {},
"outputs": [
{
Expand All @@ -325,7 +323,7 @@
" [51.3741, -0.09646]]"
]
},
"execution_count": 9,
"execution_count": 7,
"metadata": {},
"output_type": "execute_result"
}
Expand All @@ -338,16 +336,16 @@
},
{
"cell_type": "code",
"execution_count": 12,
"execution_count": 14,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"C:/Users/joh3146/Documents/dssg/map_data_locations_small.html\n",
"C:/Users/joh3146/Documents/dssg/map_data_locations_regular.html\n",
"C:/Users/joh3146/Documents/dssg/map_data_locations_large.html\n"
"C:/Users/Caroline Wang/Onedrive/DSSG/map_data_location_smalls.pdf\n",
"C:/Users/Caroline Wang/Onedrive/DSSG/map_data_location_regulars.pdf\n",
"C:/Users/Caroline Wang/Onedrive/DSSG/map_data_location_larges.pdf\n"
]
}
],
Expand All @@ -362,13 +360,13 @@
" zoom_start = 20, \n",
" tiles = 'stamentoner')\n",
"\n",
" for point in range(0, len(tims_location_list)):\n",
" folium.CircleMarker(tims_location_list[point],\n",
" radius=labelsizes[tick],\n",
" color='red',\n",
" fill_color='red',\n",
" fill_opacity=0.2\n",
" ).add_to(london_map)\n",
"# for point in range(0, len(tims_location_list)):\n",
"# folium.CircleMarker(tims_location_list[point],\n",
"# radius=labelsizes[tick],\n",
"# color='red',\n",
"# fill_color='red',\n",
"# fill_opacity=0.2\n",
"# ).add_to(london_map)\n",
"\n",
" for point in range(0, len(jc_location_list)):\n",
" folium.CircleMarker(jc_location_list[point],\n",
Expand All @@ -378,10 +376,10 @@
" fill_opacity=0.2\n",
" ).add_to(london_map)\n",
" \n",
" filestr_in = \"C:/Users/joh3146/Documents/dssg/map_data_locations.html\"\n",
" filestr_in = \"C:/Users/Caroline Wang/Onedrive/DSSG/map_data_locations.html\"\n",
" filestr_out = filestr_in[:-5] + '_' + labelstr[tick] + filestr_in[-5:]\n",
" print(filestr_out)\n",
" london_map.save(\"C:/Users/joh3146/Documents/dssg/london_map_large_labels.html\")"
" london_map.save(filestr_out)\n"
]
}
],
Expand Down
2 changes: 1 addition & 1 deletion notebooks/20190701-jch-jamcam-selection.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -1257,7 +1257,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.6.3"
"version": "3.7.3"
}
},
"nbformat": 4,
Expand Down
Loading