2016-08-15 04:02:00,854 DEBUG: Downloading http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1 to ca--on--seguin-61056a48.csv 2016-08-15 04:02:00,854 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1 with args {'f': 'json'} 2016-08-15 04:02:04,793 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'returnCountOnly': 'true', 'where': '1=1', 'f': 'json'} 2016-08-15 04:02:38,154 INFO: Source has 20370 rows 2016-08-15 04:02:38,155 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'returnGeometry': 'false', 'outFields': u'CivicAddress,CivicNumber,Municipality', 'f': 'json', 'where': '1=1', 'resultRecordCount': 1, 'resultOffset': 0} 2016-08-15 04:02:38,360 INFO: Source does not support pagination with fields specified, so querying for all fields. 2016-08-15 04:02:38,360 INFO: Built 21 requests using resultOffset method 2016-08-15 04:02:38,361 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 0} 2016-08-15 04:02:41,583 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 1000} 2016-08-15 04:02:44,737 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 2000} 2016-08-15 04:02:47,935 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 3000} 2016-08-15 04:02:51,108 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 4000} 2016-08-15 04:02:54,277 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 5000} 2016-08-15 04:02:57,379 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 6000} 2016-08-15 04:03:00,771 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 7000} 2016-08-15 04:03:03,923 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 8000} 2016-08-15 04:03:07,159 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 9000} 2016-08-15 04:03:10,316 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 10000} 2016-08-15 04:03:13,475 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 11000} 2016-08-15 04:03:16,617 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 12000} 2016-08-15 04:03:19,772 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 13000} 2016-08-15 04:03:22,886 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 14000} 2016-08-15 04:03:26,004 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 15000} 2016-08-15 04:03:29,114 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 16000} 2016-08-15 04:03:32,241 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 17000} 2016-08-15 04:03:35,353 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 18000} 2016-08-15 04:03:38,528 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 19000} 2016-08-15 04:03:41,678 DEBUG: Requesting http://www.wpsgn.ca/arcgis/rest/services/OpenData/WPSGN_OPENDATA/MapServer/1/query with args {'outSR': 4326, 'f': 'json', 'resultRecordCount': 1000, 'outFields': '*', 'returnGeometry': 'true', 'geometryPrecision': 7, 'where': '1=1', 'resultOffset': 20000} 2016-08-15 04:03:44,459 INFO: Downloaded 20370 ESRI features for file /tmp/worker-RUAKqf/work-wxu5DG/out/process_one-z_A6eA/cache-7sO6PH/esri/ca--on--seguin-61056a48.csv 2016-08-15 04:03:44,489 INFO: Cached data in file:///tmp/worker-RUAKqf/work-wxu5DG/out/process_one-z_A6eA/cached/ca--on--seguin-61056a48.csv 2016-08-15 04:03:44,493 DEBUG: URL says ".csv" for file:///tmp/worker-RUAKqf/work-wxu5DG/out/process_one-z_A6eA/cached/ca--on--seguin-61056a48.csv 2016-08-15 04:03:44,493 DEBUG: Guessed ca--on--seguin-17fc8f4a.csv for file:///tmp/worker-RUAKqf/work-wxu5DG/out/process_one-z_A6eA/cached/ca--on--seguin-61056a48.csv 2016-08-15 04:03:44,495 DEBUG: File exists /tmp/worker-RUAKqf/work-wxu5DG/out/process_one-z_A6eA/conform-WBTewZ/http/ca--on--seguin-17fc8f4a.csv 2016-08-15 04:03:44,495 INFO: Downloaded to [u'/tmp/worker-RUAKqf/work-wxu5DG/out/process_one-z_A6eA/conform-WBTewZ/http/ca--on--seguin-17fc8f4a.csv'] 2016-08-15 04:03:44,495 INFO: Decompressed to 1 files 2016-08-15 04:03:44,496 INFO: Sampled 6 records 2016-08-15 04:03:44,505 DEBUG: Converting to /tmp/worker-RUAKqf/work-wxu5DG/out/process_one-z_A6eA/conform-WBTewZ 2016-08-15 04:03:44,505 DEBUG: extract temp file /tmp/openaddr-extracted-ZVvfqM.csv 2016-08-15 04:03:44,505 INFO: ESRI GeoJSON source found; treating it as CSV 2016-08-15 04:03:44,505 INFO: Converting source CSV /tmp/worker-RUAKqf/work-wxu5DG/out/process_one-z_A6eA/conform-WBTewZ/http/ca--on--seguin-17fc8f4a.csv 2016-08-15 04:03:56,368 INFO: Converted to /tmp/worker-RUAKqf/work-wxu5DG/out/process_one-z_A6eA/conform-WBTewZ/converted/ca--on--seguin-17fc8f4a.csv with 20370 addresses 2016-08-15 04:03:56,369 INFO: Processed data in /tmp/worker-RUAKqf/work-wxu5DG/out/process_one-z_A6eA/out.csv