2018-06-01 23:29:02,224 DEBUG: Downloading http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0 to addresses-primary-604e96f3.csv 2018-06-01 23:29:02,224 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0 with args {'f': 'json'} 2018-06-01 23:29:02,332 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'returnCountOnly': 'true', 'where': '1=1', 'f': 'json'} 2018-06-01 23:29:02,858 INFO: Source has 28479 rows 2018-06-01 23:29:02,858 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0 with args {'f': 'json'} 2018-06-01 23:29:02,953 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'returnCountOnly': 'true', 'where': '1=1', 'f': 'json'} 2018-06-01 23:29:03,339 INFO: Built 29 requests using resultOffset method 2018-06-01 23:29:03,339 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 0, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:04,732 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 1000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:06,131 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 2000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:07,603 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 3000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:09,212 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 4000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:11,153 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 5000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:12,743 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 6000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:14,315 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 7000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:15,858 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 8000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:17,387 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 9000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:18,988 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 10000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:20,588 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 11000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:22,214 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 12000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:23,827 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 13000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:25,566 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 14000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:27,363 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 15000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:29,112 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 16000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:30,967 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 17000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:32,246 INFO: Resource usage: { user: 21%, system: 0%, memory: 545MB, read: 0KB, written: 1304KB, sent: 3521KB, received: 1307KB, period: 30sec, procs: 1 } 2018-06-01 23:29:32,769 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 18000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:34,978 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 19000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:36,815 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 20000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:38,999 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 21000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:41,239 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 22000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:43,376 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 23000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:45,363 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 24000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:47,437 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 25000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:49,460 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 26000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:51,451 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 27000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:53,427 DEBUG: Requesting http://72.38.148.13:6080/arcgis/rest/services/911/MapServer/0/query with args {'outSR': '4326', 'where': '1=1', 'outFields': '*', 'resultRecordCount': 1000, 'returnGeometry': True, 'resultOffset': 28000, 'geometryPrecision': 7, 'f': 'json'} 2018-06-01 23:29:55,066 INFO: Downloaded 28479 ESRI features for file /tmp/worker-5meywyp8/work-_85zzub1/out/process_one-0bjjejcj/cache-awohgv9k/esri/addresses-primary-604e96f3.csv 2018-06-01 23:29:55,091 INFO: Cached data in file:///tmp/worker-5meywyp8/work-_85zzub1/out/process_one-0bjjejcj/cached/addresses-primary-604e96f3.csv 2018-06-01 23:29:55,097 DEBUG: URL says ".csv" for file:///tmp/worker-5meywyp8/work-_85zzub1/out/process_one-0bjjejcj/cached/addresses-primary-604e96f3.csv 2018-06-01 23:29:55,097 DEBUG: Guessed addresses-primary-2999470b.csv for file:///tmp/worker-5meywyp8/work-_85zzub1/out/process_one-0bjjejcj/cached/addresses-primary-604e96f3.csv 2018-06-01 23:29:55,112 DEBUG: File exists /tmp/worker-5meywyp8/work-_85zzub1/out/process_one-0bjjejcj/conform-bp73u70l/http/addresses-primary-2999470b.csv 2018-06-01 23:29:55,112 INFO: Downloaded to ['/tmp/worker-5meywyp8/work-_85zzub1/out/process_one-0bjjejcj/conform-bp73u70l/http/addresses-primary-2999470b.csv'] 2018-06-01 23:29:55,113 WARNING: Could not guess a single compression from file names 2018-06-01 23:29:55,113 INFO: Decompressed to 1 files 2018-06-01 23:29:55,114 INFO: Sampled 6 records 2018-06-01 23:29:55,114 DEBUG: Converting to /tmp/worker-5meywyp8/work-_85zzub1/out/process_one-0bjjejcj/conform-bp73u70l 2018-06-01 23:29:55,114 DEBUG: extract temp file /tmp/openaddr-extracted-vrb67h_3.csv 2018-06-01 23:29:55,114 INFO: ESRI GeoJSON source found; treating it as CSV 2018-06-01 23:29:55,115 INFO: Converting source CSV /tmp/worker-5meywyp8/work-_85zzub1/out/process_one-0bjjejcj/conform-bp73u70l/http/addresses-primary-2999470b.csv 2018-06-01 23:30:02,274 INFO: Resource usage: { user: 35%, system: 1%, memory: 540MB, read: 0KB, written: 9188KB, sent: 55KB, received: 1074KB, period: 30sec, procs: 1 } 2018-06-01 23:30:02,808 INFO: Converted to /tmp/worker-5meywyp8/work-_85zzub1/out/process_one-0bjjejcj/conform-bp73u70l/converted/addresses-primary-2999470b.csv with 28479 addresses 2018-06-01 23:30:02,810 INFO: Processed data in /tmp/worker-5meywyp8/work-_85zzub1/out/process_one-0bjjejcj/out.csv 2018-06-01 23:30:02,810 WARNING: Nothing previewed