2018-04-07 02:11:15,093 DEBUG: Requesting https://nsgi.novascotia.ca/WSF_DDS/DDS.svc/DownloadFile?tkey=fhrTtdnDvfytwLz6&id=70 with args None 2018-04-07 02:11:15,572 DEBUG: Content-Type says "application/octet-stream" for https://nsgi.novascotia.ca/WSF_DDS/DDS.svc/DownloadFile?tkey=fhrTtdnDvfytwLz6&id=70 2018-04-07 02:11:15,573 DEBUG: Content-Disposition disagrees: "BASE_NS_CivicAddress_File_UT83_SHP.zip" 2018-04-07 02:11:15,630 DEBUG: file says "application/zip" for https://nsgi.novascotia.ca/WSF_DDS/DDS.svc/DownloadFile?tkey=fhrTtdnDvfytwLz6&id=70 2018-04-07 02:11:15,630 DEBUG: Guessed ca--ns--province-325cbc7d.zip for https://nsgi.novascotia.ca/WSF_DDS/DDS.svc/DownloadFile?tkey=fhrTtdnDvfytwLz6&id=70 2018-04-07 02:11:15,630 DEBUG: Requesting https://nsgi.novascotia.ca/WSF_DDS/DDS.svc/DownloadFile?tkey=fhrTtdnDvfytwLz6&id=70 with args None 2018-04-07 02:11:25,341 INFO: Downloaded 13477421 bytes for file /tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/cache-y_yd2hml/http/ca--ns--province-325cbc7d.zip 2018-04-07 02:11:25,519 INFO: Cached data in file:///tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/cached/ca--ns--province-325cbc7d.zip 2018-04-07 02:11:25,615 DEBUG: URL says ".zip" for file:///tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/cached/ca--ns--province-325cbc7d.zip 2018-04-07 02:11:25,615 DEBUG: Guessed ca--ns--province-2460d74f.zip for file:///tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/cached/ca--ns--province-325cbc7d.zip 2018-04-07 02:11:25,643 DEBUG: File exists /tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/conform-c5k2mq63/http/ca--ns--province-2460d74f.zip 2018-04-07 02:11:25,643 INFO: Downloaded to ['/tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/conform-c5k2mq63/http/ca--ns--province-2460d74f.zip'] 2018-04-07 02:11:27,266 DEBUG: Expanded file /tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/conform-c5k2mq63/unzipped/BASE_NS_CivicAddress_File_UT83.shx 2018-04-07 02:11:27,266 DEBUG: Expanded file /tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/conform-c5k2mq63/unzipped/Licence.txt 2018-04-07 02:11:27,266 DEBUG: Expanded file /tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/conform-c5k2mq63/unzipped/BASE_NS_CivicAddress_File_UT83.prj 2018-04-07 02:11:27,266 DEBUG: Expanded file /tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/conform-c5k2mq63/unzipped/BASE_NS_CivicAddress_File_UT83.dbf 2018-04-07 02:11:27,266 DEBUG: Expanded file /tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/conform-c5k2mq63/unzipped/BASE_NS_CivicAddress_File_UT83.shp 2018-04-07 02:11:27,266 INFO: Decompressed to 5 files 2018-04-07 02:11:27,309 INFO: Sampled 6 records 2018-04-07 02:11:27,309 DEBUG: Converting to /tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/conform-c5k2mq63 2018-04-07 02:11:27,309 DEBUG: Selected /tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/conform-c5k2mq63/unzipped/BASE_NS_CivicAddress_File_UT83.shp for source 2018-04-07 02:11:27,310 DEBUG: extract temp file /tmp/openaddr-extracted-5du5p199.csv 2018-04-07 02:11:27,341 INFO: Converting layer 0 ('BASE_NS_CivicAddress_File_UT83') to CSV 2018-04-07 02:11:27,341 WARNING: No encoding given and OGR couldn't guess. Trying ISO-8859-1, YOLO! 2018-04-07 02:11:27,342 DEBUG: Assuming shapefile data is encoded iso-8859-1 2018-04-07 02:11:45,139 INFO: Resource usage: { user: 37%, system: 1%, memory: 458MB, read: 1840KB, written: 174084KB, sent: 234KB, received: 14709KB, period: 30sec, procs: 1 } 2018-04-07 02:12:15,094 INFO: Resource usage: { user: 55%, system: 0%, memory: 458MB, read: 0KB, written: 6952KB, sent: 50KB, received: 956KB, period: 30sec, procs: 1 } 2018-04-07 02:12:45,153 INFO: Resource usage: { user: 56%, system: 0%, memory: 458MB, read: 0KB, written: 7484KB, sent: 49KB, received: 879KB, period: 30sec, procs: 1 } 2018-04-07 02:13:15,143 INFO: Resource usage: { user: 42%, system: 0%, memory: 458MB, read: 0KB, written: 5692KB, sent: 4KB, received: 68KB, period: 30sec, procs: 1 } 2018-04-07 02:13:45,100 INFO: Resource usage: { user: 41%, system: 0%, memory: 458MB, read: 0KB, written: 5660KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-04-07 02:14:15,116 INFO: Resource usage: { user: 41%, system: 0%, memory: 458MB, read: 0KB, written: 5452KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-04-07 02:14:45,139 INFO: Resource usage: { user: 41%, system: 0%, memory: 458MB, read: 0KB, written: 5460KB, sent: 10446KB, received: 93KB, period: 30sec, procs: 1 } 2018-04-07 02:15:15,106 INFO: Resource usage: { user: 77%, system: 0%, memory: 458MB, read: 0KB, written: 10384KB, sent: 16045KB, received: 248KB, period: 30sec, procs: 1 } 2018-04-07 02:15:45,129 INFO: Resource usage: { user: 77%, system: 1%, memory: 451MB, read: 0KB, written: 11172KB, sent: 63KB, received: 71KB, period: 30sec, procs: 1 } 2018-04-07 02:16:15,139 INFO: Resource usage: { user: 75%, system: 3%, memory: 451MB, read: 0KB, written: 12360KB, sent: 66KB, received: 2799KB, period: 30sec, procs: 1 } 2018-04-07 02:16:45,136 INFO: Resource usage: { user: 73%, system: 3%, memory: 451MB, read: 0KB, written: 12052KB, sent: 91KB, received: 10915KB, period: 30sec, procs: 1 } 2018-04-07 02:17:15,100 INFO: Resource usage: { user: 39%, system: 2%, memory: 451MB, read: 0KB, written: 6192KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-04-07 02:17:45,106 INFO: Resource usage: { user: 39%, system: 2%, memory: 451MB, read: 0KB, written: 6460KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-04-07 02:17:47,114 INFO: Converted to /tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/conform-c5k2mq63/converted/BASE_NS_CivicAddress_File_UT83.csv with 448005 addresses 2018-04-07 02:17:47,164 INFO: Processed data in /tmp/worker-t0j5tfe7/work-t9u3k14r/out/process_one-o2zbn5nt/out.csv 2018-04-07 02:17:47,164 WARNING: Nothing previewed