2018-04-15 08:12:11,153 DEBUG: URL says ".opt" for https://www.avoindata.fi/data/dataset/cf9208dc-63a9-44a2-9312-bbd2c3952596/resource/6c6ccc69-0e05-4ed9-a1c8-31f62d7ed121/download/04_osoitteet_2018-02-15.opt 2018-04-15 08:12:11,154 DEBUG: Guessed addresses-primary-dff20e4b.opt for https://www.avoindata.fi/data/dataset/cf9208dc-63a9-44a2-9312-bbd2c3952596/resource/6c6ccc69-0e05-4ed9-a1c8-31f62d7ed121/download/04_osoitteet_2018-02-15.opt 2018-04-15 08:12:11,154 DEBUG: Requesting https://www.avoindata.fi/data/dataset/cf9208dc-63a9-44a2-9312-bbd2c3952596/resource/6c6ccc69-0e05-4ed9-a1c8-31f62d7ed121/download/04_osoitteet_2018-02-15.opt with args None 2018-04-15 08:12:15,163 INFO: Downloaded 12992328 bytes for file /tmp/worker-g52hbb12/work-ipjc2tuy/out/process_one-qt2uyj09/cache-l_ch5pkx/http/addresses-primary-dff20e4b.opt 2018-04-15 08:12:15,617 INFO: Cached data in file:///tmp/worker-g52hbb12/work-ipjc2tuy/out/process_one-qt2uyj09/cached/addresses-primary-dff20e4b.opt 2018-04-15 08:12:15,777 DEBUG: URL says ".opt" for file:///tmp/worker-g52hbb12/work-ipjc2tuy/out/process_one-qt2uyj09/cached/addresses-primary-dff20e4b.opt 2018-04-15 08:12:15,834 DEBUG: Guessed addresses-primary-0fa91f91.opt for file:///tmp/worker-g52hbb12/work-ipjc2tuy/out/process_one-qt2uyj09/cached/addresses-primary-dff20e4b.opt 2018-04-15 08:12:15,909 DEBUG: File exists /tmp/worker-g52hbb12/work-ipjc2tuy/out/process_one-qt2uyj09/conform-2iwfl7yj/http/addresses-primary-0fa91f91.opt 2018-04-15 08:12:15,910 INFO: Downloaded to ['/tmp/worker-g52hbb12/work-ipjc2tuy/out/process_one-qt2uyj09/conform-2iwfl7yj/http/addresses-primary-0fa91f91.opt'] 2018-04-15 08:12:15,910 WARNING: Could not guess a single compression from file names 2018-04-15 08:12:15,910 INFO: Decompressed to 1 files 2018-04-15 08:12:15,911 INFO: Sampled 6 records 2018-04-15 08:12:15,911 DEBUG: Converting to /tmp/worker-g52hbb12/work-ipjc2tuy/out/process_one-qt2uyj09/conform-2iwfl7yj 2018-04-15 08:12:15,944 DEBUG: extract temp file /tmp/openaddr-extracted-m3fahh_w.csv 2018-04-15 08:12:15,944 INFO: Converting source CSV /tmp/worker-g52hbb12/work-ipjc2tuy/out/process_one-qt2uyj09/conform-2iwfl7yj/http/addresses-primary-0fa91f91.opt 2018-04-15 08:12:15,944 DEBUG: Synthesized header ['COLUMN1', 'COLUMN2', 'COLUMN3', 'COLUMN4', 'COLUMN5', 'COLUMN6', 'COLUMN7', 'COLUMN8', 'COLUMN9', 'COLUMN10', 'COLUMN11', 'COLUMN12', 'COLUMN13', 'COLUMN14', 'COLUMN15', 'COLUMN16'] 2018-04-15 08:12:41,201 INFO: Resource usage: { user: 18%, system: 0%, memory: 544MB, read: 0KB, written: 41520KB, sent: 187KB, received: 43397KB, period: 30sec, procs: 1 } 2018-04-15 08:13:11,145 INFO: Resource usage: { user: 20%, system: 0%, memory: 544MB, read: 0KB, written: 4176KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-04-15 08:13:41,159 INFO: Resource usage: { user: 20%, system: 0%, memory: 544MB, read: 0KB, written: 4268KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-04-15 08:14:11,166 INFO: Resource usage: { user: 20%, system: 1%, memory: 544MB, read: 0KB, written: 3332KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-04-15 08:14:41,183 INFO: Resource usage: { user: 19%, system: 1%, memory: 544MB, read: 0KB, written: 2592KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-04-15 08:15:11,129 INFO: Resource usage: { user: 20%, system: 1%, memory: 544MB, read: 0KB, written: 2732KB, sent: 374KB, received: 79960KB, period: 30sec, procs: 1 } 2018-04-15 08:15:35,385 INFO: Converted to /tmp/worker-g52hbb12/work-ipjc2tuy/out/process_one-qt2uyj09/conform-2iwfl7yj/converted/addresses-primary-0fa91f91.csv with 129074 addresses 2018-04-15 08:15:35,398 INFO: Processed data in /tmp/worker-g52hbb12/work-ipjc2tuy/out/process_one-qt2uyj09/out.csv 2018-04-15 08:15:35,398 INFO: Writing from /tmp/worker-g52hbb12/work-ipjc2tuy/out/process_one-qt2uyj09/out.csv to /tmp/points-how9r9hb.bin... 2018-04-15 08:15:41,169 INFO: Resource usage: { user: 27%, system: 1%, memory: 544MB, read: 0KB, written: 3272KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-04-15 08:15:51,009 INFO: Wrote 129074 points to /tmp/points-how9r9hb.bin 2018-04-15 08:15:51,009 DEBUG: Reading from /tmp/points-how9r9hb.bin 2018-04-15 08:15:51,877 DEBUG: Reading from /tmp/points-how9r9hb.bin 2018-04-15 08:15:53,463 INFO: Preview width 668, scale 0.00329, zoom 8.01 2018-04-15 08:15:54,659 DEBUG: Getting tile http://a.tiles.mapbox.com/v4/mapbox.mapbox-streets-v7/8/144/72.mvt?access_token=sk.eyJ1Ijoib3Blbi1hZGRyZXNzZXMiLCJhIjoiY2lpM2F1ZG8zMDB4Z3Q4bTBocHQ1aXQ3dyJ9._peY1MJVk-8w6juDAdmqcg 2018-04-15 08:15:56,139 DEBUG: Getting tile http://a.tiles.mapbox.com/v4/mapbox.mapbox-streets-v7/8/145/72.mvt?access_token=sk.eyJ1Ijoib3Blbi1hZGRyZXNzZXMiLCJhIjoiY2lpM2F1ZG8zMDB4Z3Q4bTBocHQ1aXQ3dyJ9._peY1MJVk-8w6juDAdmqcg 2018-04-15 08:15:58,329 DEBUG: Getting tile http://a.tiles.mapbox.com/v4/mapbox.mapbox-streets-v7/8/146/72.mvt?access_token=sk.eyJ1Ijoib3Blbi1hZGRyZXNzZXMiLCJhIjoiY2lpM2F1ZG8zMDB4Z3Q4bTBocHQ1aXQ3dyJ9._peY1MJVk-8w6juDAdmqcg 2018-04-15 08:15:59,394 DEBUG: Getting tile http://a.tiles.mapbox.com/v4/mapbox.mapbox-streets-v7/8/144/73.mvt?access_token=sk.eyJ1Ijoib3Blbi1hZGRyZXNzZXMiLCJhIjoiY2lpM2F1ZG8zMDB4Z3Q4bTBocHQ1aXQ3dyJ9._peY1MJVk-8w6juDAdmqcg 2018-04-15 08:16:01,290 DEBUG: Getting tile http://a.tiles.mapbox.com/v4/mapbox.mapbox-streets-v7/8/145/73.mvt?access_token=sk.eyJ1Ijoib3Blbi1hZGRyZXNzZXMiLCJhIjoiY2lpM2F1ZG8zMDB4Z3Q4bTBocHQ1aXQ3dyJ9._peY1MJVk-8w6juDAdmqcg 2018-04-15 08:16:03,368 DEBUG: Getting tile http://a.tiles.mapbox.com/v4/mapbox.mapbox-streets-v7/8/146/73.mvt?access_token=sk.eyJ1Ijoib3Blbi1hZGRyZXNzZXMiLCJhIjoiY2lpM2F1ZG8zMDB4Z3Q4bTBocHQ1aXQ3dyJ9._peY1MJVk-8w6juDAdmqcg 2018-04-15 08:16:05,537 DEBUG: Reading from /tmp/points-how9r9hb.bin 2018-04-15 08:16:11,139 INFO: Resource usage: { user: 24%, system: 0%, memory: 567MB, read: 0KB, written: 644KB, sent: 11KB, received: 383KB, period: 30sec, procs: 1 } 2018-04-15 08:16:41,154 INFO: Resource usage: { user: 29%, system: 1%, memory: 580MB, read: 0KB, written: 13284KB, sent: 0KB, received: 0KB, period: 30sec, procs: 2 } 2018-04-15 08:17:11,144 INFO: Resource usage: { user: 28%, system: 1%, memory: 650MB, read: 0KB, written: 68932KB, sent: 1KB, received: 1KB, period: 30sec, procs: 2 } 2018-04-15 08:17:41,152 INFO: Resource usage: { user: 27%, system: 1%, memory: 650MB, read: 0KB, written: 55932KB, sent: 0KB, received: 0KB, period: 30sec, procs: 2 } 2018-04-15 08:18:11,243 INFO: Resource usage: { user: 20%, system: 1%, memory: 650MB, read: 0KB, written: 27920KB, sent: 0KB, received: 0KB, period: 30sec, procs: 2 } 2018-04-15 08:18:23,492 INFO: Preview image in /tmp/worker-g52hbb12/work-ipjc2tuy/out/process_one-qt2uyj09/preview.png