2018-05-12 20:12:44,310 DEBUG: URL says ".opt" for https://www.avoindata.fi/data/dataset/cf9208dc-63a9-44a2-9312-bbd2c3952596/resource/60257374-2547-48b4-b61b-2426e9063064/download/01_osoitteet_2018-02-15.opt 2018-05-12 20:12:44,311 DEBUG: Guessed addresses-primary-d3257709.opt for https://www.avoindata.fi/data/dataset/cf9208dc-63a9-44a2-9312-bbd2c3952596/resource/60257374-2547-48b4-b61b-2426e9063064/download/01_osoitteet_2018-02-15.opt 2018-05-12 20:12:44,311 DEBUG: Requesting https://www.avoindata.fi/data/dataset/cf9208dc-63a9-44a2-9312-bbd2c3952596/resource/60257374-2547-48b4-b61b-2426e9063064/download/01_osoitteet_2018-02-15.opt with args None 2018-05-12 20:13:01,067 INFO: Downloaded 57108144 bytes for file /tmp/worker-4ygse3xe/work-7f30j0ac/out/process_one-71flbbum/cache-ckmlyj1_/http/addresses-primary-d3257709.opt 2018-05-12 20:13:02,165 INFO: Cached data in file:///tmp/worker-4ygse3xe/work-7f30j0ac/out/process_one-71flbbum/cached/addresses-primary-d3257709.opt 2018-05-12 20:13:02,465 DEBUG: URL says ".opt" for file:///tmp/worker-4ygse3xe/work-7f30j0ac/out/process_one-71flbbum/cached/addresses-primary-d3257709.opt 2018-05-12 20:13:02,465 DEBUG: Guessed addresses-primary-beba1ad2.opt for file:///tmp/worker-4ygse3xe/work-7f30j0ac/out/process_one-71flbbum/cached/addresses-primary-d3257709.opt 2018-05-12 20:13:02,757 DEBUG: File exists /tmp/worker-4ygse3xe/work-7f30j0ac/out/process_one-71flbbum/conform-scdggejz/http/addresses-primary-beba1ad2.opt 2018-05-12 20:13:02,757 INFO: Downloaded to ['/tmp/worker-4ygse3xe/work-7f30j0ac/out/process_one-71flbbum/conform-scdggejz/http/addresses-primary-beba1ad2.opt'] 2018-05-12 20:13:02,757 WARNING: Could not guess a single compression from file names 2018-05-12 20:13:02,758 INFO: Decompressed to 1 files 2018-05-12 20:13:02,758 INFO: Sampled 6 records 2018-05-12 20:13:02,758 DEBUG: Converting to /tmp/worker-4ygse3xe/work-7f30j0ac/out/process_one-71flbbum/conform-scdggejz 2018-05-12 20:13:02,759 DEBUG: extract temp file /tmp/openaddr-extracted-pm7j8mtw.csv 2018-05-12 20:13:02,759 INFO: Converting source CSV /tmp/worker-4ygse3xe/work-7f30j0ac/out/process_one-71flbbum/conform-scdggejz/http/addresses-primary-beba1ad2.opt 2018-05-12 20:13:02,759 DEBUG: Synthesized header ['COLUMN1', 'COLUMN2', 'COLUMN3', 'COLUMN4', 'COLUMN5', 'COLUMN6', 'COLUMN7', 'COLUMN8', 'COLUMN9', 'COLUMN10', 'COLUMN11', 'COLUMN12', 'COLUMN13', 'COLUMN14', 'COLUMN15', 'COLUMN16'] 2018-05-12 20:13:14,357 INFO: Resource usage: { user: 19%, system: 2%, memory: 544MB, read: 0KB, written: 171124KB, sent: 290KB, received: 56348KB, period: 30sec, procs: 1 } 2018-05-12 20:13:44,319 INFO: Resource usage: { user: 40%, system: 0%, memory: 544MB, read: 0KB, written: 10176KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-05-12 20:14:14,331 INFO: Resource usage: { user: 41%, system: 0%, memory: 544MB, read: 0KB, written: 9704KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-05-12 20:14:44,329 INFO: Resource usage: { user: 41%, system: 0%, memory: 544MB, read: 0KB, written: 8900KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-05-12 20:15:14,321 INFO: Resource usage: { user: 38%, system: 0%, memory: 544MB, read: 0KB, written: 9376KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-05-12 20:15:44,320 INFO: Resource usage: { user: 48%, system: 0%, memory: 544MB, read: 0KB, written: 10832KB, sent: 7008KB, received: 6976KB, period: 30sec, procs: 1 } 2018-05-12 20:16:14,298 INFO: Resource usage: { user: 37%, system: 0%, memory: 544MB, read: 0KB, written: 8104KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-05-12 20:16:44,334 INFO: Resource usage: { user: 36%, system: 1%, memory: 544MB, read: 0KB, written: 4988KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-05-12 20:17:14,365 INFO: Resource usage: { user: 39%, system: 1%, memory: 544MB, read: 0KB, written: 5248KB, sent: 2KB, received: 1KB, period: 30sec, procs: 1 } 2018-05-12 20:17:44,293 INFO: Resource usage: { user: 39%, system: 1%, memory: 544MB, read: 0KB, written: 5124KB, sent: 1KB, received: 1KB, period: 30sec, procs: 1 } 2018-05-12 20:18:14,290 INFO: Resource usage: { user: 39%, system: 1%, memory: 544MB, read: 0KB, written: 5160KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-05-12 20:18:44,347 INFO: Resource usage: { user: 37%, system: 1%, memory: 544MB, read: 0KB, written: 5036KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-05-12 20:19:14,343 INFO: Resource usage: { user: 37%, system: 1%, memory: 544MB, read: 0KB, written: 5044KB, sent: 0KB, received: 0KB, period: 30sec, procs: 1 } 2018-05-12 20:19:44,301 INFO: Resource usage: { user: 42%, system: 1%, memory: 544MB, read: 0KB, written: 5584KB, sent: 8582KB, received: 89KB, period: 30sec, procs: 1 } 2018-05-12 20:19:45,231 INFO: Converted to /tmp/worker-4ygse3xe/work-7f30j0ac/out/process_one-71flbbum/conform-scdggejz/converted/addresses-primary-beba1ad2.csv with 487626 addresses 2018-05-12 20:19:45,258 INFO: Processed data in /tmp/worker-4ygse3xe/work-7f30j0ac/out/process_one-71flbbum/out.csv 2018-05-12 20:19:45,258 WARNING: Nothing previewed