metrics collection gets panic #425
Description
Mar 24 09:04:03 vds0 virtengine[9620]: fatal error: concurrent map iteration and map write
Mar 24 09:04:03 vds0 virtengine[9620]: goroutine 6903 [running]:
Mar 24 09:04:03 vds0 virtengine[9620]: runtime.throw(0xd9a07c, 0x26)
Mar 24 09:04:03 vds0 virtengine[9620]: /home/jonathan/golang/go/src/runtime/panic.go:596 +0x95 fp=0xc420edfbe0 sp=0xc420edfbc0
Mar 24 09:04:03 vds0 virtengine[9620]: runtime.mapiternext(0xc420edfd88)
Mar 24 09:04:03 vds0 virtengine[9620]: /home/jonathan/golang/go/src/runtime/hashmap.go:737 +0x7ee fp=0xc420edfc90 sp=0xc420edfbe0
Mar 24 09:04:03 vds0 virtengine[9620]: github.com/megamsys/vertice/metrix.eventSkews(0xc420698a00, 0x12, 0xc420c62000, 0xc4200a0448, 0xc4200a03e8)
Mar 24 09:04:03 vds0 virtengine[9620]: /home/jonathan/.go/src/github.com/megamsys/vertice/metrix/scylla_output.go:67 +0x35e fp=0xc420edfdf8 sp=0xc420edfc90
Mar 24 09:04:03 vds0 virtengine[9620]: github.com/megamsys/vertice/metrix.(*OpenNebula).DeductBill(0xc420556050, 0xc420cba000, 0xc4208ba900, 0xc000)
Mar 24 09:04:03 vds0 virtengine[9620]: /home/jonathan/.go/src/github.com/megamsys/vertice/metrix/one.go:56 +0x3fc fp=0xc420edfec8 sp=0xc420edfdf8
Mar 24 09:04:03 vds0 virtengine[9620]: github.com/megamsys/vertice/metrix.(*OpenNebula).Collect(0xc420556050, 0xc420cba000, 0x3, 0xc420aa9560)
Mar 24 09:04:03 vds0 virtengine[9620]: /home/jonathan/.go/src/github.com/megamsys/vertice/metrix/one.go:74 +0xcb fp=0xc420edff10 sp=0xc420edfec8
Mar 24 09:04:03 vds0 virtengine[9620]: github.com/megamsys/vertice/metrix.(*MetricHandler).Collect(0x13be0e0, 0x13709a0, 0xc420556050, 0x0, 0x0, 0x0, 0xc420aa94a0, 0x8b2482)
Mar 24 09:04:03 vds0 virtengine[9620]: /home/jonathan/.go/src/github.com/megamsys/vertice/metrix/metric_handler.go:13 +0x97 fp=0xc420edff58 sp=0xc420edff10
Mar 24 09:04:03 vds0 virtengine[9620]: github.com/megamsys/vertice/subd/metricsd.(*Handler).processCollector(0xc42013e1b8, 0x13be0e0, 0xc420222000, 0x13709a0, 0xc420556050, 0xc42086f1d8, 0xc3e320)
Mar 24 09:04:03 vds0 virtengine[9620]: /home/jonathan/.go/src/github.com/megamsys/vertice/subd/metricsd/handler.go:16 +0x43 fp=0xc420edffa8 sp=0xc420edff58
Mar 24 09:04:03 vds0 virtengine[9620]: runtime.goexit()
Mar 24 09:04:03 vds0 virtengine[9620]: /home/jonathan/golang/go/src/runtime/asm_amd64.s:2197 +0x1 fp=0xc420edffb0 sp=0xc420edffa8
Mar 24 09:04:03 vds0 virtengine[9620]: created by github.com/megamsys/vertice/subd/metricsd.(*Service).onedCollectors
Mar 24 09:04:03 vds0 virtengine[9620]: /home/jonathan/.go/src/github.com/megamsys/vertice/subd/metricsd/service.go:128 +0x491
Mar 24 09:04:03 vds0 virtengine[9620]: goroutine 1 [chan receive, 47 minutes]:
Mar 24 09:04:03 vds0 virtengine[9620]: github.com/megamsys/vertice/cmd/vertice/run.(*Start).Run(0xc4201b8e40, 0xc420143540, 0x0, 0x0)
Mar 24 09:04:03 vds0 virtengine[9620]: /home/jonathan/.go/src/github.com/megamsys/vertice/cmd/vertice/run/command.go:85 +0x5e3
Mar 24 09:04:03 vds0 virtengine[9620]: github.com/megamsys/libgo/cmd.(*Manager).Run(0xc4201ac160, 0xc420010130, 0x2, 0x2)
Mar 24 09:04:03 vds0 virtengine[9620]: /home/jonathan/.go/src/github.com/megamsys/libgo/cmd/cmd.go:183 +0x15b7
Mar 24 09:04:03 vds0 virtengine[9620]: main.main()
Mar 24 09:04:03 vds0 virtengine[9620]: /home/jonathan/code/detio/gitpackager/vertice/build/xenial/virtengine/src/github.com/megamsys/virtengine/cmd/vertice/main.go:52 +0xb8