Alright, I have now upon further testing concluded that it's something about the headset.

I tried it on the old computer again, and after just a few seconds the same symptoms showed there as on the other computer.

It's time to give those Razer guys a goddamn call

EDIT: Go figure that phone support is only for US or Canadian customers