Can't you just use a pot of water on the hob? Surely it doesn't get any cheaper than that.
Yes, but an electric milk warmer is quicker. A couple of minutes can seem like hours when you've got a baby screaming for his/her feed.
Also safer. You don't really want to be fucking around with a pot of hot water in one hand while you're holding a screaming baby in the other arm.