As BD said, it can be used in that manner but doesn't have to be.
Any word can be taken negatively if it's intended that way.
a black mate described it as this...
calling me nicely neger, is like calling an obese person nicley fat, or someone who wheres glasses nicely foureyes. of course fat and foureyes can be taken negatively too if intended.