Milk is Veg or Non-Veg

There is a raging controversy about whether milk is a vegetarian food or non –vegetarian. Skeptics say that since it is liquid food it should be designated as vegetarian and not consumed after infancy as it is then not required. On the other hand, pro-milk drinkers say that milk is a vegetarian food since it is not procured by killing the animal and does not consist of any animal part.