is not so much defined by the presence of public courts, military, roads , etc. Would anyone call the founding fathers socialists ? Hardly - and yet they did support all these, as well as established post office and so forth.
Socialism is more of a ideology in which the government can legislate and regulate financial and moral behavior of the society. It assumes that the legislator has the ultimate wisdom in what is best for society and allows the government to set maximum/minimum price wages, ban foods/drinks/products, regulate private business, give out special deals to preferred industries/businesses and otherwise intrude in free market.