I think we need to recognize that what makes something “good” is completely subjective. When you argue that public goods are good for society, you are essentially saying that people don’t know what is good for themselves, and that others should decide that for them.
This is immoral. I don’t decide what is good for you, you do.
If something is good for you, you will pay for it. If you don’t want to pay for it, then it is not good for you.