One of the biggest arguments against the Ever Virginity of Mary is that the Bible says about Jesus's brothers. However, the Greek word for brothers was also used to address friends and every day people as we see in the Epistles.
That's probably it.
I didn't know that about you, but that's for a different thread. :P Well I know that even though some may know that they are not worshipping but rather venerating, they're still not on board with it.