I am having this same problem, I found this in a search hoping to find help, but my problem is much more severe. I have at least 150 villagers, from the roof of one house I counted 14 iron golems. Walking through the streets is like wading through a mosh pit, you can't enter any of the buildings, even the nearby fields are full of hippies... What do I do? I can't take on that many golems without major TNT cannon artillery...
1. Kill golemns
2. Put a block of sand infront of every door except 1.
3. Once night comes let two to five villagers go in the house and then block it with sand.
4. Let the zombies do the rest of the work and enjoy the show.