They are so annoying spawning all the time and messing up my world. I cant even afk to make my farm grow at night because i get killed by phantoms unless i make a dirt hut to box myself in or take a bed with me all the time (which i hate doing because I dont want my spawn point reset!)
And pillagers are way too OP spawning basically everywhere at any time!
Pillagers aren't that bad, actually. Most of the time you can even just ignore them and they'll just wander on by without even seeing you. Just fight with smart tactics (shield, ranged weapons, or just kite them around to spread them out a bit). Cows are everywhere, too, so if you kill a banner-head just suck down some milk and you won't have to suffer through the hour-plus Bad Omen.
The only real annoying part about Pillagers is when you're too close to an outpost, but those are uncommon enough that you shouldn't have any issues with finding a safe spot to build in.