Sometimes there are safer options than beating or joining them. Like hiding and not letting them know you're there in the first place. Always a good option with invasions until you know if they'd hire you or just kill you. Or make you kill someone.