I have something similar... seems like yellowjackets, not wasps. Girl got stung a few times and ended up in the ER.
I've had the notion to pour gas in to their hole and light it on fire. 2 cans of Raid didn't take care of them. I also took a spade and wrecked their entrance tunnel but the little jerks drilled another one.