Yes !
It all depends at which point of the mains cycle the switch was turned off. Switch off when the mains is at a peak, and the caps store about 350 Volts DC which can't get away to anywhere because there's such bl...y good insulation between the live and neutral and the earth.
It hurts, too !
