It's not specified either way.
The only rule that seems to apply is under ammunition explosions, where it says something to the effect of when a slot containing ammunition is hit, the ammo contained in that slot explodes. Since Rocket Launchers and One Shot SRM/LRM/Streaks contain their ammo WITH the launcher, not in a separate bin, that seems to suggest that the launchers themselves explode.