People have, but it's not as simple as you'd think. You really should get a switch that is rated for DC power, like an automotive 12v switch. And those are pretty heavy. Most lightweight switches are AC rated, which means they are more likely to fail on switching when the DC arcs across the gap.
There's actually a reason why rc planes and helis traditionally bias to direct connections to the battery.