You would have had to toggle the S2 switch back and forth at least twice. Pushing it down once would not have initiated RTH. You could have also hit the return to home icon on the left side of the DJI GO app. If done in the DJI GO app though, you'd also have to slide the button to confirm that you want to RTH. So, I'm assuming you toggled the S2 switch if anything.