I understand the concern, but it may be unrealistic to expect that there will be no further restrictions. As these become more popular they will probably need to be more regulated for all kinds of reasons - safety, privacy, noise, nuisance etc.. The new UAVs really are a paradigm shift in terms of airspace use.
If I had to guess, at this point, I think that all except the real toy aircraft will end up with transponders along the lines of ADS-B, not in order to spy on or track the users but to avoid conflicts with other traffic and to keep them out of TFRs and other restricted airspace. Maybe there will also be some kind of flexibility introduced for very low-altitude flights of limited range.