Part 101.41 lists the same rules as section 336 so let's just treat them as the same thing. Section 101 does list rules that you can "violate". I'll list Part 101.41 below that pertains to UAV's and bold the areas that apply to this statement:
This subpart prescribes rules governing the operation of a model aircraft (or an aircraft being developed as a model aircraft) that meets all of the following conditions as set forth in section 336 of Public Law 112-95:
(a) The aircraft is flown strictly for hobby or recreational use;
(b) The aircraft is operated in accordance with a community-based set of safety guidelines and within the programming of a nationwide community-based organization;
(c) The aircraft is limited to not more than 55 pounds unless otherwise certified through a design, construction, inspection, flight test, and operational safety program administered by a community-based organization;
(d) The aircraft is operated in a manner that does not interfere with and gives way to any manned aircraft; and
(e) When flown within 5 miles of an airport, the operator of the aircraft provides the airport operator and the airport air traffic control tower (when an air traffic facility is located at the airport) with prior notice of the operation.
Only AMA members need to follow AMA rules. They don't apply to anyone else.
There can be as much violation under Part 101 (Section 336) as there is under Part 107. The actual disagreement is if violation of anything in Section 336 automatically means it does not apply. My position is that your reason for flying is the first question (hobby vs commercial). If, in this case, it's hobby, you then ask if there was a violation of 336. I contend if there was it does not automatically mean that you were not flying non-commerecially (violation of 336 does not change this). You are simply in violation of one of the things you are required to due when you fly non-commercially. The intent of Section 336 is Congress telling the FAA that they don't need to regulate things like paper airplaces thrown in the air for fun or small UAVs as long as they follow certain ruled as there is no need. That is, as long as you fly safe... a boat ton of other rules don't need to apply to you. The FAA holds a commercial flight to a much higher standard. So if a person is flying as a hobby and accidently violate one rule under hobby use, why would it make sense to all of a sudden say that they are flying commercially and turn their world upside down with recision of certain rules they were suppose to follow and add other rules that they were not supposed to follow. It make much more sense to see the reason for the flight not changing at all (hobby) and simply applying a penalty for violation of the _actual_ thing the person did wrong.
Let me say in this post that I don't fly under Part 107 so I've not go through everything listed there (as there was no need and research is time intensive). Right now I'm going through 107 so I've not get commented on some of the things posted here). I'm not 100% convinced that it allows a violation against a hobby flight.