I think intent is a key element here. The hypothetical trespassing toddler is not intending to cause the property owner any harm; most likely they do not yet understand the concept of property boundaries. Similarly, an adult who trips on the sidewalk and falls into someone else's property is not intending to trespass either, even if they do understand the concept. In both cases, violence and threats are not justified by the NAP, in my opinion.