layer/validate: Fixed error in NSEC3 name error response check.

Function determining whether a NSEC3 record covers a name was wrong. The
case when the owner and next hashed name was wrapping over zero was
wrongly interpreted.