Why hello there. Sure I can answer your question, but first I should mention...
I don't think all human rights spring from property rights, but many do. Nor do I think people are property, I do think people have a right, akin to a property right, in themselves. Meaning people should be able to self determine.
A person is neutral if they refuse to interact with another person, since it is within everybody's right to self determine to decide who they will or won't interact with.
A person is not neutral if they forcibly insist another person interact with them despite an objection from the intended victim.
A neutral person who keeps to them self is not "breaking the peace", but a person who insists another person interact with them or be harmed, is breaking the peace.
I hope that answers your question.
That's all you get for now.