What kind of knives are illegal in New York? First and foremost, it is illegal to carry a knife if you intend to use it to harm another person. It isn't legal to own any knife primarily used as a weapon. It's also important to note that you can't carry a knife that is more than four inches long.