Are Perceptrons the neural network equivalence of Linear and Logistic Regression?
Yes, logistic regression can be viewed as a simple neural network with multiple inputs, a single neuron, a single output, and using the logistic function as the activation function.

No, linear regression is not a form of a neural network (a neural network would have a activation function; but there's nothing like that present in linear regression).