Is this scheme correct for logistic regression with stochastic gradient descent
Hard to say without more detail, but isn't your update wrong? you need to subtract rather than add the gradient. Unless alpha is negative, this is wrong.