Sparse connections in feedforward network tensorflow or pytorch?
We don't use sparse connections in feedforward to make use of an efficient matrix product operations.
But If you want to model that aspect, see dropout