Transactional Replication: can create 52 publication, but creating 53rd leads to problems
I believe you are running into the desktop heap issue described here (support.microsoft.com/kb/949296) and here (support.microsoft.com/kb/824422).