Will extra teeth on a chainring work?
Two extra teeth will increase your gear ratios by 6% (34/32 = 1.06). What it will not do is help retain you chain any better.

Did you shorten the chain when you removed the inner and outer rings? (Assuming that's what you did.) If you didn't that may be why you are dropping the chain - it's too slack. BTW, you can re-install the front derailleur to act as a chain guide. 

If you did shorten the chain you may have to replace it to accommodate the new larger chainring.