Cannot blur objects with Z Combine
I got it working. As PG Math proposed I used Alpha Overs and Mask. I didn't use Z transform. 

For each object layer ( except background ) i set all other object layers as a mask. The camera can now freely move around the scene and the objects are blurred nicely and the objects render correctly.