Is it common to have no ceiling joists above joist-parallel walls?
I have seen this many times in older home renovations here in VA.  Even homes older than the 20's.    I would recommend bracing and installing supplemental support before removing the wall.  It can help prevent movement.  Also make sure you are not removing a load bearing wall.