Can I use an old chimney as a electrical chase
It isn't a chimney if it is disconnected.   Yes.
As for what you need to support the cables.   This is really on the whim of a local inspector.   As mentioned in comments I have never had an issue dropping NM straight down plumbing walls in the interior of a house.   I made right before the drop and right after the drop very secure.