$user not updating and "Validation error, please try again." on form in block
Just to answer my own question. In this answer to another question, Berdir mentions that Drupal 6 will not update your block information. The example given to do it in code is here but I just updated the cache field to -1 (BLOCK_NO_CACHE) in the blocks table.