despite their dislike of byrnes and the obvious assumption that whatever had happened had likely been the overseer 's fault , there was n't the slightest suggestion that this would alter the slave 's fate in any way .