Many American athletes opposed competing on a Sunday because they traveled as representatives of their colleges and were expected to withdraw rather than compete on the `` sabbath '' . The decision to hold competitions on a Sunday brought protests from many American athletes , who traveled as representatives of their colleges and were expected to withdraw rather than compete on their religious day of rest .