BUG/TST: Read from Public s3 Bucket Without Creds
- [x] Closes #34626

We should potentially merge this before https://github.com/pandas-dev/pandas/pull/34266 to confirm reading from s3 without credentials works.

Ref discussion here: https://github.com/pandas-dev/pandas/pull/34793#issuecomment-645023794

cc. @jorisvandenbossche 