TST: csv_dir_path fixture check the existence of the dir instead of the file 
Currently, all test date files are excluded in distribution. But we are using `csv_dir_path` fixture to check the existence of the directory instead of the test file itself. It caused many failures in #38852. I excluded the dir `pandas/tests/io/parser/data` in that PR. Maybe should check the file instead of the dir.