What are the options for renting an aircraft in the Caribbean with an FAA certificate?
You would be much better off renting the plane in the United States. It will be difficult to find a rental anywhere in the Caribbean, except maybe Puerto Rico.

You may want to read Greenspun's Flying in the Caribbean. It's a little dated but has good information.