Shale is a particularly good rock for this to occur in, and some limestones like chalk, are composed almost entirely of fossilized marine animal remains. Fossils will be found almost exclusively in sedimentary rocks. Sedimentary rocks are formed by the compression and cementation of sediments over millions of years.