I noticed that Google search results for one of my sites link directly to ajax request pages, so I put them on robots.txt. However, doing this makes Google not crawl the contents at all (checked using Google Webmaster Tool).Is there any way to make Google still crawl the ajax contents as a part of the main website contents, but not link to the ajax request links directly?
Make Google crawl ajax contents but not link to them directly
seo;ajax