Why does NIH study section website robot.txt disallow search?
@Memming, this could be done for any number of reasons.  The two I can think of off the top of my head is 1) to prevent site slowdowns especially due to what is likely to be the duplication of information developed by indexing the NIH site and 2) to protect (to some extent) the privacy of the participants.

One suggestion, have you tried using Google to search the site?  Search is not the same as indexing.  So if you're looking for sections with "Joe Brown" you can try searching "Joe Brown site:csr.nih.gov".  I was able to get results with this approach using a name I picked at random from the study sessions.