   [.net] Web crawling and java script
  Here's a site with sample query http://www.ncbi.nlm.nih.gov/pubmed/?term=biomarker+seldim for which I need to get some information from. In the left hand top corner there's an option Display Settings. By choosing for instance "XML" and pressing "Apply" we can get site's view in XML format. And this is what I'm just willing to do - download site's content in XML format, but I can't specify into the browser an explicit address because of &#106avascript.Any idea on how I could get the site's content in XML format?   
  Hi,have a look here.http://eutils.ncbi.nlm.nih.gov/entrez/query/static/eutils_help.htmlYou can use the complete database with parameter commands in the adressline. It responds with a XML file.There are ready to use tools, but it shouldn't take long to write a crawler. Many online platforms for antibodies use them to link references ... or find them in the first place or to find standard antigene names and synonymes.--GWDevEdit:You build you search with these instructions:http://eutils.ncbi.nlm.nih.gov/corehtml/query/static/esearch_help.htmlThat will give you a xml with the PMIDs.Please be fair and read the requirements to run such scripts.   ;  It looks like they use a POST variable called EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sPresentation to determine how to format the response. Contruct a POST request manually and set that to the value "xml" and see if that works.   ;Quote:Original post by CodeMunkieIt looks like they use a POST variable called EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DisplayBar.sPresentation to determine how to format the response. Contruct a POST request manually and set that to the value "xml" and see if that works.It is 'retype=xml' actually.   