=" no index "> ▁ ▁Or , ▁to ▁block ▁B ing ' s ▁bot , ▁specify : ▁ ▁< meta ▁name =" bing bot " ▁content =" no index "> ▁ ▁Or , ▁to ▁block ▁Ba id u ' s ▁bot , ▁specify : ▁ ▁< meta ▁name =" ba id us p ider " ▁content =" no index "> ▁ ▁rob ots . txt ▁file ▁ ▁A ▁rob ots . txt ▁file ▁can ▁be ▁used ▁to ▁block ▁craw ling . ▁ ▁No index ing ▁part ▁of ▁a ▁page ▁▁ ▁It ▁is ▁also ▁possible ▁to ▁exclude ▁part ▁of ▁a ▁Web ▁page , ▁for ▁example ▁navigation ▁text , ▁from ▁being ▁indexed ▁rather ▁than ▁the ▁whole ▁page . ▁There ▁are ▁various ▁techniques ▁for ▁doing ▁this ; ▁it ▁is ▁possible ▁to ▁use ▁several ▁in ▁combination . ▁Google ' s ▁main ▁indexing ▁sp ider , ▁Google bot , ▁is ▁not ▁known ▁to ▁recognize ▁any ▁of ▁these ▁techniques . ▁ ▁< no index > ▁tag ▁ ▁The ▁Russian ▁search ▁engine ▁Yan dex ▁introduced ▁a ▁new ▁< no index > ▁tag ▁which ▁prevents ▁indexing ▁of ▁the ▁content ▁between ▁the ▁tags . ▁To ▁allow ▁the ▁source ▁code ▁to ▁validate , ▁<!-- no index --> ▁altern atively ▁can ▁be ▁used : ▁< p > ▁Do ▁index ▁this ▁text . ▁< no index > Don ' t ▁index ▁this ▁text .</ no index > ▁<!-- no index --> Don ' t ▁index ▁this ▁text . <!-- / no index --> ▁</ p > ▁ ▁Other ▁indexing ▁sp iders ▁also ▁recognize ▁the ▁<