php - How to identify the client is a search robot? -


i have built entire site using ajax (indeed it's gwt). have implemented ajax crawling proposed google. however, after implementation, found neither yahoo , bing, nor baidu implemented scheme!

i'm wondering if there way identify web client search robot. if are, shown html snapshot created.

it best if can identify them in apache level, can mod_rewrite. it's still ok if can in php or gwt.

to apache can use rewriterule rewritecond on %{http_user_agent} .

the rewritecond accepts regexp, have use pattern there, matches bots(you should find informations how build pattern on page linked acme).

but careful: search-engines may penalize pages deliver different contents bots , others clients.


Comments

Popular posts from this blog

asp.net - repeatedly call AddImageUrl(url) to assemble pdf document -

java - Android recognize cell phone with keyboard or not? -

iphone - How would you achieve a LED Scrolling effect? -