Difference between spider, crawler and robots? - Joomla! Forum - community, help and support
hello all, looks spider, crawler, robots same many says both terms different. had searched many forums, posts didn't exact answer. tell me this.... consider , work on suggestion given you..
spider , crawler technically same, except spider used tool used crawl website, while crawler used search engines (also crawling website).
i think mean "robot" , not "robots" (which text file instructing search engines index , not index), , "robot" means technically crawler or spider crawling website (such googlebot, bingbot, other tool/search engine). robot can mean spider or crawler.
of course, others may terms equivalent, , that's ok, because definitions subjective.
i think mean "robot" , not "robots" (which text file instructing search engines index , not index), , "robot" means technically crawler or spider crawling website (such googlebot, bingbot, other tool/search engine). robot can mean spider or crawler.
of course, others may terms equivalent, , that's ok, because definitions subjective.
Comments
Post a Comment