Wednesday, February 25, 2009

Search Engine Spider OR web crawlers

Search Engine Spider - A computer software program that automatically browses the Web pages. Spiders are used to submit pages to search engines through links. It crawls over the Web thats why we Call them spider. Another term for these computer software program is " web crawler ".so many professionals don't know the name of these spiders. so here i am giving you a table of that.


Search Engine Spider Names

Spider Name

Search Engine

Status

AbachoBOT

Abacho

-

Acoon

Acoon

-

AESOP_com_SpiderMan

Aesop

-

ah-ha.com crawler

Ah-ha

-

appie

Walhello

-

Arachnoidea

Euroseek

active

ArchitextSpider

Excite

inactive

Atomz

Atomz

-

DeepIndex

DeepIndex (www.en.deepindex.com)

-

ESISmartSpider

Ttravel Finder

-

EZResult

EZResults

-

FAST-WebCrawler

AlltheWeb

active

Fido

PlanetSearch

-

Fluffy the spider

SearchHippo

active

Googlebot

Google

active

Gigabot

Gigablast

active

Gulliver

Northernlight

inactive

Gulper

Yuntis

active

HenryTheMiragoRobot

Mirago

-

ia_archiver

Alexa

active

KIT-Fireball/2.0

Fireball (German SE at www.fireball.de)

-

LNSpiderguy

Lexis-Nexis

-

Lycos_Spider_(T-Rex)

Lycos

inactive

MantraAgent

LookSmart

active

MSN

Microsoft Prototype Crawler
Added 5.2003 by Dale Shad of
www.118group.com

active

NationalDirectory-SuperSpider

National Directory

-

Nazilla

Websmostlinked

-

Openbot

Openfind

-

Openfind piranha,Shark

Openfind

-

Scooter

AltaVista

active

Scrubby

Scrub The Web

active

Slurp.so/1.0
Slurp/2.0j
Slurp/2.0
Slurp/3.0

Inktomi

active

Tarantula

AltaVista

inactive

Teoma_agent1

Teoma

active

UK Searcher Spider

UKSearcher

-

WebCrawler

WebCrawler

-

Winona

WhatUSeek
Added 3.2003 by Dale Shad of
www.118group.com

active

ZyBorg

Wisenut

active

No comments: