Free crawler downloads

The Zoom Search Engine is a free package that allows web developers to add an industrial-strength custom search to their website in a matter of minutes. It is an extremely easy-to-use application that requires no complicated server-side set-up procedures. It can also be used to create search engines for intranets, CDs and DVDs as well.

Zoom is capable of serving up to 300 queries a minute and it can index and search 1000’s of web site domains in a single index. Developers who choose to upgrade to the Enterprise Edition will be able to index up to 1 million pages.

Features include: wildcard and exact phrase searching; “Google-like” context search results; Highlighted found words; spelling & synonym suggestions; exclusion/negative searches; display images/thumbnails in search results; prioritize recommended links for keywords/phrases; A9 and OpenSearch compatible XML/RSS output (CGI only); Sitemap generation (Yahoo™ and Google™ compatible); international language support; statistical graphs & reports.

Zoom allows searches into DOC, PDF, PPT, XLS, RTF and WPD files and is capable of indexing SWF and FlashPaper files. In addition, Zoom now supports indexing/searching of the meta-data in MP3 and various image file formats. See the Zoom website for a complete list of supported file formats.

The Zoom Search Engine will index files in either spider or offline mode. Indexing options include incremental index, simultaneous broken link detection, content filtering, flexible scanning and skipping options.

Zoom is available in Free (max. 50 pages), Standard $US49 (max. 100 pages), Professional $US99 (max. 200,000 pages) and Enterprise $US299 (max. 1 million pages) Editions. It supports PHP, ASP, Javascript and CGI platforms and can also create .NET search pages.
Tags: website, search, engine, php, asp, javascript, indexer, dvd, google, context, wildcard, spider, offline, crawler, indexing, metadata, …

An efficient search engine is vital if the full potential of your medium sized corporate network is to be realized. Ideally, you or your users should be able to find that important document or file almost instantly. We offer a low cost high-performance solution. Our software product is a self-contained index-based network search engine that indexes all shared files in your local area network and provides users with the ability to locate necessary files within a few seconds. It returns blazingly fast search results to your users, even when large numbers of shared files and folders are present.

The built-in web-server and database ensure trouble free deployment and configuration while the web-based user interface enables users to enter intuitive search queries on all file types using a simple wild-card based format and via their favorite web browser. Our search engine will be delivering enhanced performance direct to users within minutes of deployment and with little or no training required.

Of course, raw search speed is not the only performance criteria. The GUI based administration console provides access to a variety of powerful features and configurable options that make it flexible enough to fulfil most needs. For example, files or folders can be selectively included or excluded from the database index while the index itself can be maintained using an incremental multi-threaded crawl mode that demands only minimal network resources. Once initial indexing is complete, Network Search Engine will not introduce unnecessary network traffic.

Do you already have a web server, such as IIS, installed? That's fine. The SoftPerfect Network Search Engine will make use of third party ISAPI & CGI compliant servers with minimum configuration issues. In most cases, configuration simply consists of copying over a group of supplied files to your web server folder.
Tags: network, search, server, find, locate, files, crawler, engine, windows, smb, folders, indexer, lan, search engine, …

Automatically search web sites for emails. Simply provide a starting web site or starting keywords and let emailgrabber do the rest. Emailgrabber will crawl the web site and collect all email addresses it finds. It will also follow every link. Specify the web sites you want to visit to allow emailgrabber to stay on top of your goal or block web sites you don't want it to visit. Merge email addresses from multiple source files, removing duplicates. Export email addresses gathered using the most suitable delimiter. Save your search session so you can resume it later. Free Lifetime Updates - when you buy emailgrabber you not only get the latest version, but every update we release, whether it is an update for the version you own or a future version.
Tags: email, grabber, crawl, crawler, spider, search, collect, collector, web, engine, bot, robots, robot, email web crawler, email search engine, email search, spider crawl, spider robots, spider bot, …

With this program you can download all the movie clips from a webserver automatically (with or without sublinks). It's very easy to use and gives you amazing results within seconds. This download manager for movies searches all your favorit web links, spiders, parses, grabs, extracts and crawls all the movies you would have downloaded by hand.
Tags: movie, clip, search, download, spider, crawl, grabber, crawler, parser, manager, download manager, …

Create an XML sitemap or an HTML sitemap for your website the quick and easy way. Just enter your URL and go! Upload directly from Inspyder Sitemap Creator and ping the search engines too!
Tags: sitemap, create, generator, generate, creator, crawler, sitemapper, google, sitemaps, yahoo, xml, create sitemap, sitemap generator, generate sitemap, sitemap creator, sitemap crawler, google sitemaps, yahoo sitemaps, xml sitemap, …

RSScrawler displays your favorite RSS news feeds as a flicker-free ticker bar on your Windows Desktop. RSScrawler keeps you always informed in the same way as those ticker bars known from various TV stations. Never miss any breaking news!
Tags: rss, rdf, atom, news, feeds, feed, desktop, ticker, newsticker, tickerbar, infos, crawler, newscrawler, pipeline, corporate, enterprise, news ticker, corporate news ticker, enterprise rss, …

Collect and compile e-mails, phone and fax numbers from the websites around the world using the keywords you enter for. The program will spider, grab, crawl, rip, harvest, extract and parse for the e-mails and can also automatically send them out.
Tags: collect, email, serialmails, mail, marketing, emarketing, crawl, crawler, extract, finder, grab, grabber, parser, collect email, e-mail-marketing, e-marketing, e-mail marketing, email crawl, email crawler, email marketing, email-marketing, email extract, email finder, email grab, email grabber, email parser, …