Free crawler downloads

The Zoom Search Engine is a free package that allows web developers to add an industrial-strength custom search to their website in a matter of minutes. It is an extremely easy-to-use application that requires no complicated server-side set-up procedures. It can also be used to create search engines for intranets, CDs and DVDs as well.

Zoom is capable of serving up to 300 queries a minute and it can index and search 1000’s of web site domains in a single index. Developers who choose to upgrade to the Enterprise Edition will be able to index up to 1 million pages.

Features include: wildcard and exact phrase searching; “Google-like” context search results; Highlighted found words; spelling & synonym suggestions; exclusion/negative searches; display images/thumbnails in search results; prioritize recommended links for keywords/phrases; A9 and OpenSearch compatible XML/RSS output (CGI only); Sitemap generation (Yahoo™ and Google™ compatible); international language support; statistical graphs & reports.

Zoom allows searches into DOC, PDF, PPT, XLS, RTF and WPD files and is capable of indexing SWF and FlashPaper files. In addition, Zoom now supports indexing/searching of the meta-data in MP3 and various image file formats. See the Zoom website for a complete list of supported file formats.

The Zoom Search Engine will index files in either spider or offline mode. Indexing options include incremental index, simultaneous broken link detection, content filtering, flexible scanning and skipping options.

Zoom is available in Free (max. 50 pages), Standard $US49 (max. 100 pages), Professional $US99 (max. 200,000 pages) and Enterprise $US299 (max. 1 million pages) Editions. It supports PHP, ASP, Javascript and CGI platforms and can also create .NET search pages.
Tags: website, search, engine, php, asp, javascript, indexer, dvd, google, context, wildcard, spider, offline, crawler, indexing, metadata, …

Automatically search web sites for emails. Simply provide a starting web site or starting keywords and let emailgrabber do the rest. Emailgrabber will crawl the web site and collect all email addresses it finds. It will also follow every link. Specify the web sites you want to visit to allow emailgrabber to stay on top of your goal or block web sites you don't want it to visit. Merge email addresses from multiple source files, removing duplicates. Export email addresses gathered using the most suitable delimiter. Save your search session so you can resume it later. Free Lifetime Updates - when you buy emailgrabber you not only get the latest version, but every update we release, whether it is an update for the version you own or a future version.
Tags: email, grabber, crawl, crawler, spider, search, collect, collector, web, engine, bot, robots, robot, email web crawler, email search engine, email search, spider crawl, spider robots, spider bot, …

With this program you can download all the movie clips from a webserver automatically (with or without sublinks). It's very easy to use and gives you amazing results within seconds. This download manager for movies searches all your favorit web links, spiders, parses, grabs, extracts and crawls all the movies you would have downloaded by hand.
Tags: movie, clip, search, download, spider, crawl, grabber, crawler, parser, manager, download manager, …

Create an accurate XML sitemap in seconds! Just enter your URL and go. Inspyder Sitemap Creator will crawl your site and generate an XML sitemap that's ready for submission to all the major search engines.

Sitemap Creator's powerful 'Site Sections' allows you to quickly and easily organize your pages by priority and update frequency. Don't tediously configure each URL, use Site Sections to match groups of URLs at once.

After creating your sitemap, Inspyder Sitemap Creator can upload it to your website and notify (or ping) the search engines. Inspyder Sitemap Creator can be scheduled to run automatically so that your sitemap is always accurate, even if your site changes frequently.

Download a free trial today!
Tags: sitemap, create, generator, generate, creator, crawler, sitemapper, google, sitemaps, yahoo, xml, create sitemap, sitemap generator, generate sitemap, sitemap creator, sitemap crawler, google sitemaps, yahoo sitemaps, xml sitemap, …

RSScrawler displays your favorite RSS news feeds as a flicker-free ticker bar on your Windows Desktop. RSScrawler keeps you always informed in the same way as those ticker bars known from various TV stations. Never miss any breaking news!
Tags: rss, rdf, atom, news, feeds, feed, desktop, ticker, newsticker, tickerbar, infos, crawler, newscrawler, pipeline, corporate, enterprise, news ticker, corporate news ticker, enterprise rss, …

Collect and compile e-mails, phone and fax numbers from the websites around the world using the keywords you enter for. The program will spider, grab, crawl, rip, harvest, extract and parse for the e-mails and can also automatically send them out.
Tags: collect, email, serialmails, mail, marketing, emarketing, crawl, crawler, extract, finder, grab, grabber, parser, collect email, e-mail-marketing, e-marketing, e-mail marketing, email crawl, email crawler, email marketing, email-marketing, email extract, email finder, email grab, email grabber, email parser, …