 |
Crawlers |
 |
| ETagFix 1.00 |
 |
ETagFix is an ISAPI plugin for Internet Information Server (IIS) that changes the etag produced by IIS so that your etag does not change every time your computer reboots. This can result in web crawlers and user clients wanting to recache your web page when they don't need to.
Released: 2004-04-23
License: Free
Publisher: ISAPILabs
Language: English
Platform: Windows
Install: Install and Uninstall
|
 Good Product I downloaded etag fix for correction to my web servers e tags. So far based on my observations the product has done a great job.
| CoffeeCup Google SiteMapper 4.7 |
|
|
By placing a Sitemap-formatted file on your webserver, you enable the Google crawlers to find out what pages are present and which have recently changed, and to crawl your site accordingly. Using Sitemaps to inform and direct the Google crawlers, they hope to expand their coverage of the web and improve the time of inclusion in their index.
Released: 2008-06-03
License: $29.00
Publisher: CoffeeCup Software
Language: English
Platform: Vista, Windows, Mobile
Requirements: Pentium 133, 32MB RAM, 200mb hard drive, IE 4.0 or higher
Install: Install and Uninstall
|
| CoffeeCup Sitemapper 5.5 |
 |
By placing a Sitemap-formatted file on your webserver, you enable the search engine crawlers to find out what pages are present and which have recently changed, and to crawl your site accordingly. Using Sitemaps to inform and direct crawlers, they hope to expand their coverage of the web and improve the time of inclusion in their index. Sitemaps are an easy way for you to help improve your coverage in search engine indexes.
Released: 2011-08-13
License: $29.00
Publisher: CoffeeCup Software
Language: English
Platform: Vista, Windows
Requirements: Pentium 133, 32MB RAM, 200mb hard drive, IE 7.0 or higher
Install: Install and Uninstall
|
| Sothink DHTML Menu Suite 7.2 |
 |
Let your creation of JavaScript menus simple! The generated JavaScript menus can be compatible with most browsers. Template is provided to start menu without designing; image library is offered to use the image resource from the program. The search engine will find the menu apps contents and its link easily by Search Engine Friendly Code Maker. It integrates with Dreamweaver and FrontPage seamlessly; you can edit the menu in web editor directly!
Released: 2011-05-12
License: $99.00
Publisher: SourceTec Software
Language: English, French, German, Korean
Platform: Windows
Requirements: Intel Pentium 233Mh or above (P4 or K8 is recommended); 63Mb of RAM or above;
Install: Install and Uninstall
|
| Sothink Tree Menu builder 2.8 |
 |
It creates tree menu easily, with NO JS experience required. Its high compatibility supports most browsers, including Firefox 2.0 and Opera 9. It supports Windows Vista (SP1). It works well with Dreamweaver, Expression Web, FrontPage and Golive. It creates search-engine-friendly sitemaps and Site Navigation Structure Generator will generate menu based on your site. You can control expanding or collapsing the sub tree in web page.
Released: 2009-02-20
License: $59.95
Publisher: SourceTec Software
Language: English
Platform: Vista, Windows
Requirements: Intel Pentium 233Mh or above (P4 or K8 is recommended); 63Mb of RAM or above;
Install: Install and Uninstall
|
| Sitemap Writer Pro 5.0.0 |
 |
Sitemap Writer Pro is an easy- to -use program, fast and efficient which offers creation of sitemaps with millions of URLs and 6 different types of sitemaps (Standard Sitemap, Google News, Google Video, Google Code Search, Google Geo, Google Mobile) to properly index every website, generate an xml sitemap and upload it to all search engines that support XML sitemaps (Google, Yahoo, Ask.com, Bing (Live.com) and Moreover.com).
Released: 2010-05-24
License: $29.95
Publisher: Emergency Soft
Language: English, French, Russian, Spanish
Platform: Vista, Windows
Requirements: Microsoft .NET Framework 2.0
Install: Install and Uninstall
|
 Tried using app with a CRE shop cart but did not appear to work?
Does not work well and does not work with Zen Cart.
 why to pay??? Same thing like http://www.xml-sitemaps.com/ but it cost money..so...I'm not payng. sorry..
| ScrapePro Web Scraper 2.6.2.1867 |
 |
Extensible web scraper platform. - Easy configuration using tree control, drag&drop, context menus and wizards - Use custom actions, converters, filters, data sources and user interface plugins - .Net macros - Docking - Error handling - Built-in proxy to filter and modify web pages - API - Multiple crawler processes - Real time graphical crawler interface - Per-page configurable browser options - HTML Tidy - Constraints to ensure data validity
Released: 2011-09-08
License: $299.00
Publisher: ScrapePro.com
Language: English
Platform: Windows
Install: Install and Uninstall
|
| Files Crawler 1.5 |
|
|
Files Crawler is a file search application. It lets you search tons of files and download music, videos, images, documents and software.
Files Crawler is actually performing its search at Google. As Google allows us to search for more than just Web pages, due to its special indexing method of directory listing. Directory listing of Websites, is actually what allows Google to see all sort of files usually hidden from us.
Released: 2007-12-17
License: Free
Publisher: SpeedApps Inc
Language: English
Platform: Windows
Requirements: nothing special
Install: Install and Uninstall
|
| Advanced Robots.txt Generator 1.2 |
 |
Create your robots.txt files in seconds and maintain them easilly and effortlesly with the unique utility Advanced Robots.txt Generator. The software supports 300 robots, works in a WYSWIWYG visual way and comes with full documentation and unlimited customer support. It's features include automatic creation of Robots.txt files, automatic uploading, comparison with previously saved project, online/offline documentation, manual, free upgrades etc.
Released: 2007-06-14
License: $65.00
Publisher: BasiSoft Solutions
Language: English
Platform: Windows
Requirements: 2 Mb of Disk space
Install: Install and Uninstall
|
| Robot-Manager 3.1 |
 |
Manage and track visits by robots, spiders and crawlers to your website. Identify which spiders visited, when they visited, and what pages they indexed. Direct spiders to your most important pages, and exclude them from non-public pages. Maximizes effectiveness with search engines by avoiding over/under submitting. Excellent to improve search engine placements for users of automatic submission software such as WebPosition, TopDog, AddWeb, etc.
Released: 2002-11-27
License: $129.95
Publisher: Website Management Tools
Language: English
Platform: Windows
Requirements: Windows
Install: Install and Uninstall
|
|
Audio & Multimedia
