Dewdrop

Funded by Jisc. Developed by HRI Digital at the University of Sheffield

Version 0.5 Available

Version 1.0 will be available shortly, including access to the open source code on Github.

Download version 0.5 (14th August 2017): dewdrop-v0.5.zip

The zip file is approximately 786 MB in size. It contains the Dewdrop program and all user documentation.

Read the Quick Start Guide

You can view the full documentation for Dewdrop here

Help! You can contact Michael Pidd at m.pidd@sheffield.ac.uk

Introducing Dewdrop and Discovery-Friendly Records

  1. Dewdrop is a software program designed to create discovery-friendly records of your website. It is a web crawler combined with a text analyser.
  2. Dewdrop is designed to make your website content more easily accessible to search engines and third-party content aggregators by creating versions of your content (discovery-friendly records) that these services understand. You can also use Dewdrop to acquire content from third-party websites for your own data mining and other research purposes.
  3. Dewdrop is particularly suitable for poorly designed websites that cannot be easily discovered or indexed by search engines and third-party content aggregators.
  4. Dewdrop's discovery-friendly records do not make your existing website content invalid. The records act as signposts, directing search engines and content aggregators to your website.
  5. Dewdrop requires minimal technical know-how.
  6. Dewdrop will crawl your website (HTML pages, PDF documents, Word documents and database content), analyse the textual content of your website and then create new, discovery-friendly records.
  7. Discovery-friendly records are a version of your website content that is presented in HTML RDFa, RDF or JSON-LD formats, depending on your preference. We recommend HTML RDFa for beginners.
  8. When Dewdrop has finished you can ask your server administrator to save these records to the root directory of your website. They will site alongside your existing website content.
  9. There are only two screens for the user interface. You can see what the screens look like here: Screen#1: Crawler and here: Screen #2: Analyser
  10. Read the Quick Start Guide.

Minimum System Requirements

  1. 8GB RAM, i5 processor.
  2. A hard drive of at least 397MB (Dewdrop's program size). However, your hard drive also needs enough space to accommodate the data being retrieved and processed by Dewdrop; which is dependent on the size of the website being crawled. At least 1GB is recommended.
  3. Dewdrop requires Java to be installed on your computer. You can download the latest version from here: https://java.com/en/download.
  4. Dewdrop will work on any operating system that has Java installed.
  5. For information, the following system features will impact on the overall speed of Dewdrop:
    1. The read/write speed of your hard drive.
    2. The size and read/write speed of your RAM (memory).
    3. The speed of your internet connection.
    4. The speed of your computer's processor and the number of cores.

You can view the full documentation for Dewdrop here