Linked Data Manager

The Linked (Open) Data Manager is available in a 1st alpha version by early 2012 developed by the Semantic Web Company in the course of the LOD2 FP7 project. It is a Java based Linked (Open) Data Management Suite to schedule and monitor required ETL: Extract - Transform - Load jobs for smooth and efficient Linked (Open) Data Management for web-based Linked Open Data portals (LOD platforms) as well as for sustainable Data Management and Data Integration usage inside of the enterprise / the organisation.

The basic idea of the SWC Linked (Open) Data Manager is to provide a tool for data workers in organisations to easily manage the normalisation of information and data from several internal and / or external data sources in a central data & knowledge store to handle the following topics:

  • Continuous updating mechanisms from several data sources into the centralised Linked Data Manager
  • Caching mechanisms for external (mostly Open Data) sources into the Linked Data Manager to ensure permanent availability of all data & information for further re-use
  • User friendly monitoring and alert mechanisms to ensure transparency of all relevant data management jobs
  • Easy to use scheduling mechanisms for all data sources and all data relevant tasks in extraction - transformation - loading (ETL)

Furthermore the SWC Linked Data Manager provides the following features:

  • Flexible plugin system to develop required ETL modules for Linked Data Management for several data soruces and formats (APIs, XLM, CSV, RDF beside many others)
  • Comprehensive and constantly growing plugin library for further re-use and modification
  • Stable and performant technologies based on the Vaadin Java Framwork
  • Mechanisms for data extraction, data cleaning, data linking and data normalisation using RDF (Resource Description Framework)

The Linked Data Manager was partly financed by the FP7 project LOD2 as well as by a REEEP project for reegle.info - and is already in use at the reegle.info Clean Energy Information Portal.

The SWC Linked (Open) Data Manager will be published very soon in the first release version in late 2012!