Ingesting Documents and RDF

Strangle, MarkLogic appears to have some best documentation of dealing with documents and RDF in a single data hub, even though the concept isn’t unique to MarkLogic.  As I’ve blogged about before, there are a number of other products, and its conceivable to build your own using various open source frameworks and libraries (Apache Jena etc)

The BBC News sample is probably the best I’ve found so far.

We started with each article as a single XHTML document. We then used OpenCalais to analyze the articles and find the entities (real-world things) within them. OpenCalais spotted entities like people, their roles, places (cities and countries) and organizations. On top of this it linked individuals with their role(s) and also determined the subject headings (categories) of the documents. For example, for one news article, OpenCalais generated triples for us that indicated the item was about war, identified the places mentioned in the article, and provided geo-location information for those places

The results can be seen in the downloadable zip, which provides a directory for the source (XHTML articles), and a directory wih the generated RDF file from OpenCalais.  The RDF file uses rdf:Description to reference to the original BBC URL of the article.  Both the XHTML and the RDF files are then ingested into MarkLogic – as expected.

Finally, “SPARQL and XQuery Together” shows how to leverage both content structures.

Interested in anyones experience of MarkLogic, as the documents hints at a cool product.


~ by mdavey on June 10, 2016.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: