Neda Abolhassani & Teresa Tung | Accelerating Industry Data Integration
KGC | The Complete Collection
•
19m
A data supply chain is industry-specific, but many data prep tools are industry agnostic. As part doing this work, data engineers and domain experts apply their deep knowledge of how to transform raw data to a form that can address specific problems. In this way, the data supply chain is a domain like so many others to which AI is applied. It involves making decisions repeatedly informed by past experience.
Our work aims to leverage our own experience, to capture and apply industry and domain experience to accelerate industry data integration. To tackle this problem we’re taking an approach that layers a Knowledge Graph on top of the Data Mesh to capture domain knowledge and to connect the different data domains.
Like many others, we’re excited about Zhamak Dehghani’s new Data Mesh architecture paradigm. It’s distributed architecture follows many of the data integration strategies from the web, and includes mature rules around data products, quality, and governance.
This talk illustrates how some machine learning techniques can help in data profiling and mapping of siloed data sources for Enterprise Knowledge Graph construction. We present how this Knowledge Graph can be employed in a Data Mesh architecture for accelerating industry data integration for an Oil and Gas use case.
Up Next in KGC | The Complete Collection
-
Olaf Hartig | RDF Star: Metadata For ...
The lack of a convenient way to capture annotations and statements about individual RDF triples has been a long standing issue for RDF. Such annotations are a native feature in other contemporary graph data models (e.g., edge properties in the Property Graph model). In recent years, the RDF* app...
-
Paco Nathan | Graph Based Data Science
Python offers excellent libraries for working with graphs: semantic technologies, graph queries, interactive visualizations, graph algorithms, probabilistic graph inference, as well as embedding and other integrations with deep learning. However, most of these approaches share little common groun...
-
Paolo Manghi | The OpenAIRE Research ...
The presentation will introduce the motivations, architecture, and operation of the OpenAIRE Research Graph (http://graph.openaire.eu), one of the largest (if not the largest) public, open access, collections of metadata and semantic links (~1Bi) between research-related entities: articles (124M+...
