Shekhar Iyer | Multi-Modal Retrieval Over Knowledge Graphs
KGC | The Complete Collection
•
24m
Recent Advances in representation learning and application of Deep Neural Nets towards structured data and Knowledge Graphs (KG) is enabling opportunities for multi-modal representation of entities and relations. We can now aspire to build access to data encoded in knowledge Graphs through one of many modalities (image, audio, text or video) and also train joint representations to cross over from one modality to another (e.g. text-to-image, audio-to-text). These kinds of capabilities allow us to build applications that can use entity information in entirely new ways, to exploit the sensors available in modern multi-modal devices like glasses, watches, smart earphones etc... These contextually aware smart devices provide a better model for the users to interact with the world and consequently need a more robust support from a multi-model knowledge Graph to help them contextualize the users environment. In this presentation I will talk about a retrieval architecture to support a multi-modal KG. I will also show some examples of prototypes we have built to multi-modal retrieval.
Up Next in KGC | The Complete Collection
-
Stefan Plantikow | The Upcoming GQL S...
Following the GQL Manifesto, the ISO working group that develops the SQL standard voted to initiate a project for a new database language: GQL (Graph Query Language). This talk presents an overview of the goals of GQL and the progress so far, key aspects of the language design such as the basic d...
-
Steven Gustafson | Connecting The Dot...
Knowledge graphs provide a way for us to capture and relate information into a representation that can mimic expert knowledge. One type of expert knowledge that has proven to be particularly useful in industry is reasoning by analogy, or using a replacement problem and solution pair to think abo...
-
Trey Botard | Bringing Time & Truth T...
Semantic systems provide tremendous opportunities to interoperate our data, facilitate shared vocabularies, and power enterprise knowledge graphs, but these increasingly distributed data ecosystems also introduce new instabilities and concerns. What happens when data we rely on is changing in une...
