Shekhar Iyer | Multi-Modal Retrieval Over Knowledge Graphs
KGC 2021
•
24m
Recent Advances in representation learning and application of Deep Neural Nets towards structured data and Knowledge Graphs (KG) is enabling opportunities for multi-modal representation of entities and relations. We can now aspire to build access to data encoded in knowledge Graphs through one of many modalities (image, audio, text or video) and also train joint representations to cross over from one modality to another (e.g. text-to-image, audio-to-text). These kinds of capabilities allow us to build applications that can use entity information in entirely new ways, to exploit the sensors available in modern multi-modal devices like glasses, watches, smart earphones etc... These contextually aware smart devices provide a better model for the users to interact with the world and consequently need a more robust support from a multi-model knowledge Graph to help them contextualize the users environment. In this presentation I will talk about a retrieval architecture to support a multi-modal KG. I will also show some examples of prototypes we have built to multi-modal retrieval.
Up Next in KGC 2021
-
Peter Rose | Integrating Heterogeneou...
The COVID-19 pandemic has mobilized researchers worldwide to investigate many aspects of the outbreak, ranging from case statistics, patient demographics, transportation modeling, epidemiological studies, to viral genome sequencing. Relevant data are produced and publically shared at an unprecede...
-
Xian Li | AutoKnow: Self-Driving Know...
Can one build a knowledge graph (KG) for all products in the world? Knowledge graphs have firmly established themselves as valuable sources of information for search and question answering, and it is natural to wonder if a KG can contain information about products
offered at online retail sites.... -
Amgad Madkour | Entity Life Cycle In ...
Entity-based results are becoming an integral part of the search experience. Search-centric companies highly rely on knowledge graphs in providing the necessary information for building rich search experiences. An entity can originate from a structured, semi-structured, or unstructured data sourc...
