RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipes

机译：复仇之乐：用于烹饪食谱的多式联理理解的挑战数据集

获取原文

页面导航

摘要
著录项
相似文献
相关主题

摘要

Understanding and reasoning about cooking recipes is a fruitful research direction towards enabling machines to interpret procedural text. In this work, we introduce RecipeQA. a dataset for multimodal comprehension of cooking recipes. It comprises of approximately 20K instructional recipes with multiple modalities such as titles, descriptions and aligned set of images. With over 36K automatically generated question-answer pairs, we design a set of comprehension and reasoning tasks that require joint understanding of images and text, capturing the temporal flow of events and making sense of procedural knowledge. Our preliminary results indicate that RecipeQA will serve as a challenging test bed and an ideal benchmark for evaluating machine comprehension systems.

机译：关于烹饪食谱的理解和推理是朝向使机器解释程序文本的富有成果的研究方向。在这项工作中，我们介绍了复仇了。用于烹饪食谱的多式化理解的数据集。它包括大约20k的教学配方，其中具有多种模式，例如标题，描述和对准的图像集。通过超过36K自动生成的问题答案对，我们设计了一套理解和推理任务，需要共同了解图像和文本，捕获事件的时间流动并掌握程序知识。我们的初步结果表明，复仇会将作为挑战性试验台和用于评估机器理解系统的理想基准。

著录项

来源
《Conference on empirical methods in natural language processing》|2018年|cxvi p. 725-1444|共11页
会议地点
作者
Semih Yagcioglu; Aykut Erdem; Erkut Erdem; Nazli Ikizler-Cinbis;
展开▼
作者单位

展开▼
会议组织
原文格式 PDF
正文语种
中图分类程序设计、软件工程;
关键词

相似文献

外文文献
中文文献
专利

1. Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images [J] . Marin Javier, Biswas Aritro, Ofli Ferda, IEEE Transactions on Pattern Analysis and Machine Intelligence . 2021,第1期

机译：Refipe1M +：用于学习跨莫代尔嵌入式烹饪食谱和食物图像的数据集
2. Using the MGB-2 challenge data for creating a new multimodal Dataset for speaker role recognition in Arabic TV Broadcasts [J] . Mohamed Lazhar Bellagha, Mounir Zrigui Procedia Computer Science . 2021,第a期

机译：使用MGB-2挑战数据，用于在阿拉伯语电视广播中创建新的多模式数据集进行扬声器角色识别
3. Creating a Multitrack Classical Music Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applications [J] . Li Bochen, Liu Xinzhao, Dinesh Karthik, IEEE transactions on multimedia . 2019,第2期

机译：创建用于多模式音乐分析的多轨古典音乐演奏数据集：挑战，见解和应用
4. RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipes [C] . Semih Yagcioglu, Aykut Erdem, Erkut Erdem, Conference on empirical methods in natural language processing . 2018

机译：RecipeQA：烹饪食谱多模态理解的挑战数据集
5. Now We're Cooking with Auxin: Using Synthetic and Genomic Tools to Probe the Root Recipe [D] . Lanctot, Amy P. 2021

机译：现在我们正在用助枝素烹饪：使用合成和基因组工具探测根食谱
6. The Automatic Detection of Chronic Pain-Related Expression: Requirements Challenges and the Multimodal EmoPain Dataset [O] . Min S. H. Aung, Sebastian Kaltwang, Bernardino Romera-Paredes, -1

机译：慢性疼痛相关表达的自动检测：需求挑战和多模式EmoPain数据集
7. RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipes [O] . Semih Yagcioglu, Aykut Erdem, Erkut Erdem, 2018

机译：复仇之乐：用于烹饪食谱的多式联理理解的挑战数据集
8. Choose Your Title: Kosher Minced Fish Cooking, Fish Cooking with a Food Processor, International Fish Recipes [R] . Regenstein, J. M. , Regenstein, C. E. 1981

机译：选择你的标题：犹太剁碎的鱼烹饪，用食物处理器烹饪鱼，国际鱼食谱

RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipes

摘要

著录项

相似文献

相关主题

期刊订阅