Bengali Visual Genome 1.0
In: https://ufal.mff.cuni.cz/bengali-visual-genome, 2022
Online
unknown
Zugriff:
Data --- Bengali Visual Genome (BVG for short) 1.0 has similar goals as Hindi Visual Genome (HVG) 1.1: to support the Bengali language. Bengali Visual Genome 1.0 is the multi-modal dataset in Bengali for machine translation and image captioning. Bengali Visual Genome is a multimodal dataset consisting of text and images suitable for English-to-Bengali multimodal machine translation tasks and multimodal research. We follow the same selection of short English segments (captions) and the associated images from Visual Genome as HGV 1.1 has. For BVG, we manually translated these captions from English to Bengali taking the associated images into account. The manual translation is performed by the native Bengali speakers without referring to any machine translation system. The training set contains 29K segments. Further 1K and 1.6K segments are provided in development and test sets, respectively, which follow the same (random) sampling from the original Hindi Visual Genome. A third test set is called the ``challenge test set'' and consists of 1.4K segments. The challenge test set was created for the WAT2019 multi-modal task by searching for (particularly) ambiguous English words based on the embedding similarity and manually selecting those where the image helps to resolve the ambiguity. The surrounding words in the sentence however also often include sufficient cues to identify the correct meaning of the ambiguous word. Dataset Formats --- The multimodal dataset contains both text and images. The text parts of the dataset (train and test sets) are in simple tab-delimited plain text files. All the text files have seven columns as follows: Column1 - image_id Column2 - X Column3 - Y Column4 - Width Column5 - Height Column6 - English Text Column7 - Bengali Text The image part contains the full images with the corresponding image_id as the file name. The X, Y, Width and Height columns indicate the rectangular region in the image described by the caption. Data Statistics --- The statistics of the current release are given ...
Titel: |
Bengali Visual Genome 1.0
|
---|---|
Autor/in / Beteiligte Person: | Sen, Arghyadeep ; Parida, Shantipriya ; Kotwal, Ketan ; Panda, Subhadarshi ; Bojar, Ondřej ; Dash, Satya Ranjan |
Link: | |
Zeitschrift: | https://ufal.mff.cuni.cz/bengali-visual-genome, 2022 |
Veröffentlichung: | Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL), 2022 |
Medientyp: | unknown |
Schlagwort: |
|
Sonstiges: |
|