DSpace Repository

An Interactive Image Editing System using an Uncertainty-based Confirmation Strategy

Show simple item record

dc.contributor.author shinagawa, seitaro en
dc.contributor.author yoshino, koichiro en
dc.contributor.author SEYED HOSSEIN, ALAVI en
dc.contributor.author KALLIRROI, GEORGILA en
dc.contributor.author DAVID, TRAUM en
dc.contributor.author SAKRIANI, SAKTI en
dc.contributor.author Nakamura, Satoshi en
dc.date.accessioned 2020-06-02T07:32:20Z en
dc.date.available 2020-06-02T07:32:20Z en
dc.date.issued 2020-03-25 en
dc.identifier.issn 2169-3536 en
dc.identifier.uri http://hdl.handle.net/10061/13987 en
dc.description.abstract We propose an interactive image editing system that has a confirmation dialogue strategy using an entropy-based uncertainty calculation on its generated images with Deep Convolutional Generative Adversarial Networks (DCGAN). DCGAN is an image generative model that learns an image manifold of a given dataset and enables continuous change of an image. Our proposed image editing system combines DCGAN with a natural language interface that accepts image editing requests in natural language. Although such a system is helpful for human users, it often faces uncertain requests to generate acceptable images. A promising approach to solve this problem is introducing a dialogue process that shows multiple candidates and confirms the user’s intention. However, confirming every editing request creates redundant dialogues. To achieve more efficient dialogues, we propose an entropy-based dialogue strategy that decides when the system should confirm, and enables effective image editing through a dialogue that reduces redundant confirmations. We conducted image editing dialogue experiments using an avatar face illustration dataset for editing by natural language requests. Through quantitative and qualitative analysis, our results show that our entropy-based confirmation strategy achieved an effective dialogue by generating images desired by users. ja
dc.language.iso en en
dc.publisher IEEE en
dc.relation.isreplacedby https://ieeexplore.ieee.org/document/9099288/authors#authors en
dc.rights Creative Commons Attribution 4.0 License. en
dc.subject Natural languages en
dc.subject Generators en
dc.subject Generative adversarial networks en
dc.subject Task analysis en
dc.subject Training en
dc.subject Hair en
dc.subject Image generation en
dc.title An Interactive Image Editing System using an Uncertainty-based Confirmation Strategy en
dc.type.nii Journal Article en
dc.contributor.transcription シナガワ, セイタロウ ja
dc.contributor.transcription ヨシノ, コウイチロウ ja
dc.contributor.transcription ナカムラ, サトシ ja
dc.contributor.alternative 品川, 政太朗 ja
dc.contributor.alternative 吉野, 幸一郎 ja
dc.contributor.alternative 中村, 哲 ja
dc.textversion none en
dc.identifier.jtitle IEEE Access en
dc.relation.doi 10.1109/ACCESS.2020.2997012 en
dc.identifier.NAIST-ID 84366442 en
dc.identifier.NAIST-ID 74651712 en
dc.identifier.NAIST-ID 73297715 en
dc.identifier.NAIST-ID 73296626 en

Files in this item

Files Size Format View

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record

Search DSpace

Advanced Search


My Account