"Seeing Red" Or "Tickled Pink"? Investigating the Power of Language and Vision Models Through Color, Emotion, and Metaphor

Author :
Publisher :
Total Pages : 0
Release :
ISBN-10 : OCLC:1398440779
ISBN-13 :
Rating : 4/5 ( Downloads)

Book Synopsis "Seeing Red" Or "Tickled Pink"? Investigating the Power of Language and Vision Models Through Color, Emotion, and Metaphor by : Olivia Winn

Download or read book "Seeing Red" Or "Tickled Pink"? Investigating the Power of Language and Vision Models Through Color, Emotion, and Metaphor written by Olivia Winn and published by . This book was released on 2023 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: We use this model to examine the relationship between color and emotion devoid of confounding factors. Finally, we turn to figurative language as a resource, examining the pragmatics of visualizing metaphoric phrases. We demonstrate a novel approach to generating visual metaphor through the collaboration of large language models and diffusion-based text-to-image models, and in doing so create a novel dataset of visual metaphor with both literal and figurative captions. We then develop an evaluation framework using human-AI collaboration to examine the efficacy of the model collaboration, and choose a downstream task of visual entailment to evaluate the human-AI collaboration.


"Seeing Red" Or "Tickled Pink"? Investigating the Power of Language and Vision Models Through Color, Emotion, and Metaphor Related Books