Haiku Generator from Photo

by Summer and Evelyn Hasama

Link to Google Colab

Final Presentation Slides:

Link to Presentation

Abstract

Generate a haiku (a Japanese 5-7-5 syllable poem often relating to nature) using deep learning. To make things a bit more interesting, take a photo as input and use an existing object detection model to determine keywords. We would then put these keywords in our haiku text generating model based on GPT2. Evaluate the generated haikus using BERTScore.

How to run the code

1. Open the Google Colab
2. Run all cells

Background

Previous solutions:

• Generating Haiku with Deep Learning (Part 1)
• Deep Haiku: Teaching GPT-J to Compose with Syllable Patterns
• Generating and Evaluating Japanese Haiku Poems with Deep Language Models

Databases:

• Haiku Dataset - bfbarry
• Haiku Dataset - hjhalani30