Final project

V-BOOK ( voice book ) – “Little blue and little yellow”

These days, There are lot’s of E-book and audiobook, but I think there is not that much voice controlled book. Actually, I got inspired by the project that Pedro showed us before, the one that makes the sound effect for kid books. Based on that reference, I wanted to use the basic voice recognition technic to trigger the visual animation.



Target audience

My target audience will be mostly children and also parents and teachers who usually read books for kids. It can be used in school or also can be used at home. I thought it would be more convenient instead of clicking something or swiping the page.

Interaction Flow

If the user reads the sentence, a magical animation will be triggered.









After I tested with basic voice recognition, I want to add more magical and unexpected interaction between reader and the animation of the book.



final idea

I’m going to make a web-based simple memory game. (memory test).

There is a game in Korea named ” if I go to (somewhere).”

For example, someone says “If I go to the market, there is an apple” and then, next person has to repeat the word and add something like “If I go to the market, there is an apple and there is a cashier”. People will take turn and keep repeating and adding the words.

If someone messed up the order or don’t know what to say next, then the game is over.

I can say this game is a combination of listening and memorizing and saying correctly. I thought it would be fun If I remake this game as a web-based game using Speech to Text and Text to Speech.

The computer will never lose in this game… So this is more for fighting with yourself like a memory test.

And I’m not sure whether I will add visual by displaying the text on the page or just focus on voice interaction.

final idea


I tried to create a voice interface version of the Urban dictionary.

So If you say a word, it will show the description of the words.


I used p5.speech.js to recognize the speech and  I used Urban dictionary API to grab the descriptions.

Screen Shot 2018-02-07 at 2.04.48 PM

I tested with few words: Hello, what’s up, Amanda, curry, Good-bye.



Code: GitHub