week2-STT

I tried to create a voice interface version of the Urban dictionary.

So If you say a word, it will show the description of the words.

 

I used p5.speech.js to recognize the speech and  I used Urban dictionary API to grab the descriptions.

Screen Shot 2018-02-07 at 2.04.48 PM

I tested with few words: Hello, what’s up, Amanda, curry, Good-bye.

 

 

Code: GitHub

week2-STT

week1

1.This my favorite fashion brand’s website. I changed the price which I can never afford.

Screen Shot 2018-01-22 at 8.59.30 PM

 

I tried to think about things that will make me annoying.

2. This is my Instagram. I only switched the “Cancel” and “Log out” context.

I will try to press Log Out button to log out but I will never get logged out on my Instagram.

Screen Shot 2018-01-27 at 7.36.56 PM

3.  In Amazon website, I replaced the product images to loading icon gif which will never stop.

Screen Shot 2018-01-27 at 8.36.56 PM

 

week1

Urban Interaction idea

Idea #1

What?       Augmented Music player

  • Different style ( genre ) of music plays in a different space automatically based on GPS.
  • augmenting sounds.

For example, If you are in the gallery, classical music will be played and If you are in the park, jazz music will be played.

Or maybe add a function that people can customize their music zone??

Why?       I love music and people love music.

Instead of listening to their own music playlist, people can listen to same music at the same time and share the same experience in the same space.

 

 

Urban Interaction idea

#2 Weather+Time Clock

I tried to make an Interactive clock that you can check time & weather controlling with your hand gesture. ( using Leap Motion )

First, I created simple sketches with Processing using ‘Temboo’ weather library to bring the weather data.

Then, I projected & mapped these sketches to a round shape canvas using Madmapper.

For the user interaction, I choose to use hand gestures.

So for now, If you swipe your hand above the sensor, it will show you other city’s weather.

 

I didn’t put an interaction for the clock yet, but I will add more interactions soon for other functions!

 


PROTOTYPE – HOW IT WORKS 


 PROCESS – MadMapper

 


SKETCHES – PROCESSING ( Temboo weather data  & current time )

 


1

FullSizeRender 7

2

53 4

 

#2 Weather+Time Clock

Final Project- Swell Beats

 

Swell Beats- Amanda Lee & Jeff Park

For our final project, we wanted to make a multiplayer VR music experience that lets user “ surf ” the MIDI wave.

 


Inspiration

http://www.georgeandjonathan.com/#2

GeorgeandJonathan.com is an NYC electro duo’s band page. On this page, they have these “music videos” that show you all the notes used in their songs. Using Three.js, they let you navigate these notes from a traditional bird’s eye view.
Screen Shot 2017-05-06 at 2.24.44 PM
Screen Shot 2017-05-06 at 2.24.54 PM Screen Shot 2017-05-06 at 2.25.04 PM



http://dinahmoelabs.com/_plink/

Screen Shot 2017-05-06 at 2.32.13 PM

 


Idea Sketches

Screen Shot 2017-05-06 at 2.43.18 PM Screen Shot 2017-05-06 at 2.43.24 PM

 

 

 

 

 

 

 

 

 

 


Tech used

  • Three.js
  • Cordova
  • p5&Tone.js

Demo

For now, We made a simple environment that makes sound (notes) when users pressed arrow key (left&right). And Whenever user presses the key and makes a sound, it creates a box behind the user like a tail.

And we connect with WebVR, so user can explore the space dynamically.

Screen Shot 2017-05-06 at 2.52.44 PMScreen Shot 2017-05-06 at 2.55.28 PMScreen Shot 2017-05-06 at 2.55.20 PMScreen Shot 2017-05-06 at 2.55.12 PM

 

And we are still working on this project !


What comes next?

  • Technical Challenges
  • Supporting socket.io with a-frame
  • How to ensure a good framerate with other people making shapes?
  • Connect the Daydream Controller
  • Visual polish

 

  • The Music
  • Map pitch bend OR volume to a viewer’s z-position (up/down)
  • How to implement rests? (perhaps a jump?)
  • Quantize to the beat
  • Add different instruments

 


What did we learn?

  • WebVR with Three.js! A-frame is nice, but it doesn’t get us as far as three.js
  • We have a lot more design-wise to think through to refine the experience.
  • Tone.js vs p5.sound
Final Project- Swell Beats

week1

 


Make a “thing” that communicates what you are interested in exploring in this class.

 

I love taking photos and recording videos in my everyday lives. Especially I prefer to take video. Because I can capture a real movement, real situation and real sound ( voice, music, noise ) and I can remind that moment more vividly.

I usually get captivated by people’s  gestures or face expression. Because It’s funny that we can see through people’s feeling by their gestures, face expression.

This video is what I observed in a cafe named ‘Brooks brothers Red fleece cafe’.

 

week1

3D printing

I had some problem with the previous idea, so I decided to make a Halloween pumpkin using light.

Sketch

img_6034 img_6033

Processscreen-shot-2016-10-15-at-10-50-41-am screen-shot-2016-10-18-at-11-24-16-am screen-shot-2016-10-18-at-11-22-14-am screen-shot-2016-10-18-at-11-22-46-am screen-shot-2016-10-18-at-11-21-26-am


-3D printing
img_5903

img_5921


-Removing the support material

img_5926img_5929


– I made a small stem (top) of the pumpkin that you can take it off.

img_6047img_6048


-Sandingimg_5950

img_6007


– I used the primer spray and sand it again to make a texture.
img_6042img_6039


I used the phone flash light to make the pumpkin glow.

img_4548

3D printing