Computer vision

  • Talked with Kyle McDonald
    • My project reminded him of anonymous hugging
    • Suggested testing different ways to max the performance, setting benchmark and see which part costs the most
  • Face detection
    • Use small canvas for executing face detection, display the image with big size of canvas.
    • From below test pics you can see, it’s much better to analyze with smaller canvas, but there’s no big difference between displaying big and small canvas, so for better resolution, it seems ok to display bigger canvas.






Greyscale + Blur

multiple faces detection, yet not stable due to changing lightness

  • Collect personal moment as taking photos –> accompany with you all the time to comfort you to confront unknown
  • Affecting virtual world


Wireless Wooo


Thanks to Andy‘s advice on hooking up localhost of my laptop through itpsandbox wifi, now I can run codes on mobile phone using laptop as server! (ps. It also works at home, just in NYU because of the security issue, using ITPSANDBOX is needed.)

*Note* It’s not advised to run server elsewhere (e.g. heroku, digitalOcean) because it takes more time to transfer the data back and forth. Localhost with laptop is the best option for proof of concept!


Paper Mache

–> Decide to do it after finalizing the virtual content.



A flying + walking, surreal experience design for rooftop. Work done with amazing John.

It’s all start from an assignment in the class Spatial Media, with specific requirement as below:

+ be site specific (i.e. be designed for an actual location)
+ be designed for use by more than one person
+ involve a horizontal surface


Because we wanted the experience to be strongly connected with space, we developed the idea starting from space. We chose rooftop because its exciting yet rusted characters, and we thought it has the potential to be a relaxing playground for citizens, especially for cities with limited space.


+ Utilize the height and windy characters directly from space
+ Cooperate with your teammates to maximize and exaggerate the excitement


SWINGS PRODUCTION(making miniature!)

+ woods
+ necklace chains & rings
+ thin hemp rope
+ webcam
+ monitor
+ white board


+ Openframeworks
+ videoGrabber
+ videoPlayer
+ color detection
+ image sequences
+ soundPlayer

Swing range test

Infinite Loop
This is one of the amazing beautiful mistake with the infinite loop between monitor showing what camera capturing and camera capturing monitor.


+ Team A & Team B
+ swing people*5 need to cooperate to swing as high as they can to shoot out the strong thunder, or either weak thunder or NO thunder will be shoot out(different thunder sound effects).
+ people in the center can block the thunders by stepping on them(scoring sound effect + spark sequence), so two team have to try to rope in the people in the center
+ once thunders reach the other side, strong thunder gets 2 scores, weak thunder gets 1 score.