Category Archives: ITP – Tisch – NYU

Expanding Interactive Video Final

Going to continue with my Eye Tracking idea… here are some pictures of the device I have built…

Eye Tracking

Need to change/enhance the application:

  1. Improve eye tracking code
    1. Edge detection on pupil
    2. Calculate relative position of cornea reflection and pupil
    3. Calibration procedure
  2. Instead of pulling pictures from Flickr, use “local” pictures
    1. Select the pictures in a “meaningful” way – by color, theme or emotion?
  3. Show the “winner” after each slide
  4. Log what pictures are winners
  5. Create a web page with results

Still working on the “purpose” of this project other than the rating tool… want to try to draw some kind of conclusion from the “experiment”.

Some other ideas that are swirling in my head:

  1. Blur areas of picture/video eyes are not looking at
    1. User using the eye tracking device would see it all in focus
    2. “Audience” would see the in-focus and out of focus areas
  2. Present an out of focus video/picture. Wherever user looks at more, it start to come into focus

Ubiquitous Computing for Mobile Devices Final Project

After having two fellow ITPers come up to me asking me if I was a professor I started thinking about the first impressions we have of people and how we perceive ourselves in one way and other people see us in another way. Or sometimes you are simply not aware of the image you are presenting to the world.

It would be interesting to find out how other people see me… both people who know me/interact with me and people who just see me walking by.

Based on that I teamed up with Caleb and Joo-Youn to create a mobile app to explore this fact.

After some brainstorming, we came up with a game/social network/informative site. Here it how it might work:

  1. First we pre-populate the database with all of ITP student’s names and pictures
  2. We then send out a picture of someone to your phone
  3. You then have to find that person and take a picture with them
    1. You can “pass” that person by replying with the word “NEXT”
  4. Upload the picture to our system to get points
  5. Get extra points by tagging the person with a one word adjective
  6. Get the following picture
  7. The more points you have, the more often your picture will be sent
  8. On the web you will see the adjectives people have been described
  9. You can send us the phone number of a friend to invite them to the game
    1. They will receive a message asking for their name and picture
  10. You can see what people have said about you by sending the word “TAGS”
  11. If you tag someone with the same adjective they tagged you, you are a match and both get a message

Nature of Code Final Idea


For my final I decided to continue my “Male Female” code by adding food, reproduction, and genetic algorithms. Here are some of the basic rules I am imagining:

  1. Male and Females are attracted to each other
    1. Sex drive makes them seek more
    2. Charm makes them be more successful in pairing up
  2. They eat
    1. The more they eat the slower they get
    2. If they don’t eat enough, they don’t make it to the mating area
  3. They can only mate in certain areas (migration)
    1. They only go to the migration areas when they are paired up
    2. Going to mating areas requires energy and makes them hungry
    3. If they get too hungry they give up on mating
  4. They need food to have enough energy to get the mating areas
    1. Some animals can hold more food than others
  5. Once they mate, they die
  6. Kids inherit the properties of the parents with a bit of mutation

Properties or DNA:

  1. Appetite vs. Sex drive
  2. Stomach size vs. Charm

Jonathan Harris

Today we had the privilege of having Jonathan Harris talk to us during Nature of Code class.

He is a Computer Scientist/Artist who has done some amazing work mainly focused on data aggregation and visualization.

These were my favorite two:

Universe – an interface that looks at news on the internet
We Feel Fine – an aggregator of blog entries that talk about how the blogger feels

In the light of that, I am going to use this blog entry to test his software…

I feel amazed and in awe of the human creativity, where we think everything has been invented and then someone shows up with a brand new way of looking at the world.

Let’s see if We Feel Fine catches this entry 🙂

Garden


This code is based on Dan Shiffman’s recursive tree example… modified it a little to have different trees in terms of branch timing and branching angles…
Click to create new trees.

Video Performance

Self Conscious
Expanding Interactive Video – midterm

– Sitting with back to the audience, head down, eyes closed
– Eye Tracking gear on (one camera on my eye and one facing forward)
– Laptop in hand
– Ask everyone to turn on their own web cams and arrange them so people behind can see each others screens
– Music starts
– Fades from black to image of my eyes opening
– Turn and face the audience
– Start mixing the video reacting to the music