Selim Onat

My main occupation is Neuroscience.

In the past, I have been interested on how the visual system processes natural scenes. To this end, I have recorded naturalistic movies using micro-cameras carried by cats while they were actively exploring a natural environment. I used these movies to train neuronal networks in an unsupervised manner and compared learnt features to the known properties of neurons in visual cortex. I also used these videos as stimuli during physiological recordings to gain insights on the principles of natural signal processing in the visual cortex.

Recently, I started working on how humans make generalizations based on what they have previously learnt. To this end, I am using a variety of methodologies including fMRI (1), autonomous (2), as well as eye-movement recordings (3). This research emanates from the well-established field of "stimulus generalization" following mainly the "lineage" of Hovland, Hull and Roger Shepard (4), and including the more recent computational work of Josua Tenenbaum (5). Furthermore, it integrates work on anxiety disorders, as it is believed that these mechanisms are impaired in people suffering from anxiety problems.

kinect camera to control stop-motion video flow

In this post I would like to explore embodied ways on how one could interact with a visual stream. More specifically, this is about controlling the flow of a video stream with one own's body movements.

The system I am using is based on Microsoft's Kinect camera. On the computer side I am using the Quartz Composer to connect different streams of information on the one side body related parameters and on the other parameters related to the video stream.

In the following video, I am showing a simple situation where the movie is controlled by vertical movements of my hand.


Kinect controlled video playing from sonat on Vimeo.