title

Showing posts with label idea. Show all posts
Showing posts with label idea. Show all posts

Friday, November 26, 2021

ideas - sound

Sound as input

This is something you mentioned earlier. Extending human actions by simulating the echo of actions from one place to another. Would be limited to actions that involve sound, e.g. talking, snapping your fingers etc. This could be very nice if it has a very short release time.

Verbal -> non verbal communication. Speech is transformed into abstract shapes / vibrations. Non-verbal form of communication. Like the two cups on a string sound is converted into vibration. Present an expanded way of communication aided by visuals. The pitch and tone of your voice is analysed. Each sound is presented in its wave format, but eace spline will connect to the one before, creating a generative landscape through sound.

Buoy / wave height data is basically a little slice / plane with a displacement modifier on it. Could be fun to try and use this data and apply it to an "urban slice". Either directly to create a surreal feeling or use the height data and map it to something else, such as time etc. The purpose of this would be to create a connection between two wildly different settings, busy urban setting ≠ ocean.

Alternatively go to a location and record audio. Then extract the 3D data of this location from a 3D map. Then use the sound to displace and distort the digital copy. Sound is vibrations that travels through the air. With tiny refractions. As such this project increases the impact / magnitude of these sounds. It presents us just a more extreme version of what already happens. Schlieren photography.

Sound as output

Create sound from motion. This would be about using realtime data via. a live stream. E.g. there are tons a traffic cams around Seoul which could be used. However it would be better to have a stream that involves more people and less cars. For this it would be about capturing the urban soundscapes. However this would be very similar to the wind project by Damian Stewart. To differenitate the project maybe i should try to analyse the input differently e.g. use the motion itself to create sounds, instead of pixel contrast.

Summed up: Use motion to draw paths, then convert these paths into waveforms / notes.

Water - LED experiment. This one has the same problem as the media art project about creating waves. To get around this, maybe i could make a small stand for the LED light and place it somewhere along the Cheonggyecheon and record data myself. Then use this data to do the experiment. However it wouldn't be real time data anymore. This project would be about capturing a specific moment for people to experience without being there. In a similar way to how photographs gives us a glimpse into the past. This project is about experiencing the past via an audio - visual installation / more immersive.

Alternatively I could try to use buoy / wave height data from a distant location and then use this data to generate sound, but i think this has been done many times before.

I was thinking about how to create forms related to heat. One way would be to go in the direction of a mirage / refraction of light. Or the human thermal boundary layer.

Problem with this model is that it may be too flimsy with just paper. E.g. if add support inside, it will interfere with the rear projection.

Friday, November 12, 2021

Idea proposals

So far I've mostly thought about connecting different locations together in a very "object" oriented way. I think i should do a few experiments that are more tied to connecting people across locations.

Optical Flow / difference keying. With an empty location as input data, then use movement / difference from the original input image to create distortion. People act as energy, distorting the texture around the room. E.g. like paddling in water. People as a brush.

Room size theremin?

Translating presence. With an unwrapped building / room people can lean into each room / building to experience a distant location. I think this would be more sensory data such as smells or sounds. Alternatively maybe the opposite could be done where actions in the original location is translated onto the unwrapped location. Maybe like lights?

Space within space. Projection mapping on model to reveal a bigger space contained within a smaller one. I was thinking this could be done via. either a laser pointer and a webcamera where you track the red dot in real time with a mask layered on top to reveal another space behind. Or it could be done via gyroscope data where your phone acts as a pointer. This would be less accurate but it would make it easier for people to interact with the model.

Volumetric / 3D map. Crosssections of space. Presence translated into Z - depth like the short movie Hedgehod in the fog. Layer 4 - 5 transparent lcd screens then use peoples position to place them on each screen. Another way would be to have one transparent screen and use a beam splitter to mirror the screen. However with this way there wouldn't be any delay between the screens. I was thinking if it would be possible to somehow incorporate the technique from NFT class for the thesis project. To keep it completely digital i could try to see how well it would translate currently. For an experiment maybe it would be best to do only one "slice".

Window into another location. Use screen with accelerometer to explore a distant location. I think with this, the window would either look directly into another space, so when you tilt the screen the space stays upright (like when you turn your head) or it would affect the space within, when you tilt the screen, objects will follow. This could be completely digital, or it could be a physical installation.

Wifi sniffing. Monitoring all the traffic on an unsercured wifi network. Either show each user connected or the most frequented websites. Visualize or compare this traffic to other locations. Each blob can represent a website visited. For each unique IP adress that is visited the blob grows bigger. Digital version of the previous experiment. I am not sure how legal this is however.

Friday, October 29, 2021

Experiment - morphing object

This project has been a failure so far. I've tried a few different variations with different materials, none of them really working. Ideally i would use motors to move the magnets / pull the strings.

Just condom filled with water and magnet inside burst immediately. Same with balloon and magnet. Wrapping multiple balloons inside each other solved this problem but then i couldn't fill it with water anymore as it was "too strong".

When i put the magnet inside a polystyrene ball and double wrapped the condom it worked ok. It's pretty durable but no interesting shapes occur. Idk if maybe this is because i didn't hang it tight enough. As you can see in the video it gives in pretty fast and i can move it around. Also the magnet needs to be pretty close for it to work. Ideally, i wouldn't have to move the magnet inside the box at all as it "breaks" the feeling a bit.

I also tried to fill a condom with only polystyrene balls and threading a couple of the balls to then pull from the outside. In this case the condom needs to be hanged very tightly as you have to pull the string pretty hard for it to displace properly. Also not super durable, the condom broke pretty fast in this case.

Maybe I could make a tesselation surface instead and use strings to pull it?

Maybe this could be one of the sound experiments. Using a LED strip above water, then use ripples to generate sound. Alternatively the Media Art project from last semester could be turned into an audio project where the height of each ball controls sound.

Friday, October 22, 2021

Initial ideas

Non locality and Media

  • #1 Connecting multiple spaces together. Data network. 
  • #2 Synchronised objects.
  • #3 Connecting spaces (e.g. stores / window into another location).
  • #4 & 5 Connecting socially, e.g. sharing faces project.
  • #5 Physical, remote presence. Remote control.
  • #6 Community controlled / hive mind e.g. Twitch plays pokemon, Tokyo City Symphony.
  • #7 Telepresence is connection across time and space - immortality?

A floating / non gravitational object. I was thinking of data networks, how each location acts as a data point. As networks are always on, always connected. This was about showing the network as a living, dynamic being. E.g. lava lamp / metaballs. Each data point is twitching, sending or gathering data.

I was thinking it could either be made with a tessellation surface that can retract and expand using thread, or maybe it could be possible to make a silicon blob filled with liquid as well as a magnet inside. Maybe magnets could be used to distort the shape?

The first thoughts i had was to make distant interaction possible or that if you interact with one object in one space then its counterpart in another space would also change. However I think this won't work that well just cause it will be very awkward in that i would need a livestream of both locations for the effect to work. I don't think it gets the point across that well. Having two objects in one room mimic each other could work, maybe oscillating back and forth, like bits flipping between 0 and 1. As long as there is some feedback that something is actually happening.

Remote control. Persons physical position controls distortion of object. A low resolution set of bricks, pushed by opposite poles of a magnet. Two motors controlling the x, y position.

I think maybe this would be a more effective way to do "non - locality", with a "window" to another place. Then give small ways to interact with the environment. Maybe the "window" could be on a wheel so that when you turn it around gravity shifts.

Using phone as a flashlight, by accessing the gyroscope data. E.g. with Chromatophores as you mentioned squid / octopus use it to camouflage themselves / as a way to communicate. Do projection mapping on model (or just use a screen). Then use gyroscope data from phone to act as a flashlight / pointer that masks out a layer underneath. When you point your phone on the object, its true colors will show.

A flexible LED surface to mimic chromatophores found in cephalopods. I was thinking it could be abstract patterns that change on z - depth. E.g. if pushed in the LEDs will switch color. Or to combine this with the first idea, the LEDs switch color when pulled. E.g. when a surface is pulled there's stress put on it.

Internet controlled object. Motors / projection mapping. Community controlled projects, e.g. Twitch plays Pokemon. Maybe something similar to the volumetric video from last week in NFT. You can draw in this 3D space and see results the results live in a similar format. As for making it a physical object, maybe it could be a set of transparent lcd screens placed near each other or acryl plates with rear projection on them from an angle.

Biological clock. Connecting heart beat to clock / Heart works as a battery for the clock. Would be nice to make it sensitive enough so it actually shows when your heartbeat increases. However, this is very much so outside of the initial theme i chose. I just thought this would be a fun project to try.


Extra idea

Using OBS websockets to connect two separate things. With this its possible to make pretty much any program remote controllable via. a web interface. E.g. maybe it could be to have a Pong game played via two different browser windows. Or to control Arduino motors via web interface.