The interviews from the Metal DEC lab are now online at the youtube page
On Friday the 25th we spent our day at Metal and had the chance to talk with the artists about their work during the residency. Here’s the result:
Hans feels like an antenna here at Chalkwell Hall, he’s getting lots of inputs and inspiration from working side to side with other artists. At first, he found it difficult to free himself from business dynamics he’s usually subject to by working in a company, clients demand results, finished products, and don’t seem to care about the importance of the process, which is what the residency here is focused on. Being in between the art and business world, Hans tries to mix the idea of “uniqueness” related to the former with the one of “reproduction” on which the latter is based on. Using code (Action Script and Processing), he generates slight variations of the same piece, resulting in a series of reproduced but still unique images. Also, he is concerned with the role of hardware in digital art as often this is only thought of as art if delivered together with a physical medium. Particularly, digital art is expressed through screens, i.e. artificial light. Hans is here researching the possibility to exhibit digital art through other media such as E-paper or more viable QR codes techniques.
John was looking into two different areas and projects, one of which he had already started working on some time before Metal, and the other one set by him as a consequence to a theft within the building. Such system consisted in a small camera filming the building entrance, and a system that would perform face recognition, which was partially working – for example, it would struggle to recognize Graham’s beard.
The first project on the other hand, was involving one out of four swan pedalos that were used for the Liverpool Biennale and then sold on Ebay and that John decided to buy. His purpose was to try and create an “open source” swan pedalo: understanding the unconventional combination of the two expressions, and especially how open source implies that the source has to be available, the idea was to actually expore new methods of collective and maybe modifying use of such pedalo, through people’s interventions and suggestions. In fact, the object could maybe be modified by its ‘users’ as ong as it is still usable.
John’s view of his work is that all of it is continuous, and is not made for a sole and specific purpose, which can in fact be seend in the swan pedalo and the ongoing research about it.
Stephen is investigating the predictive power hidden in data. Data sets can reveal recurring patterns if analyzed over time and such patterns can show tendencies on which a possible model of future things to happen can be drawn. Data mining, a practice increasingly adopted by business to profile users and target marketing accordingly, does that by using algorithms to find informational patterns in databases and produce knowledge out of them (KDD). Various forms of divination such as tasseomancy, a method for reading tea leaves, also use data patterns to forsee the future; Stephen is developing a system that juxtaposes KDD and divination methods: a webcam installed at the bottom of a cup scans the leaves pattern and send the images to the computer that analyzes them through algorithms and store them in a database in which the interpretation of the same pattern given by a human user (divinator) is also stored. In doing so, the parallel human-machine vision of data patterns is merged in the production of knowledge.
Olga, who is also a PhD student at Goldsmiths and attended our same course, created a light responsive system made up of four light sensors and three vibrating devices whose connection one to the other and then to the body is meant to explore the interaction between the sun and the body. By the time she showed us her project, in which the sensors were attached to different parts of her clothes, they were all responsive although some of the values (especially the one of sensor n4 on the front) had really low values because of the darkness of the room.
Olga is generally interested in infraverbal communication, i.e. the exchange of informations that happens at a non linguistic and more subtle level such as the one of electromagnetic fields and feromons. She is directing her PHD research towards the connection between sun, humans and machines, while the work she is performing with another student is based on interaction dynamics happening out of consciousness between humans, which she is exploring through the use of sensors.
Rob is working on a system that captures images at set intervals and are affected by light sensors. The images are automatically stored in a remote server and then played as a sequence creating a time lapse effect; the hardware components of the system are a Make Controller to which light sensors are plugged and a camera connected to a Mac Mini. He is using Max MSP/Jitter with a patch that regulates the system and that he had created before joining Metal and edited in order to adapt it to the surroundings at Chalkwell Hall. He showed us some extracts of what has been captured between 4 pm on Thursday the 24th and this morning, resulting in a video where the shades affected by light intensity implied a visual sensation of movement and evolution of the space.
Markus is exploring new possibilities in video expression not necessarily based on speech and dialogues but rather focused on montage and post production techniques. He would like to add interactivity to his work as it is something he has not done yet. On Thursday, he went for a walk on the mud (a “non space” in his words) with Graham and filmed short clips which he then edited in order to create a visual pattern. He often adds his own sounds to the videos based on what he’s trying to express.
Caroline explained that she has not been practicing for a couple of years, and was now trying to explore new areas of research and get back into arts practice: she mainly researched during her stay at Metal, deciding to take on more different kinds of information without narrowing it down too much, in order to identify a focus.
One of the points she got into, was analysing how different means of everyday life exercise control on the very basic tasks of her life itself, such as work, amongst others.
Having done the requisite research on tea leaf practice I decided to engage once again in the act itself. I again recorded the process using the same apparatus as last night.
To prep myself for the frame of mind one should be in when doing an act such as this I did some basic four fold breath breathing exercises and also listened to some binaural brainwaves music. It’s important to engage in these actions to enter the mental/psychological space, even if one would consider that space a simple suspension of disbelief, necessary for scrying practices.
I decided to steer clear of the interpretations of what the various symbols I saw meant, but realised that the person who looked into the tea leaves would need some sort of guidance as to what to detect. Usually this guidance would be provided by the tea leaf reader (in a classic instance of mediated agency between bodies) but in the eventual realisation of this concept this guidance will be provided by software who will provide it in order to gather information into it’s database tables.
Once I had completed the gazing and took time to look at the patterns I realised that there was a possibility of using the users input to the database as a trojan horse for the computer to garner information. For instance I could ask the user to count the number of leaves they see and add this to the database. This data would go into the computers view of the patterns, as knowing the amount of tea leaves might be additional data which will let it filter the imagery more appropriately.
Something that I found noteworthy was that upon later inspection of the glass that the patterns within suggested different shapes and combinations to me. This really made me think about the state of mind one has and how much this determines your propensity amenable to perceiving patterns. I wondered if there would be a way to bring out how distilling ones experience into a database could alter your pattern discerning capabilities.
Following this more intuitive engagement with tasseomancy I was on much firmer conceptual ground. I was much clearer about how the interaction between computer and tea gazer would have to be a co-relational relationship, with the computer adopting a pseudo – seer like position as well as acting as a data munging agent. I was also able to devise a provisional database structure into which the data of the divination practice would be entered. This is a rough sketch of how the structure will work
this is a rough plan, awaiting proper ER diagramming
I then set about using Perl to create a DBD interface whereby data could be entered via the command line. I wanted to code this from scratch as much as possible, as I deemed it within my existing knowledge and that it would take just as long to start coding it as to search efficiently across google for a script that approximated to the function which I desired to have. In so doing I was take a cue from Tim Kindbergs decision making process.
Here are some of my preferred stills of the webcam perspective of tea leaf reading
Off the back of this mornings conversation I figured I’d get the ball rolling on this topic.
I have a lot of experience of the frustration of muddling through layers of code abstraction with only an inkling of what is going on. In part this is an experiment to see how quickly I can accomplish what I want via searching the distributed knowledge of coders via Google. For a long time I have been uneasily conscious of how much my knowledge of code and efficacy of getting code work done hinges upon my efficient use of boolean search strings and knowing which forums to glean first.
I want a rough and ready way to analyse the movement of the tea leaves from the POV of the webcam. I searched for “image analysis perl” and in (0.15 seconds) approximately 299,000 results were returned. I believe I am found what I am looking for on the third returned hit (http://w3.biosci.utexas.edu/atkinson/software/Scripts.html) a series of scripts designed to track the movements of flies. I imagine that pattern won’t be dissimilar from swimming tea leaves.
But I need to split my webcam captured .ogv file into individual jpgs for this script to work. I go through several iterations of search strings before this one “split .video into frames ubuntu separate” returns the hint I need (http://stackoverflow.com/questions/2691996/ffmpeg-split-into-frames). This is stack overflow, the site that Tim counselled us on.
[evolution of search strings = split .gov into consecutive jpg, split .ogv into consecutive frames, split .video into frames ubuntu separate]
From this page I knew what I wanted was: “ffmpeg split jpgs”.
But then I needed to know how to install ffmpeg. And then I discovered that ffmpeg won’t convert ogv files. So then I need mencoder to change my .ogv files to avis which can be converted by ffmpeg into separate jpegs for the purposes of the script which I found so quickly.
I believe everything I want to do could be done quickly via a knowledge of PD or MAX or similar programs. However I wanted to test if it was possible to quickly assemble some code in a hodge podge magpie manner. In
I was pretty pleased with the video and image results acquired from yesterdays webcam experiments to continue proceeding down this path.
However said path was marred by my creaking Lattitude laptop with Ubuntu Interpid Ibex installed. It proved incredibly hard to get software installed on it, however I did manage to improve the contrast of the images snapped yesterday. By increasing the contrast the pattern is given greater relief, something that will be easy to automate via gimp or image magick.
Adjusted Images which will help computer detect patterns more readily. Final picture remains unadjusted to illustrate the importance of calibrating webcam for consistent white balancing
The ever generous Derek Shaw of SoSlug offered to oversee the upgrading of the Ubuntu software, and in the meantime I cracked ahead with using Graham Harwoods laptop to do the various image software investigations. For a while I got quite involved in finding ready made ways of analysing the motion of the tea leaves as I had detected in video recorded last night. This process has been documented here and it did offer up some nice stills of tea reading from a different perspective. I’ve collated a series of frame grabs of the video from last night (a selection of which I have added here), which have their own bewitching patterns contained within and perhaps offer a totally parallel site for exploring the different patterns seen by computer and human.
However I found that the myriad of options available to catalogue patterns within moving video (and the associated complexity attending each method, including this which at first glance appeared to be relatively pain free in terms of implementation) was taking me too far in one direction. I wanted to return to conceptualising the process of distilling the overall practice of tea leaf reading into a database. Ergo a second bout of tea leaf reading was required.
This time around I was more concerned with engaging with the practice itself rather than proving that the webcam apparatus would hold up. To that end I dove into “Telling Fortunes By Tea Leaves”, a canonical text in tasseomancy dating from 1922. This provided some useful background information, some of which buttressed areas which I was keen to interrogate and some of which make me think again about the suitability of tasseomancy as a scrying practice.
The rhetoric contained within the book follows an established trope in occult & magickal practices, the idea that the subconscious must assert itself (‘self’ is hardly ideal to use here but it will have to suffice) at some point within the ritual. Within tea leaf reading this opportunity for subconsciousness to bubble to the surface occurs when the tea cup, with a small amount of tea remaining in it, is swilled by the left hand and quickly inverted. During this moment the mind must be either completely absent or intensely focused, again this correlates with what previous research into Chaos Magicks ‘Sigil’ projection. Interestingly Cecily Kent (the author) notes that:
“time has no meaning for the subconscious self”
This is interesting for me as I am interested in using the video capture length as data for the computer to add to its database table record of the tea leaf reading experience.
The person gazing at the tea leaves is invited to discern shapes and letters. However it is at this point that tasseomancy differs from the sorts of scrying practices I was initially attracted to: there is a rigid symbolism associated with the symbols detected, in a manner not too dissimilar from other means of fortune telling. This is problematic in that the divination practice suddenly become tied to a fixed symbolic register external to the experience of the practitioner. However it is interesting as the idea of the patterns being codified per some external authority is very pertinent to the broader conception of code, (code as embedded intelligence such as postcodes, code as ordering structures and protocols external to computers) that we have developed within this lab.
Note: Sigil as used herein is not to be confused with the use of Sigil in Perl. I only learnt about this crossover in the context of this lab, but it represents another interesting transfer between the occult and code
For some of my investigations I was really quite eager to explore the above experiment in the telephone game (or Chinese Whispers as it is known on this side of the pond, for reasons I am still not clear about). My twist on the experiment was to be training the computer’s speech recognition to listen to electro-magnetic vibrations via magnetic pick up mics.
However things have stalled at the first, and crucial, software hurdle. I was attempting to install speech recognition software on ubuntu, which does exist in the form of Julius and Vox-forge. However synaptic package manager was somewhat hamstrung and though I have managed to download the packages from here I am wary about getting sucked into the Linux terminal line (i.e. via DPKG) installation vortex (I suspect my grasping knowledge of code installation hasn’t installed everything from the ubuntu archive).
The hardware end of the project would be relatively easy to cobble together, a quick visit to a music store would suffice. However I really would like to build this electrical stethoscope as described here. I think this is interesting for two reasons, one being my recently kindled interest in biodynamic psychotherapy, and two because this method of attuning to computer hardware is intimately linked to earlier audio debugging methods