Descriptions and Comparisons

Following the visual clues, the music itself can be analyzed through these kinetic drawings. The position of the lines can be related to pitch. The density and length of lines are indicators of the speed of the music. Circles and figure eights represent string crossings. Correlating the position of the lines in the photograph to the movement and position of the bow hand, the lower notes on the fiddle, played on the G string are represented by the higher lines in the drawing. High notes played on the E string are represented by the lines in the lower areas of the drawing. In fig. 4. Snow in April (also audio ex. 1), one can see that there is more density to the lines in the upper regions of the drawing, showing that the melody has a higher proportion of low notes. The sweeping gestures from the upper right corner to the middle on the right side represent long bow strokes. These long bow strokes indicate a slower tempo. The curls and stylized figure eights represent string crossings, where the bow hand changes levels from string to string. Following the curls at the very bottom of the page, which represent the E string and high notes, we can follow the line right up to the top of the page, which represents the G string. From this we can deduce that there is a part of the melody which jumps from the high notes to the low notes. As the lateral movements are those which indicate the length of bow, we can also see that in this part of the melody it is an abrupt string crossing, with few if any notes played between. Exploring and analyzing the static image of a melody is one method by which the viewer can experience fiddle music in a new way. Listening to the music while looking at the drawing enhances the viewer's appreciation, entwining the visual with the aural experience.

Immediately, I was surprised by the diversity of gesture which these drawings began to show. The following three examples are the result of taping Arches paper to the wall and holding a watercolour crayon between the fingers of my bow hand, drawing on the paper while I played. Fig. 1. 1 represents the traditional reel, Mason's Apron. The A and B sections and the repeats are separated in colour and in space on the page. Fig. 2. is a traditional slow air, Bunch of Keys. In this one, the A and B sections are also different colours, but layered in the same area. Fig. 3. is Snow in April, a waltz by Tim Janz, where the A and B sections are presented in the same colour.

Further Research

All of the drawings which I have discussed in this paper are the documentation of one fiddler: myself. This is a record of my personal gestures, my personal style. The kinetic drawings of my airs, waltzes, jigs and reels reflect my own movements, and although there would be some similarities between fiddlers, this is only a glimpse of the variations which can be explored.

As every fiddler has a unique sound and interpretation of a tune, every kinetic drawing will record the exact movements made in the manipulation of the bow. This becomes a unique signature, generating a unique visual reference of the artistic expression of each individual fiddler. I suggest that every genre of fiddle tunes will also have its own particular set of gestures. A hardanger fiddler will have different elements in the line than will be found in those of an Irish fiddler or a Scottish fiddler. Styles also vary widely within any national tradition, with regional diversity from north to south and east to west. Because of this, the possibilities for the exploration of gesture between and within style sets are endless.

This work also informs us pedagogically, providing more clues in our pursuit of the performance of different styles. It can become another facet of learning, along with listening, and watching other fiddlers play. A laser pointer taped to the bow hand uses commonly found technology in a simply, yet highly effective way, and can easily be integrated into the music teaching studio.

New music compositions could also find departure points for these techniques. After seeing the results of the FiddleLights videos, I wondered what it would be like if I could compose my own music thinking of the gestures, so that the ultimate result would be a synchronization of the drawing and the music, in process as well as result.

To further develop all of these concepts, I am hoping to work with Dr. Sheelagh Carpendale at the University of Calgary with the Vicon MoCap System. It is a machine and computer program which tracks movement in 3D. This will present more possibilities for recording the movements of individual fiddle players. Although my documentation of bow movement through the FiddleLights Project gives a true representation of the bow hand movement of the fiddler, it neglects to incorporate the movement of the whole body of the fiddler. Rather, the fiddler must remain at the same angle to the wall, with the light pointing at 90° to the wall, which can be restrictive for the player. This new imaging system will record the movement of the entire body of the fiddler in 3D, allowing complete freedom of movement.

Conclusion

The corporeal experience of the fiddler, in which the manipulation of the bow creates the sound on the fiddle, is something which is largely known only through a kinesthetic sense experienced by fiddlers themselves. The FiddleLights Project enhances the haptic experience of fiddling into a visual realm of documentation. For non-fiddle players, the only connection to this experience is visually, through watching a fiddler play. With the FiddleLights Project, deeper insight through the visualisation of kinetic signatures is open to all. The kinetic drawings and videos of the FiddleLights Project also present examples of abstract visual art as impactful images created with intention and aesthetic merit.

Presently under Peer Review at the University of Ulster

fig.1: Mason’s Apron, watercolour on Arches paper

fig.2: Bunch of Keys, watercolour on Arches paper

fig.3: Snow in April, watercolour on Arches paper

fig.4: Snow in April from the series Fiddle Lights

fig.5: Bridal Jig from the series Fiddle Lights

fig.6: Mason’s Apron from the series Fiddle Lights

List of Figures

Figure 1. Elisa Sereno-Janz. Mason's Apron from the series Fiddle Lights. 2011.     watercolour crayon on Arches paper

Figure 2. Elisa Sereno-Janz. Bunch of Keys from the series Fiddle Lights. 2011 watercolour crayon on Arches paper. 2011.

Figure 3. Elisa Sereno-Janz. Snow in April from the series Fiddle Lights. 2011. watercolour crayon on Arches paper.

Figure 4. Elisa Sereno-Janz. Snow in April from the series Fiddle Lights. 2012 Digital Photograph.

Figure 5. Elisa Sereno-Janz. Bridal Jig from the series Fiddle Lights. 2012 Digital Photograph.

Figure 6. Elisa Sereno-Janz. Mason's Apron. from the series Fiddle Lights. 2012 Digital Photograph.

Figure 7. Elisa Sereno-Janz. Reels: Mason's Apron, Growlin' Old Man and Old Woman, Swallow's Tail Reel. from the series Fiddle Lights. 2012 Digital Photograph.

Figure 8. Elisa Sereno-Janz. Jigs: Bridal Jig, Fairhaired Boy, Gaelic Club. from the series Fiddle Lights. 2012 Digital Photograph.

Figure 9. Elisa Sereno-Janz. Slow Tunes: Snow in April, Lone Pine Waltz, and Bunch of Keys. from the series Fiddle Lights. 2012 Digital Photograph.

Figure 10. Elisa Sereno-Janz. Growlin' Old Man and Old Woman. from the series Fiddle Lights. 2012 Digital Photograph.

Figure 11. Elisa Sereno-Janz. Fairhaired Boy. from the series Fiddle Lights. 2012 Digital Photograph.

Figure 12. Elisa Sereno-Janz. Swallow's Tail Reel. from the series Fiddle Lights. 2012 Digital Photograph.

List of Videos

Video 1. Elisa Sereno-Janz. fiddle. Growlin' Old Man and Old Woman. Trad. Reel. 2012. Digital Video

Video 2. Elisa Sereno-Janz. fiddle. Fairhaired Boy. Trad. Jig. 2012. Digital Video

Video 3. Elisa Sereno-Janz. fiddle. Swallow’s Tail Reel. Trad. Reel. 2012. Digital Video

Video 4. Elisa Sereno-Janz. fiddle. Swallow's Tail Mute. 2012. Digital Video

fig.10: Growlin’ Old Man and Old Woman, from the series Fiddle Lights

fig.11: Fairhaired Boy, from the series Fiddle Lights

fig.11: Swallow’s Tail Reel, from the series Fiddle Lights

You Tube Link: http://youtu.be/5rXAseTStyI

Video 4. Elisa Sereno-Janz. fiddle. Swallow's Tail Mute. 2012. Digital Video

You Tube Link: http://youtu.be/5rXAseTStyI

Audio 1. Elisa Sereno-Janz. fiddle. Snow in April. composer, Tim Janz. 2012. Digital Audio.

Audio 2. Elisa Sereno-Janz. fiddle. Bridal Jig. Trad. Jig. 2012. Digital Audio.

Audio 3. Elisa Sereno-Janz. fiddle. Mason's Apron. Trad. Jig. 2012. Digital Audio.

Video 1. Elisa Sereno-Janz. fiddle. Growlin' Old Man and Old Woman. Trad. Reel. 2012. Digital Video

You Tube Link: http://youtu.be/0c7ZH3Ly4aA

Video 2. Elisa Sereno-Janz. fiddle. Fairhaired Boy. Trad. Jig. 2012. Digital Video

You Tube Link: http://youtu.be/OP_XusKnLRY

Video 3. Elisa Sereno-Janz. fiddle. Swallow’s Tail Reel. Trad. Reel. 2012. Digital Video

You Tube Link: http://youtu.be/EcXjCaRk0X4

Dr. Fintan Vallely
Conference Coordinator, NAFCo 2012 University of Ulster,
Derry, Northern Ireland

February 17, 2013

The FiddleLights Project -
An Artist's Recording of Bow Hand Movements in Fiddle Tunes

by Elisa Sereno-Janz

Alberta College of Art and Design Calgary, Canada

Introduction

Fiddling and dancing are inextricably entwined. Just as fiddle music moves the body of the dancer, the act of fiddling moves the body of the fiddler in its own dance. The performer executes complex movements in the manipulation of the bow, of the fingers, and of the entire body to release the voice of the instrument. I experience fiddling as part of the practice of haptic art, that of aesthetic touch. In this, the corporeal experience is as much a part of the music making as the aural result. FiddleLights is a new media visual art project in which I record the gestures of the bow, presenting a kinetic ‘drawing’ of the actual movements which create the bowed sound on the fiddle.

In the year 2010, after 27 years as a professional musician and private violin/ fiddle teacher, I entered the Alberta College of Art and Design in Calgary, Canada to study for a degree in Fine Art. In one of my drawing classes, the students were led in a discussion about how to access ideas for abstraction. My teacher, Mark Mullin, is an abstract painter. He suggested, "In using the body as a subject for abstraction, don't think of how the body looks, but rather how the body moves." The challenge was how to then represent that movement in a two dimensional form. This abstract drawing assignment proved to be pivotal in exploring new avenues of creative production.

Project Description

I have always been fascinated by the shapes that my bow hand draws in the air when I play the fiddle. Sometimes when teaching fiddlers and violinists, I have drawn my students’ attention to the shapes their bow hand makes as they play. When they smooth out the curves and pay attention to their movements, their playing becomes more graceful, with smoother transitions between strings and between bow strokes.

As a subject for drawing abstraction, I was very curious as to how I could represent the bow hand movement used in playing the fiddle in a two dimensional form. My theory was that I would discover basic shapes such as circles, ovals and figure eights. I tried many different methods of actualizing the shapes which I create with my bow hand when I play the fiddle. I tacked a piece of paper to the wall. Holding a felt pen between the fingers of my bow hand, I played my fiddle, transferring for the first time the shape my bow hand was making in the air onto paper.

Although this method was showing me how varied the shapes were for each tune, the resistance of the drawing tool with the paper confined my gestures. The result was an inexact representation of the movement. At this time I was also taking a photography course and experimenting with the possibilities in time lapse photography by tracking the movement of lights at night. I was curious as to whether I could somehow use that technology to show the bow hand gestures more clearly. Laser pointers are small, weigh only 10 grams and discharge a very bright, focused beam. I taped a laser pointer to my bow hand, so that the light was pointing off my knuckle, and shining at the wall at a 90° angle. I turned out the lights, so that the only light recorded in the photograph would be from the laser pointer. I set my camera to a 22 second exposure which gave enough time to play the A section and the B section of the tune once, without repeats. Because the laser pointer weighs so little as to be almost imperceptible, I was able to play with much greater freedom of movement. This now provided me with an exact two dimensional representation of the movement used to play that particular tune.

Fig. 4. is a laser kinetic drawing of the same tune Snow in April. In this digital time lapse photograph, we can see how much freer the movement of the bow hand is compared to the more angular movements recorded in fig. 3. Note however, that the general shape of the drawings are similar.

Fig. 5. Bridal Jig and fig. 6. Mason's Apron further demonstrate the variety of shapes and gestures used to give voice to the fiddle, creating a unique drawing for each tune. I found that fiddle tunes provided much better material for working with than classical music. Classical music tends to have sections where the ideas are developed over a long period of time, with more similar motivic repeated gestures, while fiddle tunes encapsulate a diversity of motion within only 16 bars of music. For all of these examples, I played the A section and the B section only once, without the traditional repeats. This allowed for more space in the drawing. When I tried it with the repeats, the lines became cluttered.

From examining these first examples of kinetic drawings of fiddle tunes, I became intrigued by the idea that certain categories of fiddle tune dances; reels, jigs, airs, waltzes seemed to have their own individual gestures and visual character. This led to a question. Could gestures be related not only to the type of dance, but also the genre of tradition, such as Irish, Scottish, Old Time, etc., or even individual players? FiddleLight images provide a new visual representation of the language of music. There is significant potential to further explore these kinetic signatures in the realms of musical analysis, pedagogical development and abstract visual art.

In contrast to Snow in April, Bridal Jig fig. 5. (audio ex. 2) has much more density in the line work. This suggests a faster tempo, encompassing more gestures in the same amount of time. The densest part of the drawing is the bottom left hand corner which suggests high notes on the E string. There is very little on the upper right hand side, letting us know that there is little or nothing on the G string, concentrating the melody between the D, A and E strings. The angular gestures at the top of the drawing indicate that there are sections of bow strokes which remain on the same string. The wavy lines, curly shapes and small circles are the string crossings. In listening to the recording, notice the lilting gestures in the music are directly represented visually by the curvilinear gestures of the bow movement.

Fig. 6. Mason's Apron (audio ex. 3) is an example of a reel and has the most density of the three examples so far. This indicates that it is the fastest tempo with the greatest frequency of bow strokes. There is a lot of angular movement similar to what we saw in The Bridal Jig, yet the lines are much shorter and there are more of them concentrated in a small space. This also suggests shorter bow strokes overall. The angular strokes on the left hand side of the drawing, which are more vertical would be those on the E string. The densest section of the angular strokes are in the middle at a slight angle. These would be on the A string. There is some activity on the right hand side of the drawing which is indicating notes on the D string. There is nothing on the G string in this melody. The circles at the bottom and middle of the drawing illustrate the string crossings found in the B section of the reel. Although there are some curly gestures in The Mason's Apron, there are far fewer than there are in The Bridal Jig. In listening to the recording of Mason's Apron, we can correlate the sound of the strong, repetitive bow strokes with the visual density of similar line.

Studying the line work has led to some interesting discoveries. I have noticed that jigs in compound duple time (6/8), have many more curly lines while reels which are in simple duple time (2/4), have more angular shapes. Simple time has an even subdivision of each beat, which works well with the binary up and down motions of the bow. Compound time has a triple subdivision of each beat leading to an asymmetrical division of the bow strokes. Generally, the strong beat is a down bow and the weak beat is an up bow. We still, on occasion add asymmetry to the bow strokes in the performance of reels. However, in observing examples of my own playing, I maintain a greater proportion of symmetry in the bowing of a reel. When considering how I bow a jig, there are far more asymmetrical bow strokes with common sequences of long, short, short that contribute to the curly lines and stylized figure eights.

In fig. 7. Reels we can compare the kinetic drawings of Mason's Apron, Growlin' Old Man and Old Woman, and Swallow's Tail Reel. Although there are some circular forms in each of these, there is a profusion of angular lines. All three reels have a similar visual vocabulary. However, Gowlin' Old Man and Old Woman has an increased density of the circles and sweeping gestures which, indicate an abundance of string crossings, not common to the other two reels.

If we compare three jigs, Bridal Jig, Fairhaired Boy, and Gaelic Club in fig. 8., we notice that the lines contain more curly shapes and stylized figure eights. This is indicative of the asymmetrical bowing used in playing the jigs. This comparison of the three jigs confirms the asymmetry of the bowing produces the lilting rhythm and characteristic feel of the jig music.

Fig. 9. shows three examples of slower tunes; two waltzes, Snow in April and Lone Pine Waltz, and one air, Bunch of Keys, for comparison. It is evident that with these slower tunes, the drawings are less dense, and the predominant gestures indicate longer bow strokes with many curls and stylized figure eights. The gestures are similar to those in the jigs (fig. 8) yet they are looser and on a larger scale. This corresponds with my use of the bow in slow airs and waltzes. I use much more bow, incorporating some bow strokes which travel the full length of the bow, from heel to tip and tip to heel. They are interspersed with shorter bow strokes as well, providing variation and emphasis. The use of the whole bow makes the gestures more expansive in these kinetic drawings of slower tunes.

In the first stage of the FiddleLights Project experimentation was conducted with recording musical performance on the fiddle through a static visual image. I discovered how different dances incorporate diverse gestures both in the movement of the body and the sound of the music. Through examination of the lines in the time lapse photos, visual signatures of pitch, tempo, and the use of symmetrical and asymmetrical bow strokes can be observed.

Videos

The static images of the FiddleLights drawings are the entry point into a time based, animated experience through video. In the static image, it is often difficult to find the starting point and the end point of the drawing. It is one thing to look at the finished drawing and imagine how it sounds. Another dimension of information and experience is incorporated when a recording of the tune is played while observing the static drawing. The next step was to record the music and the gesture with video. Initially I experimented with video capture of the point moving in space, but this did not give the sense of line found in the drawings. The moving dot needed an afterimage to show its path.

To accomplish this, I experimented with several methods and programs which did not provide a high enough resolution in the finished result. Dr. Alan Dunning, one of my professors at ACAD, suggested that I process the video with Quartz Composer. This is a computer program which can add a delay to the video. This leaves a trail long enough to give the viewer the sense that they are watching a drawing being made of the bow hand movement. This now enabled the kinetic signatures to be observed concurrently with the unfolding of the music audio.

The following three video examples demonstrate this relationship between the path of the bow and the music. Video 1. and fig.10. both represent Growlin' Old Man and Old Woman. The video reveals the synchronization of the gestures and the music, while the still photo shows the accumulation of the gestures of the entire sixteen bars of music. Similar relationships can be found with the comparison of video 2. with fig. 11. (Fairhaired Boy) and video 3. with fig. 12. (Swallowtail Reel). There is a remarkable nuance of gesture that can be seen with the processed video.

The FiddleLights Project thus far has been comprised of three major components: time lapse photos, still photo with background audio and digitally processed video. Each of these components allows the viewer to gain deeper insight into fiddle performance through an intersection of the audio experience with the visualisation of the exact movements used to produce the sound on the fiddle.

While the above analysis is concerned with musical interpretations, the outcome of this process can be appreciated on its own as a visual abstraction of aesthetic merit. The kinetic signatures, in the form of stills, with their curvilinear, organic shapes suggest form and meaning through repetition and variation. The contrast of the black background with the red drawing leads to a perception of vitality in the pieces. Viewed as a collection, these digital photos vary from the quiet curvilinear forms of the waltzes and airs, the playful curls and circles of the jigs, to the very intense, layered mark making created by the reels. The videos, viewed without sound, suggest purposeful movements. (see video 4.) There is rhythm and repetition, yet the speed at which the marks are made vary. It references handwriting, suggesting meaning, and yet ephemeral, as the drawing disappears even as it is being created. To appreciate the stills or the videos as works of abstract art, it is not necessary to know the origins of the mark making which are the foundation of the process for the FiddleLights Project.