Professional Documents
Culture Documents
Copyright:
2014
c Julien Biral et al. This is an open-access article distributed
Figure 1. Diagram of the developed pressure sensor and
under the terms of the Creative Commons Attribution 3.0 Unported License, which
its disposition: (1) Pickup; (2) Conductive band; (3) Fret
permits unrestricted use, distribution, and reproduction in any medium, provided
(used as a sensor support); (4) Bridge; (5) Saddle.
the original author and source are credited.
- 1483 -
Proceedings ICMC|SMC|2014 14-20 September 2014, Athens, Greece
1.2 Guitar Synthesizers and Controllers techniques [10]. This recognition was combined with
real-time audio processing to create an augmented guitar.
Today plenty of guitar controllers are on the market.
However their system can only recognize an ongoing
Some do not have strings [2]. Some scan the fingerboard
technique as a whole, without further parametrization.
to find exactly which notes are fretted [3]. Others use
Particularly the palm mute technique requires such a
various techniques of pitch-detection, which have been
quantitive description because it is the vehicle with which
improved considerably during the last decades. With the
many expressive changes to the sound are made
emergence of polyphonic pickups, pitch detection devices
including: shorter duration of the guitar note, attenuation
became more important and led to the development of
of the global energy in the spectrum and less higher
systems directly connectable to the guitar. These systems
frequencies. These correspond to salient features for the
allow the guitar to be used like a synthesizer, e.g. the
listener such as loudness, brightness and attack time [11].
Fishman Tripleplay and Roland VGuitar Systems.
However those guitar controllers do not accurately track
2.2 Apparatus to Measure Palm Muting
pitches when strings are palm muted. Therefore they
generally require the performer to play without muting the The apparatus we have built combines two measuring
strings [4]. systems: a hexaphonic pickup for string vibration and a
piezoresistive fabric, multipoint pressure sensor array.
1.3 Modeling the Picking Hand
2.2.1 Hexaphonic Pickups
Usually the fretting hand stops the guitar strings to
establish the pitches of notes and chords that a guitarist Among existing guitars with hexaphonic guitar pickups,
plays. The picking hand is usually considered as the we selected one that used piezoelectric sensors in the
playing hand the one that has the most impact on bridge saddles. This avoids potential problems associated
timbre and timing. Much of the character of the personal with inductive coupling between current flows in the palm
style of the guitarist and the sound itself arise from the pressure sensor array and a magnetic pickup. The ability
gestures of this playing hand. A fruitful axis of research is to record the six strings is important, as we can explore
to model the relationship between the gestures of the hypotheses such as how palm damping could reduce the
picking hand and the sound produced so that gestures can crosstalk between strings that often complicates pitch
be inferred from real-time analysis of the sound alone. tracking of guitars. It also allows us to temporally and
This has been done successfully to identify the pick spatially locate the primary source of energy driving the
position [5, 6], the pick interaction [7] and the angle of string from the initial pluck.
attack [8]. Moreover multimodal recordings sound and 2.2.2 Pressure Sensing Array and Microcontroller
sensors of the musical performances can help to bring
this idea of surrogate sensing even further, by using Sensing palm pressure is challenging because it requires
machine learning techniques to determine the relation high spatial resolution, high sensitivity to light pressure,
between audio and sensor data [9]. relatively high speed and no interference with the
guitarists regular playing technique. Piezoresistive fabric
1.4 Structure of the Paper was chosen to solve the light pressure requirement and for
its thinness and the ease with which it can be cut during
In this paper Section 2 will present the overall arc of the prototype explorations. Commercially available force
work, i.e. the setup that we used and the building of the sensing resistors (FSRs) are simply not available in the
pressure sensor. The results will then be shown in required shapes and they are not effective for very light
Section 3 and discussed more deeply in Section 4. Finally pressures.
we will conclude this work in Section 5. To confirm that fabric pressure sensing would work and
to tune the choice of fabric, we built the first prototype
2. SENSOR SETUP using conductive strip board as shown in Figure 2.
Conductors are wired alternately as signal input and
This section describes the fundamental concepts related to
ground to form an interdigitated linear array. Input signals
this work. Then we present the building of the pressure
were wired to a simple passive analog conditioning array,
sensor: its position, its design and its refinement. Figure 1
as illustrated in Figure 3, and the resulting voltages were
illustrates the specific terminology related to the guitar
acquired and translated into USB OSC messages using the
field.
Teensy 3.1 ARM microcontroller. We selected the Teensy
because it is low cost, fast enough to send a sensing frame
2.1 Guitar Techniques
every 2 ms and it has an Arduino-compatible
The development of comprehensive models of guitar programming environment, including OSC library [12]
techniques is difficult because of the variety and the support.
complexity of guitar sounds and the richness of The circuit shown in Figure 3 is a simple voltage divider
contemporary performers explorations. An important in which the second resistor, RF ab , is implemented by the
contribution to this modeling problem was proposed by piezoresistive materiality of the fabric. This method is
Reboursiere et al. who used various classification convenient in its simplicity and economy which is
approaches to recognize some popular guitar important because we replicate the circuit many times.
- 1484 -
Proceedings ICMC|SMC|2014 14-20 September 2014, Athens, Greece
the hand and the pressure sensor. Indeed, the side of the
hand has a complex structure which varies over time
according to the gesture made by the guitarist. This is not
an issue for our application as knowing the relationship of
the textile to an applied force is sufficient for our purposes
as we have ascertained that the functional relationship is
monotonic [13].
105
25
Measured points
Interpolated Curve
15
10
5
Figure 2. First attempt to sense the guitar thanks to a
pressure sensor array attached right onto the guitar bridge.
00 1 2 3 4 5 6 7
Force (N)
- 1485 -
Proceedings ICMC|SMC|2014 14-20 September 2014, Athens, Greece
(a) (b)
(a) (b)
Each area of the sensor is a derivative of a voltage The guitar audio is recorded from a Gibson Les Paul
divider, illustrated in Figure 7, where each conductive ring thanks to a hexaphonic pickup. The sound is amplified by
acts as an output and is connected to a voltage follower the RMC Poly-Drive II and split in six jacks by the RMC
and a second-order Butterworth-like filter to prevent Fanout Box. Finally, those six signals are gathered by the
aliasing when the microcontroller samples the output soundcard MOTU UltraLite MK3 and sent to the computer
voltages. This circuit has been analyzed and the variable through the USB port. The audio can then be analyzed in
resistances are inferred from the output voltages. Max/MSP or recorded for further examination.
- 1486 -
Proceedings ICMC|SMC|2014 14-20 September 2014, Athens, Greece
Normalized Magnitude
Normalized Pressure
synchronized. Actually it is impossible to know 0.05
automatically the delay between the two recordings 0.5
because they are not sampled by the same processor. The 0.4
0.04
pressure dataset is sampled by the ADC converter and
0.03
time-stamped by the OSC protocol but the internal clock 0.3
of the microcontroller is not the same as the one on the 0.2 0.02
computer. The synchronization is thus made manually by
hitting the E2 string at the beginning of the recording and 0.1 0.01
realigning of the peaks in both datasets. 0 0
44.5 45 45.5 46 46.5
Time (s)
3.2 Sensor Response to the Rolling of the Palm (a)
1
The second test consists of rolling the palm along the Normalized Pressure Intensity
RMS Audio Envelope 0.06
sensor and measuring its response. This experiment is
Normalized Magnitude
Normalized Pressure
interesting because it illustrates the distribution of the 0.8 0.05
pressure along the strings when the hand stands in
0.6 0.04
different positions. The results are shown in Figure 9,
where the time flows on the y-axis and where the x-axis 0.03
corresponds to each four areas of the sensors (1 is the 0.4
closest to the bridge and 4 is the closest to the bridge 0.02
pickup). In this case the hand applied a strong pressure 0.2
0.01
near the bridge (represented by the warmer colors on the
graph) and slightly rolled off towards the bridge pickup 0 0
26.6 26.8 27 27.2 27.4 27.6 27.8
until 44 seconds, before rolling back to the bridge. One Time (s)
can observe that the pressure applied on the first, second
(b)
and fourth area of the sensor is more intense as the hand
rolls off close to the pickup. However, the third area 1
Normalized Pressure Intensity
remains more or less constant and a less intense pressure RMS Audio Envelope 0.06
Normalized Magnitude
is applied on it. This can be explained by the complexity
Normalized Pressure
0.8 0.05
of the side of the hand that applies the palm muting: the
interaction between the location of muscles, the 0.6 0.04
malleability of the skin and the distribution of the pressure
that balances the hand on the guitar could explain this 0.03
0.4
observation and further explorations are required to
0.02
understand this phenomena.
0.2
0.01
0 0
33.5 34 34.5 35 35.5 36
Time (s)
(c)
- 1487 -
Proceedings ICMC|SMC|2014 14-20 September 2014, Athens, Greece
divide each drop into three main phases: as the sensor is low-latency. This could lead to the
rehabilitation of the playing of guitarists that suffer from
Just before the string is picked, the pressure injuries. Moreover, the study of the anticipatory gesture of
intensity starts to fall slightly: this is probably due the downward and upward picking is interesting as it
to the movement of the hand that anticipates the could be a way to predict the attack of the string.
picking by positioning the fingers adequately. Therefore, the observation of the sensor curves can give
relevant information about the sound produced and the
When the string is picked, the pressure intensity
behavior of the hand, such as the intensity and the position
quickly falls to a lower value. Indeed, when
of the pressure that produce a certain damped sound, or
guitarists play a string, they need to do it briefly
even knowing the strength of the attack by analyzing the
with a certain force to produce a good sound. The
steepness of the drop in pressure when picking.
hand can therefore be seen as a pivot where its
Finally the experiment consisting of rolling the hand
applied force is distributed between the strain
along the sensor shows that the distribution of the pressure
applied on the string and the movement required to
when palm muting is a complex problem that requires
play a note.
further work: damping heavily the string by rolling off the
After the string is picked, the pressure still hand towards the bridge pickup does not simply translate
continues to drop during a certain time. In fact, the the pressure intensity towards the pickup. The extraction
hand keeps an inertia (momentum) after picking the of correlations between the intensity and the position of
string and then needs to be positioned to anticipate the applied pressure is consequently more difficult that
the next attack. has been imagined and necessitates a better understanding
of the behavior of the hand motion of guitarists.
The same phases are observable on the upward picking
pressure set in Figure 10b and differentiating the two sets
requires further analysis. However, the pressure data set 5. CONCLUSION
of the alternate picking differs from the two first ones. In order to analyze the palm muting technique, we built a
Indeed, alternate picking is performed by strictly pressure sensor that can measure the pressure applied by
alternating downward and upward picking strokes in a the palm on the strings. Then we refined the sensor and
continuous flow. This guitar technique is important explored the integration challenges of that kind of device
because it is the most common method of plectrum on a popular guitar, a Gibson Les Paul. Our experiments
playing. If the two first cases presented a similar behavior, clearly showed that it could sense the palm pressure
the plot of the normalized pressure intensity over time of accurately. Moreover the results that we obtained gave
the alternate picking, shown in Figure 10c, is expected to interesting information about the behavior of the picking
give a slightly different result. Indeed, if in upward or hand, such as a slight release of the pressure before
downward picking, the hand must anticipate the gesture picking the string or that the distance of the hand from the
before the attack, alternate picking allows continuous bridge is more important than the applied force. These
attacks of the string without positioning the hand between early experiments show us that this category of sensor will
each picking. One can observe that this is the case as each serve as an interesting platform for further research.
drop in pressure intensity is dividable in two phases:
when the string is picked and after the string is picked. Acknowledgments
The phase that is preliminary to the attack does not appear
in this plot. This informs our hypothesis that looking to Thanks to the University of Mons and the AIMs for the
the pressure profiles of a guitarist would be a way to sponsorship, to Gibson Guitars for the Les Paul, to John
recognize and study the playing of a guitarist. Moreover, MacCallum for the help given about o.dot and Colleen
as the sensor works in real-time, all this data could be McMahon for the drawings of Figures 1, 5, 7 and 8.
interpreted and visualized directly.
6. REFERENCES
4. DISCUSSION
[1] C. Cadoz and M. M. Wanderley, Gesture-music,
Our results clearly show that there is a correlation Trends in gestural control of music, vol. 12, p. 101,
between the sound of the guitar and the behavior of the 2000.
picking hand. The observation of the sensor values plotted
together with the signal energy shows that there is an [2] L. Kessous, J. Castet, and D. Arfib, GXtar, an
anticipation of the attack in the gesture made by the interface using guitar techniques, in Proceedings of
guitarist when he/she is palm-muting the string and the 2006 conference on New interfaces for musical
picking in one direction (downward or upward). When the expression. IRCAM Centre Pompidou, 2006, pp.
guitarist alternately picks the string, this anticipatory 192195.
gesture seems to disappear as the hand strictly goes up
and down to pick the string. These results mean that it is [3] K. A. McMillen, Computer input device for
conceivable to know specifically the style of picking polyphonic stringed instruments, in Proceedings of
performed by a guitarist when palm muting in real-time, the International Computer Music Conference. Ann
- 1488 -
Proceedings ICMC|SMC|2014 14-20 September 2014, Athens, Greece
- 1489 -