Documente Academic
Documente Profesional
Documente Cultură
ging People and Sound: 12th International Symposium, CMMR 2016, São Paulo, Brazil, July 5–8, 2016, Revised
rs (pp.22-40)
FEATURED VIDEOS
gh Network Visualization Techniques
usseaux
niversité de Reims Champagne-Ardenne
sic analysis and graph visualization, we propose tonal pitch representations from the chromatic scale. On the first
t, a 12-node graph is connected as a Rhythm Network and visualized with a Circular Layout, commonly known
This particular graph topology focuses on node structure and gives strength to weak edges. At this occasion,
rity Threshold, giving an opportunity to isolate structure from singular parts of melodies. Where usual Pitch
n chords, we focus on successive pitch intervals. On the second part, we propose a rhythm representation using
ut. In addition to structural information, our second technique shows proximal and peripheral elements. This
6 melodies that we propose to visualize using Gephi.
research
bers
cations
rojects
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 1/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
1 My Eyes, my Ears
When music turns visual, it gives artists and listeners new senses to express them-
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 2/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
on the graph structure and the message it is supposed to deliver. In the scope
of Pitch Constellation or Krenek diagram, our experiment focuses on Pitch In-
tervals represented using circular layouts. Where usual implementations of pitch
constellation, concern the study of harmony [23] [13] [26], we deliver an explo-
ration of successive pitches.
The graph structure is explained in next section 2.1. It is called Rhythm
Network, but in this experiment we focus on structural aspects rather than on
temporal metrics. Rhythm Network is a graph structure focusing on time interval
between events. It was first designed by Guillaume Blot in the context of a digital
agenda where correlations between events were identified. It was also studied in
other contexts such as E-learning systems and Road Traffic Management [6] [5].
Following the paradigm strength of weak ties [22], the network is composing with
pitches, rewarding node presence before node occurrence. As a result, a pattern
appearing once has the same impact on the structure, than a repeated pattern.
Hence, successive occurrences of the same pitch are not considered. Moreover, as
we are dealing with temporal metrics, Rhythm Network keeps no record of pitch
occurrences. In this context, analyzing and representing a melody, comes along
with specific computational and visual techniques, that we explain in section 3. In
subsection 3.2, we present a method to extract singularities from a composition.
Singularity is to be understood as a particular behavior in a piece of music, but
no attempt is made to treat the concept in the mathematical way. Then we rely
on key-finding techniques to validate our representations 3.3.
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 4/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
Fig. 1. Experiment workflow: format, organize and connect. We take a MIDI file as an
input and produce a GEXF graph document.
– Format: The goal of this first step is to transform the binary MIDI file into
a more readable text format. We use MIDICSV a program developed by
John Walker in 2004 and revised in 2008 1 . This program takes the MIDI
file as an argument and produces a CSV file with the details of the events
for each channel. For example a ”Note on” event looks like this: track, time,
Noteo nc , channel, note, velocity. Using this representation a C played 30
seconds after the start of the song will be written as follow: 2, 30, Noteo nc ,
0, 60, 127. Middle C is a 60 and all other notes are sequentially relatives to
this point on a chromatic scale. Once we know that a C is played on channel
0 at 30 seconds, we do not use the first and the last arguments: track and
velocity.
1
http://www.fourmilab.ch/webtools/midicsv/
– Organize: This step sorts all ”Note on” events in a descending chronological
order. Organization also comes along with a cleaning sub-task with two axes:
keeping only ”Note on” events and advancing in an octave-free mode. At the
end of this sequence, the CSV file only contains lines of triples (time, note,
channel), where notes are numbers between 0 and 11 (0 is a C and 11 is a
Cb). The PHP script that we developed has been made available with data
in a public package 2 . Two scripts are used: (1) organizing a specific channel
(organizeo ne.php) and (2) organizing all channels (organizea ll.php). In the
second mode, we keep the chronological descending organization, then two
notes played at the same time on different channels will be written one after
Graph Exchange XML Format (GEXF) is an open and extensible XML doc-
ument used to write network topologies. GEXF 1.2 specifications are published
by GEXF Working Group [1]. The last step of our workflow is producing a GEXF
file with 12 nodes and a variable number of weighted and directed connections.
and ending at the same node and crossing all edges exactly once. The chromatic
number of the graph is 2, which is the smallest number of colors needed to draw
nodes in a way that neighbors don’t share the same color.
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 6/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
Fig. 2. Two graph representations of the circle of fifths drew using Gephi. The two
graphs share same properties but node order is diverging (a) 7 semi-tones interval (b)
chromatic order.
The circular layout commonly used to draw the graph of fifths employs a very
specific order of nodes, with 7 semi-tones differential between 2 successive notes.
That is the foundation of the concept. But, we can draw other representations
of the same graph. For example, figure 2 (b) is a chromatic representation of the
graph of fifths. With the chromatic order, the circle becomes a regular dodeca-
gram, but the graph keeps all its properties. The dodecagram graph (chromatic
representation of the graph of fifths) is isomorphic to the cycle graph (classical
representation of the graph of fifths figure 2 (a)).
Switching from a circle to a dodecagram sends to the musician another mental
projection of the circle of fifths, based on the division of the chromatic scale. As a
matter of fact, the chromatic order (the order of the 12 notes of an octave on a pi-
ano) is widely spread in musician minds. Less spread is the circlar representation
of the octave, which goes by the name of Krenek diagram, pitch constellation,
pitch-class space, chromatic circle or clock diagrams. As in McCartin article, this
circular representation of the octave bears the name of Ernest Krenek, after the
composer has represented scales using polygons [9] [16]. This major feature of the
research field Geometry of Music, addresses issues in either music analysis and
music practice: pointing out nuances between playing modes [13], appreciating
distance between notes and between harmonics [18] [20] or finding symmetric
scales [23]. In the figure 3, we see the polygon shape of diatonic scales: (a) C
scale or Ionian mode and (b) A# scale. (c) and (d) focus on C, A#, Cm and
A#m chords. A simple look at the graphs informs that all major chords (c) are
triangle with the exact same distances and angles, differing from minor chords
triangle shape (d). In this configuration, pitch intervals have specific distance
and orientation. With some practice, it can be very simple to retrieve particular
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 7/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
3
https://marketplace.gephi.org/plugin/circular-layout
4
http://www.linktodata
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 8/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 9/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
Fig. 4. Representations of the same 1LM Rhythm Network while Singularity Threshold
(ST) is evolving. Number of connections is going down, when ST is rising. With ST =
2, a connection must be present at least twice in 1LM to be considered.
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 10/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
ST 0 2 3 5
AVG. Degree 3,583 2,667 2,25 0,917
AVG Path length 1,55 1,72 1,86 1,96
Density 0,326 0,242 0,205 0,083
Diameter 3 3 4 4
Table 2. Evolution of the graph characteristics depending on ST.
For each subtrack, we have created 6 Rhythm Networks with ST growing from
0 to 5. That makes 6 versions of 24 subtracks, leading to 144 GEXF files. Table
3 presents the number of connections or edges for the 144 graphs. Some melodies
have much more connections than others. For example, Memory 1ALL has 59
connections with ST=0 and My Band 4ALL has 41 connections with ST=0,
respectively density D1ALL = 0.44 and D4ALL = 0.31 , unlike less dense melodies
of the dataset: Cocaine D2LM = 0, 038 (ST=0), D2ALL = 0, 081 (ST=0), Forgot
about Dre D5ALL = 0.098. Using ST feature, our goal is to reveal the structure
of a melody. It makes no doubt that highly connected melodies density quickly
decreases when ST is iteratively incrementing; meanwhile less singular melodies
are remaining stable. In figure 6 are displayed the 4 variations of Memory, with
ST on horizontal axis and volume of the set E from the Rhythm Network on the
vertical axis. Trend lines give relevant hints: for 1ALL (curve (d) of Figure 6),
the slope is -7 and for 1LM (curve (a) of Figure 6), the slope is -7.5. Trend line
slopes from every subtrack are presented in last column of table 3.
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 11/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
We observe heavy slopes for dense graphs. We rely on these figures to cal-
culate the linear correlation coefficient, measuring the strength of association
between density and trend. The value of a linear coefficient ranges between -1
and 1. The greater is the absolute value of a correlation coefficient, the stronger
is the relationship. The association (density, trend) has a linear coefficient of
-0.89. This leads us to some assertions:
ST 0 1 2 3 4 5 Trend Slope
1LM 43 43 32 17 14 11 -7.5
1LMS 12 12 5 0 0 0 -2.9
1ARP 32 32 28 26 18 17 -3.4
1ALL 59 59 51 44 31 28 -7
2LM 5 5 3 3 3 3 -0.5
2LMS 2 2 0 0 0 0 -0.5
2BASS 10 10 10 10 9 9 -0.2
2ALL 11 11 11 11 10 10 -0.2
3LM 21 21 19 16 14 11 -2.1
3LMS 7 7 2 0 0 0 -1.7
3BASS 8 8 6 6 6 6 -0.5
3ALL 26 26 22 20 17 16 -2.3
4LM 33 33 23 16 14 13 -4.7
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 13/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 14/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 15/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
as a starting note. But Gm, the enharmonic equivalent is fitting the graph in
the same way. Then, up to this point two answers are possible: A# and Gm.
STEP 3: Breaking eventual ties: in order to discriminate A# and Gm, we
choose the most connected node. Then, following our visual key-finding method,
one should answer that the key of the lead melody sample Memory is A#. If at
step 2, the low density of the graph leads to more than 2 possibilities, this last
tie-breaking step should end up with a solution. For the bass channel of Takin
about a revolution, possible keys are G, Em, C , but we select key G. It is the
same process for the full song Cocaine, where we had to tie-break E and Am. We
have 2 examples where we were not able to decide. Cocaine lead melody pattern
only connects 3 nodes, and each node has the same degree. Same conflict for
Forgot about Dre, with a Lead melody in Gm or A#.
We have experimented our method through the 24 graphs and then compare
our results with other proven key-finding techniques. We used the Melisma Music
Analyzer to run KS and CBMS algorithms5 . Before going further, we wish to
point out that the two techniques KS and CBMS do not retrieve always the
same results. As a matter of fact, these algorithms have to deal with ambiguous
compositions as well. KS and CBMS have retrieved the same answer with a
ratio of 33%. Our method retrieves either KS or CBMS result with a ratio of
70%. This is a conclusive step of our experiment, where we highlight the fact
that connections between pitches render the melody structure. Once Rhythm
Network is created with the relevant configuration, a simple visual analysis of
the melody agrees with one the proven key-finding techniques in more than 2 of
3 cases.
But it does not imply that the last third is flawed. We even think that these
are pertinent results. Key-finding methods are tricky because it faces several
level of complexity: scale could change anytime during the song, melody could
be simple and present poor information to work on, musicians and composers
might play out of a scale or take upon themself the fact they play or write
accidental notes. However, a scale is a scale for a reason, then whatever happens,
if a musician does not work on the scale or if he thinks he is working on a scale
5
http://www.link.cs.cmu.edu/melisma/
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 16/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
but making accidentals, the resulting melody will inevitably have a scale or will
come close from an existing scale. Considering the 6 melodies where we do not
agree with proven techniques, our method is the one having less accidental note
(first three column of table 4). To make last comments, we see in table 4 that for
most of the results all 3 methods have close information in terms of composition
of scales. Moreover, we notice conflicts for these 6 examples, as almost all have
different results for the 3 techniques. The bassline of Forgot about Dre, is the
only example where KS and CBMS return same results (last column of table 4).
Until this point, we have studied a Pitch Interval-based method to visual-
ize melody structures. We have explored the versatility of dense melodies and
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 17/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 18/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
Attraction
kt
Fa (ni , nj ) = (1)
d(ni , nj )
Repulsion
4.3 Rhythm
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 19/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
sequence and of the song and of the scale. Then we have the same issues of Pitch
Constellations: some melodies don’t have enough nodes to understand the scale,
some others have to much nodes. But, here we are not focusing on scale finding
techniques, even is it is still possible to have visual information about it, as we
will see.
With the same philosophy, this technique gives central position to highly
d d A h h fi h h h k
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 20/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
connected nodes. As we have seen in the first sections, the Rhythm Network
See all › is focusing
Seeonall ›connectivity. That gives a visual convention: important nodes
Download citation Share Download full-text PDF
24 References 5 Figures
are central. Following this convention, we can find the key of the melody. A
quick look is enough. For some cases it is very clear, where for some we need the
support of size and colors 9. In addition to key, ForceAtlas2 helps us to identified
central chords. For the chord topology, it works the same as pitch constellations.
In addition, it places these chords on a scale from central to peripheral, giving a
hierarchical decomposition of triangles. For example, arpeggio piece of Memory
shows a recurrent DFG chord, but it also shows that this central chord tends
to be colored with an A, a A, a C, and sometimes with a D. Moreover, we see
to which patterns these nodes are connected. A is forming an ADG chord and
sometimes a AGD. Cocaine Lead melody has just one central chord, that we
also find in the overall song, but with two additional nodes. The whole is giving
3 triangles.
The example of Cocaine overall song is interesting, because we see that the
two peripheral nodes have not the same importance. A is close from its triangle
ADE and it is even touching D, where C is far from it. It is the case for My
Band Lead melody, Forgot about Dre Lead Melody Sample and song and Love
is All That’s Rhythm.
With a quick sight, we identify the topology of the rhythm. Even rhythms
tend to look like circles. For example, Talkin about a revolution is a relevant
example, where notes are played regularly on an eighth-note basis. Then, our
representation is close from a regular circle. Cocaine has a similar behavior. The
only difference is that an irregularity appends, with a C connected to the D.
Other rhythms are much more irregular. Rhythm structure impacts people be-
haviors and emotions. An even rhythm tends to bring monotonousness, where
uneven rhythms bring another energy and make people dancing or/and wonder-
ing. It is the case of My Band, Forgot about Dre, Memory and Love is All.
5 Conclusion
here the number of time that the pitch is used in a sequence), we still have a
relevant clue of the structure. In addition, we bring harmony and rhythm to
other contexts. Learning, collecting and driving are actions that implies these
two phenomenon: rhythm and harmony. Now, our next step is to work with our
presented techniques in those contexts.
Because giving visual proof is not reliable enough, we also analyzed our work
on a structural basis (average degree, density, trend). We were unable to repro-
duce some visual effects in the context of a written presentation. We encourage
to discover all interactive features powered by Gephi, using GEXF melodies
published along with our experiment: select pitch neighbors, have a walk on
melodic paths or also enjoy layout personalization. Going further, Rhythm Net-
work might be applicable to various music analysis and practices: music infor-
mation retrieval, interactive learning, music recommendation tools, augmented
musical instruments, auditory perception and cognition, music interface design,
production and composition tools or also intelligent music tutoring systems.
References
1. GEXF 1.2draft Primer. Gexf working group. march 2012.
2. L. Adamic and Glance N. The political blogosphere and the 2004 u.s election:
Divided they blog. In Proceedings of the 3rd international workshop on Link dis-
covery, pages 36–43, 2005.
3. The International MIDI Association. Standard midi-file format spec. 1.1. 2003.
4. Louis Bigo, Jean-Louis Giavitto, Moreno Andreatta, Olivier Michel, and Antoine
Spicher. Computation and visualization of musical structures in chord-based sim-
plicial complexes. In Jason Yust, Jonathan Wild, and John Ashley Burgoyne,
M i C f B l S i S t b 2005
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 23/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
Music Conference, Barcelona, Spain, September 2005.
See all › 21. Rockwell
See all › Birdcage flights: A persp ective on inter-cardinality voice leading,
Joti.
2009. 5 Figures Download citation Share Download full-text PDF
24 References
22. Granovetter M, Hirshleifer D, and Welch I. The strength of weak ties, 1973.
23. Yamaguchi Masaya. Masaya Music, New York, USA, May 2006.
24. Robine Matthias, Rocher Thomas, and Hanna Pierre. Improvements of symbolic
key finding methods. In International Computer Music Conference, 2008.
25. Madsen Soren Tjagvad and Widmer Gerhald. Key-finding with interval profiles.
In International Computer Music Conference, august 2007.
26. Go dfried Toussaint. Computational geometric aspects of rhythm, melody, and
voice-leading. Comput. Geom. Theory Appl., 43(1):2–22, jan 2010.
27. George Tzanetakis, Manjinder Singh Benning, Steven R. Ness, Darren Minifie, and
Nigel Livingston. Assistive music browsing using self-organizing maps. In Proceed-
ings of the 2Nd International Conference on PErvasive Technologies Related to
Assistive Environments, PETRA ’09, pages 3:1–3:7, New York, NY, USA, 2009.
ACM.
28. Szetoa Wai Man and Man Hon Wonga. A graph-theoretical approach for pattern
matching in post-tonal music analysis, 2006.
eferences (24)
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 24/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
Rocher
Musical Structures
us Graph Layout Algorithm for Handy Network Visualization Designed for the Gephi Software
le
Show more
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 25/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
Project
H2020 VERTIGO
Francis Rousseaux
Art in Industry
View project
Project
Intelligence territoriale
Houda Neffati · Jean-Jacques Girardot · Raul A Montenegro · [...] · Mylène Leitzelman
View project
Project
View project
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 26/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
In wireless communication field, repeaters are generally used to transmit weak signals between low-power users because they can pick
up weak signals. However, repeaters can interfere with one another unless they are far enough apart or transmit on sufficiently separated
frequencies. In order to determine the minimal number of repeaters in a circular flat area of a 40km radius which can ... [Show full
abstract]
Read more
Article
For two integers k and d with (k, d) = 1 and k ≥ 2d, let Gkd be the graph with vertex set {0, 1, ⋯, k-1} in which ij is an edge if and only if d
≤ |i-j| ≤ k-d. The circular chromatic number χc (G) of a graph G is the minimum of k/d for which G admits a homomorphism to Gkd. The
relationship between χc (G-v) and χc (G) is investigated. In particular, the circular chromatic number of Gkd-v for any ... [Show full
abstract]
Read more
Chapter
Without Abstract
Read more
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 27/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
An edge-weighted digraph (G →,ℓ) is a strict digraph G → together with a function ℓ assigning a real weight ℓ uv to each arc uv( ˙G →,ℓ) is
symmetric if uv is an arc implies that so is vu. A circular r-coloring of (G →,ℓ) is a function φ assigning each vertex of G → a point on a
circle of perimeter r such that, for each arc uv of G →, the length of the arc from φ(u) to φ(v) in the clockwise ... [Show full abstract]
Read more
Article
The circular chromatic number and the fractional chromatic number are two generalizations of the ordinary chromatic number of a graph.
A graph is called star extremal if its fractional chromatic number equals its circular chromatic number (also known as the star chromatic
number). This paper studies the star extremality of the circulant graphs whose generating sets are of the form {±1,±k}.
Read more
Discover more
© 2008-2020 ResearchGate GmbH. All rights reserved. Terms · Privacy · Copyright · Imprint
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 28/29
2/25/2020 (PDF) Melody and Rhythm Through Network Visualization Techniques
https://www.researchgate.net/publication/319863548_Melody_and_Rhythm_Through_Network_Visualization_Techniques 29/29