- Research article
- Open Access
Concordance between vocal and genetic diversity in crested gibbons
© Thinh et al; licensee BioMed Central Ltd. 2011
Received: 20 July 2010
Accepted: 7 February 2011
Published: 7 February 2011
Gibbons or small apes are, next to great apes, our closest living relatives, and form the most diverse group of contemporary hominoids. A characteristic trait of gibbons is their species-specific song structure, which, however, exhibits a certain amount of inter- and intra-individual variation. Although differences in gibbon song structure are routinely applied as taxonomic tool to identify subspecies and species, it remains unclear to which degree acoustic and phylogenetic differences are correlated. To trace this issue, we comparatively analyse song recordings and mitochondrial cytochrome b gene sequence data from 22 gibbon populations representing six of the seven crested gibbon species (genus Nomascus). In addition, we address whether song similarity and geographic distribution can support a recent hypothesis about the biogeographic history of crested gibbons.
The acoustic analysis of 92 gibbon duets confirms the hypothesised concordance between song structure and phylogeny. Based on features of male and female songs, we can not only distinguish between N. nasutus, N. concolor and the four southern species (N. leucogenys, N. siki, N. annamensis, N. gabriellae), but also between the latter by applying more detailed analysis. In addition to the significant correlation between song structure and genetic similarity, we find a similar high correlation between song similarity and geographic distance.
The results show that the structure of crested gibbon songs is not only a reliable tool to verify phylogenetic relatedness, but also to unravel geographic origins. As vocal production in other nonhuman primate species appears to be evolutionarily based, it is likely that loud calls produced by other species can serve as characters to elucidate phylogenetic relationships.
A striking feature of gibbon songs is the fact that they are species-specific and evolutionarily based. Hence, gibbon songs became a promising tool to identify the taxon affiliation and to describe evolutionary relationships among taxa [1–8]. However, it is also known that gibbon songs are not totally fixed and that they show a certain amount of inter- and a not well-described intra-individual variation [9–12]. Therefore, it remains unclear to what degree acoustic features can be used as taxonomic characters, especially when only subtle differences between populations or taxa are observed. For this, it would be necessary to conduct a systematic comparison of neighbouring populations across different taxa.
In most gibbon species, both males and females sing together [5, 13–15], while in a few species males make solo songs in addition to the duets. Until now only two species, the Kloss's gibbon (Hylobates klossii) and the silvery gibbon (H. moloch), are known where females and males produce solely solo songs [4, 6, 16, 17]. The structure of gibbon songs shows a clear adaptation to improved long-distance transmission. The energy is concentrated in single frequency bands. The frequency of their call elements exhibits only slow modulations and the frequency range of their song syllable lies in an optimized transmission range . With these features, gibbon songs differ from all vocalisations of other nonhuman primates, resembling more songs of typical rainforest birds. It is notable that they are also similar in their proposed functions, like territory advertisement, mate attraction, and strengthening pair bonds [19–25].
In this study, we aim to elucidate whether differences in song structure of six crested gibbon species and especially of the four closely related species, N. leucogenys, N. siki, N. annamensis and N. gabriellae, are persistent enough to be regarded as phylogenetic trait. Therefore, we recorded more than 400 male and female songs from 92 groups at 24 locations in Vietnam, Laos and Cambodia, and compared the extracted vocal features with gibbon mitochondrial cytochrome b gene sequences from 22 of the 24 populations . Further, we want to describe the relatedness between geographic origin and song similarity as well as genetic distance. We hypothesize that beyond intra- and inter-individual variation, song structure can be used to distinguish between populations and species, and that geographic distance between populations is highly correlated with their song structure.
General differences in song structure of crested gibbons
N. nasutus females produced fast up-down sweeps like a spiral spring with a vibrato sound on first two notes. Males produced staccato sounds during, before and after their multi-modulated phrases. All male notes started with almost unmodulated frequency, followed by a down sweep and a fast up sweep. Males of N. concolor produced their multi-modulated phrase immediately after the climax of the female great call. The first note of the male call had slightly ascending structure, followed by notes with fast down-up modulation (Figure 3, Additional File 1). Males of N. leucogenys gave regularly, loud staccato sounds, which appeared rarely in N. siki and N. annamensis, and were nearly absent in N. gabriellae. N. leucogenys could be distinguished from the three southern species by their great calls, which had a longer duration and a faster frequency modulation. Accordingly, only population 4 could be assigned to N. leucogenys in all criteria, while other N. leucogenys populations (5-7) showed criteria which occurred also in N. siki and N. annamensis. N. siki populations (8-12) were more similar in their song structure to N. leucogenys than to N. annamensis populations (13-20). The main criteria to distinguish N. siki and N. annamensis songs were criteria 2 and 4 (Additional File 1). In contrast, we found higher similarities between N. annamensis populations and N. gabriellae (21-24). Here the main criteria were 3 and 5 (Additional File 1).
Acoustic discrimination of the four southern crested gibbon species
The stepwise DFA needed 14 out of the 53 acoustic parameters to achieve this classification result. The DFA included acoustic parameters of both sexes, six parameters of the multi-modulated male call (parameters: 1, 11, 14, 19, 23, 28) and eight parameters of the female great call (parameters: 31, 33, 34, 40, 41, 43, 47, 50; for description see Additional File 2). The scattergram (Figure 4) showed the separation of the 21 populations according to the first and second discriminant function, explaining 54.3% and 12.8% of variation, respectively. The first discriminant function, which mainly represents frequency characteristics of gibbon songs, separated populations 4-12 from populations 13-24. The second discriminant function, which represents temporal features of gibbon songs, separated populations 21-24 from all other populations. Already the first two functions achieved a good separation of the four species with the exception of one group in population 10, which was assigned to N. leucogenys instead of to N. siki.
We conducted hierarchical cluster analysis (CA) to verify the results of the DFA and to test whether a CA would come up with the same number of expected categories (i.e., species). Based on the acoustic song structure, the CA algorithm revealed a high concordance between the four species (Additional File 3). In total, the CA could correctly classify 68 out of 81 groups (84%). In the first cluster, N. siki groups clustered together with groups of N. leucogenys (6, 9-14) interspersed by two N. annamensis groups (33, 34). The second and third cluster comprised only of N. leucogenys and N. gabriellae groups, respectively. The fourth cluster comprised of N. annamensis groups interspersed by three N. gabriellae groups (72, 76, 77).
Correlation between vocal structure, genetic and geographic distance
Correlation between vocal similarity, genetic and geographic distance*
Distance matrices compared
Populations of collected samples
P(rxy-rand > = rxy-data)
Vocal vs Geographic
21 populations (vocal)
Genetic vs Geographic
19 populations (genetic and vocal)
Genetic vs Vocal
19 populations (genetic and vocal)
Genetic vs Vocal
4 species (genetic and vocal)
Acoustic analysis could confirm the concordance between song structure and phylogenetic relationships as obtained from mitochondrial sequence data. We found significant differences between the songs of N. nasutus, N. concolor and the four southern species, N. leucogenys, N. siki, N. annamensis and N. gabriellae. Although latter four species revealed only subtle differences in their songs, a detailed acoustic analysis was able to discriminate significantly between them. This relation was positively correlated with their genetic relatedness found by recent molecular studies [27–32]. In addition, we found a highly significant correlation between similarity in song structure and geographic distance.
Since the early study of Marshall and Marshall , we know that gibbon songs are an important trait of their taxonomic relationship [8, 10, 33]. In many cases, species could be distinguished by directly inspecting the spectrograms of their songs (see Figure 3). However, as can be seen in the same figure, closer related taxa can have very similar song structures. Although there are some studies on individual variation in gibbon songs [9, 11], there is no systematic study available to confirm whether individual variation or variation at group level is high enough to contradict a possible relation between song structure and genetic relatedness among closely related species. One reason for this lack of information could be the fact that the comparison of single neighbouring groups revealed unambiguous results. The few misclassifications in our study occurred only between neighbouring groups, whereas groups living far away from each other followed the rule, larger distance dissimilar song structure. It remains undecided whether these misclassifications between neighbouring groups in gibbons have a similar reason as in song birds. In many song bird species, neighbouring males tend to emphasis difference in their vocal repertoire . Song birds seem to use this principle of increased contrast as a tool to settle territory boundaries. However, song birds must learn their songs , whereas gibbons have a predominantly innate song structure. Therefore, their ability to produce more distinct songs in relation to their direct group neighbours should be limited. However, we do not know whether gibbons even follow such a rule. The dispersal pattern of males and females could be also an explanation for the misclassification between neighbouring groups. If neighbouring groups are genetically dissimilar then they should also differ in their acoustic structure. Again, we have no precise knowledge about the dispersal patterns of crested gibbons, although at least in a related species, the siamangs, females seem to disperse over longer distances than males . A last possibility is that the misclassification between neighbours is mainly due to the fact that songs of neighbouring groups are too similar and therefore cannot reliably be assigned to the correct group. However, the high significant relation between acoustic similarity, geographic distance and genetic relatedness showed that crested gibbon songs are a salient feature of their genetic relatedness. Accordingly, song structure is a promising tool to identify the taxon-affiliation of gibbon individuals or populations. This is of great importance, because samples from free-ranging gibbons for genetic analyses are difficult to be obtained and fur colouration, especially of female crested gibbons, is due to its extreme intra-taxon variability unreliable .
There are not many possibilities to explain our second finding, the high correlation between acoustic structure and geographic distance. The structure of animal vocalisations is under different selective forces, such as body size, habitat characteristic or different functions . However, gibbons are limited to forest habitats and the functions of their songs make it necessary to broadcast them over larger distances. Selection pressure forces under such closed habitat conditions an optimal adaptation of song structure (recently reviewed in ). Therefore, the influence of other factors is very limited and gene flow must have achieved the major influence on the structural variation in gibbon songs.
From our acoustic result we cannot conclude the origin of crested gibbons, because we have no evidence, which song structure is most ancestral. However, we found the largest differences in the song structure between the most northern and most southern species with successive gradation between them. This fits very well with the proposed hypothesis that the genus originated in the north and successively migrated to the south [28–30] (Figure 2A).
In this study, we have shown that in crested gibbons, vocal diversity correlates with genetic relatedness and geographic distance. Accordingly, acoustic analyses provide a reliable tool to support taxon-affiliation and to settle distributional ranges. Furthermore, the acoustic analysis is able to support proposed migration backgrounds. Because other nonhuman primate species have similar constraints in vocal production, it is likely that also in other primate species, loud calls can function as valuable tool to explain taxonomic relations and migration backgrounds.
Survey locations and data collection
In 2007 and 2008, we conducted field surveys in 24 protected areas in Vietnam, Laos and Cambodia (Figure 1, Additional File 4), and recorded songs from N. nasutus, N. concolor, N. leucogenys, N. siki, N. annamensis and N. gabriellae. Recordings in the range of N. hainanus were not conducted, but the species clearly differs in song structure from all others [5, 6]. Vocalisations were recorded in the early morning using a "listening post" approach based on described methods . When hearing calls, the time and direction was recorded with compass bearings on angle. With this information, it was possible to distinguish calls from different groups. Group positions were depicted on a map (1/50000) to enable changes in listening posts and to ensure the best coverage in obtaining different groups in the observation area. When doubtful whether the same or a nearby group was recorded, the data were excluded from further analysis. We used only 92 out of 175 recordings. In total, we analysed 440 great calls and 447 male calls from 92 different gibbon groups at 24 locations. To record songs, a digital solid state recorder MARANTZ PMD 660; (Marantz, Japan; sampling rate: 44.1 kHz, 16 bit amplitude resolution) and a Sennheiser directional microphone (K6 power module and ME66 recording head with MZW66 pro windscreen; Sennheiser, Wedemark, Germany) was used. Research complied with protocols approved by the National Forest Protection Department of Vietnam, the Cambodian Forestry Administration and the Lao Ministry of Agriculture and Forestry, and adhered to the legal requirements of the countries in which research was conducted. The study was carried out in compliance with respective animal care regulations and the principles of the American Society of Primatologists for the ethical treatment of nonhuman primates.
Crested gibbon songs consist of phrases from both sexes. Males produce three different phrases including boom, staccato and multi-modulated phrases, and females so-called great call phrases only (Figure 3). For the analysis we considered male phrases as fully developed if they consisted of two or more notes. Female phrases were considered as fully developed if they consisted of six or more notes. The criteria we used to describe the general differences in song structure are listed in Additional File 1.
We conducted two DFAs to statistically verify the observations as obtained from the general acoustic descriptions for the six analysed species and to test whether the four southern species, which are not separable by the general acoustic description, can be assigned correctly by the calculated acoustic parameters. We calculated mean values per group using 440 great calls and 447 multi-modulated male calls (population numbers 1-24, see Figure 1, Additional File 4). For the second DFA, including only the four southern species, we used group mean values from 410 great calls and 395 multi-modulated male calls. We analysed a total of 81 different groups from 21 populations (population numbers 4-24, Figure 1, Additional File 4). We standardized the acoustic parameters and conducted all 53 parameters to a stepwise DFA in SPSS 13 . The selection criterion for an acoustic parameter to be entered was p = 0.05 and p = 0.1 to be removed from the analysis. The assignment of songs to the different populations was cross-validated by the leaving-one-out method , which involves leaving out each of the cases in turn, calculating the functions based on the remaining n-1 cases and then classifying the left-out case. In addition, we carried out a CA in SPSS to evaluate the similarity in the acoustic structure of the 81 groups. We calculated the z-score variables of the 14 acoustic parameters selected by the stepwise DFA. As distance measure we used the Euclidean distance and cluster method 'between groups linkage'.
To test the statistical relationship between acoustic structure, and genetic and geographic distance matrices, we used a Mantel test as implemented in GenAlex . The vocal distance matrices for the four closely related species, N. leucogenys, N. siki, N. annamensis and N. gabriellae, were generated using the F values of pairwise distances in the stepwise DFA. The geographic distance matrices were calculated from the minimum distance of different groups between the 21 populations. Geographic coordinates were obtained via GPS. Genetic distances were generated using pairwise population F values between haplotypes of mitochondrial cytochrome b gene sequences by the distance function in GenAlex. Respective haplotypes were recently published by our group [28, 29] (GenBank: GU595000-GU595004 [N. leucogenys], GU321270, GU595005-GU595008 [N. siki], GU595009-GU595015 [N. annamensis], and GU595017-GU595022 [N. gabriellae]).
We are very grateful to the staff of the protected areas, in which field surveys were conducted and to local people in Vietnam, Laos and Cambodia who not only provided support in the administrative procedures but also took part in the field surveys. Many thanks to the authorities of Trung Khanh NR, the Che Tao and Muong Lao communities, Xuan Lien NR, Pu Huong NR, Vu Quang NP, Phong Nha-Ke Bang NP, Khe Ve NR, Huong Hoa NR, Da Krong NR, Phong Dien NR, Sao La NR, Bach Ma NP, Chu Mom Ray NP, Kon Ka Kinh NP, A Yun Pa NR, Bi Dup-Nui Ba NP, Ta Dung NR, Nam Kading NBCA, Xe Sap NBCA, Xe Pian NBCA and Phnom Prich WS, and to the National Forest Protection Department of Vietnam, the Lao Ministry of Agriculture and Forestry, and the Cambodian Forestry Administration for permits to conduct research. This study was conducted as PhD project in the frame of the WGL biodiversity network at the German Primate Center. The authors also wish to thank the United States Fish and Wildlife Service, and the Great Apes Conservation Fund for funding parts of this work.
- Haimoff EH: Gibbon songs an acoustical, organizational, and behavioural analysis. PhD thesis. 1983, Cambridge UniversityGoogle Scholar
- Haimoff EH, Gittins SP, Whitten AJ, Chivers DJ: A phylogeny and classification of gibbons based on morphology and ethology. The Lesser Apes. Evolutionary and Behavioural Biology. Edited by: Preuschoft H, Chivers DJ, Brockelman WY, Creel N. 1984, Edinburgh: Edinburgh University Press, 614-632.Google Scholar
- Marshall JT, Sugardjito J, Markaya M: Gibbons of the lar group: relationships based on voice. The Lesser Apes. Evolutionary and Behavioural Biology. Edited by: Preuschoft H, Chivers DJ, Brockelman WY, Creel N. 1984, Edinburgh: Edinburgh University Press, 533-541.Google Scholar
- Geissmann T: Evolution of communication in gibbons (Hylobatidae). PhD thesis. 1993, University of Zurich-IrchelGoogle Scholar
- Geissmann T, Dang NX, Lormeé N, Momberg F: Vietnam Primate Conservation Status Review. Part 1: Gibbons. 2000, Hanoi: Fauna and Flora InternationalGoogle Scholar
- Geissmann T: Duet-splitting and the evolution of gibbon songs. Biol Rev. 2002, 77: 57-76. 10.1017/S1464793101005826.View ArticlePubMedGoogle Scholar
- Geissmann T: Taxonomy and evolution of gibbons. Anthropology and Primatology into the Third Millennium. Edited by: Soligo C, Anzenberger G, Martin RD. 2002, New York: Wiley-Liss, 28-31.Google Scholar
- Konrad R, Geissmann T: Vocal diversity and taxonomy of Nomascus in Cambodia. Int J Primatol. 2006, 27: 713-745. 10.1007/s10764-006-9042-3.View ArticleGoogle Scholar
- Haimoff EH, Gittins SP: Individuality in the songs of wild agile gibbons (Hylobates agilis) of Peninsular Malaysia. Am J Primatol. 1985, 8: 239-247. 10.1002/ajp.1350080306.View ArticleGoogle Scholar
- Dallmann R, Geissmann T: Different levels of variability in the female song of wild silvery gibbons (Hylobates moloch). Behaviour. 2001, 138: 629-648. 10.1163/156853901316924511.View ArticleGoogle Scholar
- Dallmann R, Geissmann T: Individuality in the female songs of wild silvery gibbons (Hylobates moloch) on Java, Indonesia. Contrib Zool. 2001, 70: 41-50.Google Scholar
- Ruppel JC: Vocal diversity and taxonomy of Nomascus in Central Vietnam and Southern Laos. Int J Primatol. 2010, 31: 73-94. 10.1007/s10764-009-9384-8.View ArticleGoogle Scholar
- Groves CP: Systematics and phylogeny of gibbons. Gibbon and Siamang. Edited by: Rumbaugh DM. 1972, Basel and New York: Karger, 1-89.Google Scholar
- Chivers DJ: The lesser apes. Primate Conservation. Edited by: Prince Rainier III of Monaco, Bourne GH. 1977, London and New York: Academic Press, 539-598.View ArticleGoogle Scholar
- Haimoff EH, Chivers DJ, Gittins SP, Whitten AJ: A phylogeny of gibbons (Hylobates spp.) based on morphological and behavioural characters. Folia Primatol. 1982, 39: 213-237. 10.1159/000156079.View ArticlePubMedGoogle Scholar
- Marshall JT, Marshall ER: Gibbons and their territorial songs. Science. 1976, 193: 235-237. 10.1126/science.193.4249.235.View ArticlePubMedGoogle Scholar
- Geissmann T, Nijman V: Calling in wild silvery gibbon (Hylobates moloch) in Java (Indonesia): behaviour, phylogeny, and conservation. Am J Primatol. 2006, 68: 1-19. 10.1002/ajp.20203.View ArticlePubMedGoogle Scholar
- Schneider C, Hodges JK, Fischer J, Hammerschmidt K: Acoustic niches of Siberut primates. Int J Primatol. 2008, 29: 601-613. 10.1007/s10764-007-9181-1.View ArticleGoogle Scholar
- Mitani JC: The behavioral regulation of monogamy in gibbons (Hylobates muelleri). Behav Ecol Sociobiol. 1984, 15: 225-229. 10.1007/BF00292979.View ArticleGoogle Scholar
- Mitani JC: Responses of gibbons (Hylobates muelleri) to self, neighbor, and stranger song duets. Int J Primatol. 1985, 6: 193-200. 10.1007/BF02693653.View ArticleGoogle Scholar
- Raemaekers JJ, Raemaekers PM: Field playback of loud calls to gibbons (Hylobates lar): territorial, sex-specific and species-specific responses. Anim Behav. 1985, 33: 481-493. 10.1016/S0003-3472(85)80071-3.View ArticleGoogle Scholar
- Mitani JC: Territoriality and monogamy among agile gibbons (Hylobates agilis). Behav Ecol Sociobiol. 1987, 20: 265-269. 10.1007/BF00292179.View ArticleGoogle Scholar
- Cowlishaw G: Song function in gibbons. Behaviour. 1992, 121: 131-153. 10.1163/156853992X00471.View ArticleGoogle Scholar
- Geissmann T: Duet songs of the siamang, Hylobates syndactylus: II. testing the pair-bonding hypothesis during a partner exchange. Behaviour. 1999, 136: 1005-1039. 10.1163/156853999501694.View ArticleGoogle Scholar
- Geissmann T, Orgeldinger M: The relationship between duet songs and pair bonds in siamangs, Hylobates syndactylus. Anim Behav. 2000, 60: 805-809. 10.1006/anbe.2000.1540.View ArticlePubMedGoogle Scholar
- Geissmann T: Status reassessment of the gibbons: results of the Asian primate red list workshop 2006. Gibbon J. 2007, 3: 5-15.Google Scholar
- Roos C, Thanh VN, Walter L, Nadler T: Molecular systematics of Indochinese primates. Vietn J Primatol. 2007, 1: 41-53.Google Scholar
- Thinh VN, Mootnick AR, Geissmann T, Li M, Ziegler T, Agil M, Moisson P, Nadler T, Walter L, Roos C: Mitochondrial evidence for multiple radiations in the evolutionary history of small apes. BMC Evol Biol. 2010, 10: e74-10.1186/1471-2148-10-74.View ArticleGoogle Scholar
- Thinh VN, Rawson B, Hallam C, Kenyon M, Nadler T, Walter L, Roos C: Phylogeny and distribution of crested gibbons (genus Nomascus) based on mitochondrial cytochrome b gene sequence data. Am J Primatol. 2010, 72: 1047-1054. 10.1002/ajp.20861.View ArticlePubMedGoogle Scholar
- Thinh VN, Mootnick AR, Thanh VN, Nadler T, Roos C: A new species of crested gibbon, from the central Annamite mountain range. Vietn J Primatol. 2010, 4: 1-12.Google Scholar
- Roos C: Molecular evolution and systematics of Vietnamese primates. Conservation of Primates in Vietnam. Edited by: Nadler T, Streicher U, Long HT. 2004, Frankfurt: Frankfurt Zoological Society, 23-28.Google Scholar
- Monda K, Simmons RE, Kressirer P, Su B, Woodruff DS: Mitochondrial DNA hypervariable region-1 sequence variation and phylogeny of the concolor gibbons, Nomascus. Am J Primatol. 2007, 69: 1-22. 10.1002/ajp.20439.View ArticleGoogle Scholar
- Brockelman WY, Schilling D: Inheritance of stereotyped gibbon calls. Nature. 1984, 312: 634-636. 10.1038/312634a0.View ArticlePubMedGoogle Scholar
- Catchpole CK, Slater PJB: Bird Song. 2008, Cambridge: Cambridge University PressView ArticleGoogle Scholar
- Brainard M, Doupe A: What songbirds teach us about learning?. Nature. 2002, 417: 351-358. 10.1038/417351a.View ArticlePubMedGoogle Scholar
- Lappan S: Patterns of dispersal in Sumatran siamangs (Symphalangus syndactylus): preliminary mtDNA evidence suggests more frequent male than female dispersal to adjacent groups. Am J Primatol. 2007, 69: 692-698. 10.1002/ajp.20382.View ArticlePubMedGoogle Scholar
- Wich SA, Schel AM, De Vries H: Geographic variation in Thomas langur (Presbytis thomasi) loud calls. Am J Primatol. 2008, 70: 1-9. 10.1002/ajp.20527.View ArticleGoogle Scholar
- Ey E, Fischer J: The "Acoustic Adaptation Hypothesis" - a review of the evidence from birds, anurans and mammals. Bioacoustics. 2009, 19: 21-48.View ArticleGoogle Scholar
- Brockelman WY, Ali R: Methods of surveying and sampling forest primate populations. Primate Conservation in the Tropical Rain Forest. Edited by: Marsh CW, Mittermeier RA. 1987, New York: Alan R Liss, 23-62.Google Scholar
- Jacqueline JM, Willem JH: SPSS Categories® 13.0SPSS Inc. Chicago. 2003Google Scholar
- Peakall R, Smouse PE: GenAlEx 6: genetic analysis in excel: population genetic software for teaching and research. Mol Ecol Notes. 2006, 6: 288-295. 10.1111/j.1471-8286.2005.01155.x.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.