Automatic lyrics alignment for Cantonese popular music
Identifieur interne : 000279 ( PascalFrancis/Checkpoint ); précédent : 000278; suivant : 000280Automatic lyrics alignment for Cantonese popular music
Auteurs : CHI HANG WONG [Hong Kong] ; WAI MAN SZETO [Hong Kong] ; KIN HONG WONG [Hong Kong]Source :
- Multimedia systems [ 0942-4962 ] ; 2007.
Descripteurs français
- Pascal (Inist)
English descriptors
- KwdEn :
Abstract
From lyrics-display on electronic music players and Karaoke videos to surtitles for live Chinese opera performance, one feature is common to all these everyday functionalities: temporal synchronization of the written text and its corresponding musical phrase. Our goal is to automate the process of lyrics alignment, a procedure which, to date, is still handled manually in the Cantonese popular song (Cantopop) industry. In our system, a vocal signal enhancement algorithm is developed to extract vocal signals from a CD recording in order to detect the onsets of the syllables sung and to determine the corresponding pitches. The proposed system is specifically designed for Cantonese, in which the contour of the musical melody and the tonal contour of the lyrics must match perfectly. With this prerequisite, we use a dynamic time warping algorithm to align the lyrics. The robustness of this approach is supported by experiment results. The system was evaluated with 70 twenty-second music segments and most samples have their lyrics aligned correctly.
Affiliations:
Links toward previous steps (curation, corpus...)
Links to Exploration step
Pascal:07-0302216Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en" level="a">Automatic lyrics alignment for Cantonese popular music</title><author><name sortKey="Chi Hang Wong" sort="Chi Hang Wong" uniqKey="Chi Hang Wong" last="Chi Hang Wong">CHI HANG WONG</name><affiliation wicri:level="4"><inist:fA14 i1="01"><s1>Department of Computer Science and Engineering, The Chinese University of Hong Kong</s1><s2>Shatin, N.T</s2><s3>HKG</s3><sZ>1 aut.</sZ><sZ>2 aut.</sZ><sZ>3 aut.</sZ></inist:fA14><country>Hong Kong</country><placeName><settlement type="city">Sha Tin</settlement></placeName><orgName type="university">Université chinoise de Hong Kong</orgName></affiliation></author><author><name sortKey="Wai Man Szeto" sort="Wai Man Szeto" uniqKey="Wai Man Szeto" last="Wai Man Szeto">WAI MAN SZETO</name><affiliation wicri:level="4"><inist:fA14 i1="01"><s1>Department of Computer Science and Engineering, The Chinese University of Hong Kong</s1><s2>Shatin, N.T</s2><s3>HKG</s3><sZ>1 aut.</sZ><sZ>2 aut.</sZ><sZ>3 aut.</sZ></inist:fA14><country>Hong Kong</country><placeName><settlement type="city">Sha Tin</settlement></placeName><orgName type="university">Université chinoise de Hong Kong</orgName></affiliation></author><author><name sortKey="Kin Hong Wong" sort="Kin Hong Wong" uniqKey="Kin Hong Wong" last="Kin Hong Wong">KIN HONG WONG</name><affiliation wicri:level="4"><inist:fA14 i1="01"><s1>Department of Computer Science and Engineering, The Chinese University of Hong Kong</s1><s2>Shatin, N.T</s2><s3>HKG</s3><sZ>1 aut.</sZ><sZ>2 aut.</sZ><sZ>3 aut.</sZ></inist:fA14><country>Hong Kong</country><placeName><settlement type="city">Sha Tin</settlement></placeName><orgName type="university">Université chinoise de Hong Kong</orgName></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">INIST</idno><idno type="inist">07-0302216</idno><date when="2007">2007</date><idno type="stanalyst">PASCAL 07-0302216 INIST</idno><idno type="RBID">Pascal:07-0302216</idno><idno type="wicri:Area/PascalFrancis/Corpus">000338</idno><idno type="wicri:Area/PascalFrancis/Curation">000229</idno><idno type="wicri:Area/PascalFrancis/Checkpoint">000279</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a">Automatic lyrics alignment for Cantonese popular music</title><author><name sortKey="Chi Hang Wong" sort="Chi Hang Wong" uniqKey="Chi Hang Wong" last="Chi Hang Wong">CHI HANG WONG</name><affiliation wicri:level="4"><inist:fA14 i1="01"><s1>Department of Computer Science and Engineering, The Chinese University of Hong Kong</s1><s2>Shatin, N.T</s2><s3>HKG</s3><sZ>1 aut.</sZ><sZ>2 aut.</sZ><sZ>3 aut.</sZ></inist:fA14><country>Hong Kong</country><placeName><settlement type="city">Sha Tin</settlement></placeName><orgName type="university">Université chinoise de Hong Kong</orgName></affiliation></author><author><name sortKey="Wai Man Szeto" sort="Wai Man Szeto" uniqKey="Wai Man Szeto" last="Wai Man Szeto">WAI MAN SZETO</name><affiliation wicri:level="4"><inist:fA14 i1="01"><s1>Department of Computer Science and Engineering, The Chinese University of Hong Kong</s1><s2>Shatin, N.T</s2><s3>HKG</s3><sZ>1 aut.</sZ><sZ>2 aut.</sZ><sZ>3 aut.</sZ></inist:fA14><country>Hong Kong</country><placeName><settlement type="city">Sha Tin</settlement></placeName><orgName type="university">Université chinoise de Hong Kong</orgName></affiliation></author><author><name sortKey="Kin Hong Wong" sort="Kin Hong Wong" uniqKey="Kin Hong Wong" last="Kin Hong Wong">KIN HONG WONG</name><affiliation wicri:level="4"><inist:fA14 i1="01"><s1>Department of Computer Science and Engineering, The Chinese University of Hong Kong</s1><s2>Shatin, N.T</s2><s3>HKG</s3><sZ>1 aut.</sZ><sZ>2 aut.</sZ><sZ>3 aut.</sZ></inist:fA14><country>Hong Kong</country><placeName><settlement type="city">Sha Tin</settlement></placeName><orgName type="university">Université chinoise de Hong Kong</orgName></affiliation></author></analytic><series><title level="j" type="main">Multimedia systems</title><title level="j" type="abbreviated">Multimedia syst.</title><idno type="ISSN">0942-4962</idno><imprint><date when="2007">2007</date></imprint></series></biblStruct></sourceDesc><seriesStmt><title level="j" type="main">Multimedia systems</title><title level="j" type="abbreviated">Multimedia syst.</title><idno type="ISSN">0942-4962</idno></seriesStmt></fileDesc><profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>Acoustic signal</term><term>Algorithm</term><term>Cantonese</term><term>Chinese</term><term>Musical sound</term><term>Performance evaluation</term><term>Pitch(acoustics)</term><term>Robustness</term><term>Signal processing</term><term>Syllable</term><term>Synchronization</term><term>System design</term><term>Vocal signal</term><term>Warping</term></keywords><keywords scheme="Pascal" xml:lang="fr"><term>Chinois</term><term>Evaluation performance</term><term>Synchronisation</term><term>Signal vocal</term><term>Traitement signal</term><term>Algorithme</term><term>Syllabe</term><term>Tonie</term><term>Conception système</term><term>Son musical</term><term>Gauchissement</term><term>Robustesse</term><term>Signal acoustique</term><term>Cantonais</term></keywords></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">From lyrics-display on electronic music players and Karaoke videos to surtitles for live Chinese opera performance, one feature is common to all these everyday functionalities: temporal synchronization of the written text and its corresponding musical phrase. Our goal is to automate the process of lyrics alignment, a procedure which, to date, is still handled manually in the Cantonese popular song (Cantopop) industry. In our system, a vocal signal enhancement algorithm is developed to extract vocal signals from a CD recording in order to detect the onsets of the syllables sung and to determine the corresponding pitches. The proposed system is specifically designed for Cantonese, in which the contour of the musical melody and the tonal contour of the lyrics must match perfectly. With this prerequisite, we use a dynamic time warping algorithm to align the lyrics. The robustness of this approach is supported by experiment results. The system was evaluated with 70 twenty-second music segments and most samples have their lyrics aligned correctly.</div></front></TEI><inist><standard h6="B"><pA><fA01 i1="01" i2="1"><s0>0942-4962</s0></fA01><fA03 i2="1"><s0>Multimedia syst.</s0></fA03><fA05><s2>12</s2></fA05><fA06><s2>4-5</s2></fA06><fA08 i1="01" i2="1" l="ENG"><s1>Automatic lyrics alignment for Cantonese popular music</s1></fA08><fA11 i1="01" i2="1"><s1>CHI HANG WONG</s1></fA11><fA11 i1="02" i2="1"><s1>WAI MAN SZETO</s1></fA11><fA11 i1="03" i2="1"><s1>KIN HONG WONG</s1></fA11><fA14 i1="01"><s1>Department of Computer Science and Engineering, The Chinese University of Hong Kong</s1><s2>Shatin, N.T</s2><s3>HKG</s3><sZ>1 aut.</sZ><sZ>2 aut.</sZ><sZ>3 aut.</sZ></fA14><fA20><s1>307-323</s1></fA20><fA21><s1>2007</s1></fA21><fA23 i1="01"><s0>ENG</s0></fA23><fA43 i1="01"><s1>INIST</s1><s2>26256</s2><s5>354000149912370020</s5></fA43><fA44><s0>0000</s0><s1>© 2007 INIST-CNRS. All rights reserved.</s1></fA44><fA45><s0>29 ref.</s0></fA45><fA47 i1="01" i2="1"><s0>07-0302216</s0></fA47><fA60><s1>P</s1></fA60><fA61><s0>A</s0></fA61><fA64 i1="01" i2="1"><s0>Multimedia systems</s0></fA64><fA66 i1="01"><s0>DEU</s0></fA66><fC01 i1="01" l="ENG"><s0>From lyrics-display on electronic music players and Karaoke videos to surtitles for live Chinese opera performance, one feature is common to all these everyday functionalities: temporal synchronization of the written text and its corresponding musical phrase. Our goal is to automate the process of lyrics alignment, a procedure which, to date, is still handled manually in the Cantonese popular song (Cantopop) industry. In our system, a vocal signal enhancement algorithm is developed to extract vocal signals from a CD recording in order to detect the onsets of the syllables sung and to determine the corresponding pitches. The proposed system is specifically designed for Cantonese, in which the contour of the musical melody and the tonal contour of the lyrics must match perfectly. With this prerequisite, we use a dynamic time warping algorithm to align the lyrics. The robustness of this approach is supported by experiment results. The system was evaluated with 70 twenty-second music segments and most samples have their lyrics aligned correctly.</s0></fC01><fC02 i1="01" i2="X"><s0>001D04A05B</s0></fC02><fC02 i1="02" i2="X"><s0>001D04A05D</s0></fC02><fC03 i1="01" i2="X" l="FRE"><s0>Chinois</s0><s5>01</s5></fC03><fC03 i1="01" i2="X" l="ENG"><s0>Chinese</s0><s5>01</s5></fC03><fC03 i1="01" i2="X" l="SPA"><s0>Chino</s0><s5>01</s5></fC03><fC03 i1="02" i2="X" l="FRE"><s0>Evaluation performance</s0><s5>02</s5></fC03><fC03 i1="02" i2="X" l="ENG"><s0>Performance evaluation</s0><s5>02</s5></fC03><fC03 i1="02" i2="X" l="SPA"><s0>Evaluación prestación</s0><s5>02</s5></fC03><fC03 i1="03" i2="X" l="FRE"><s0>Synchronisation</s0><s5>03</s5></fC03><fC03 i1="03" i2="X" l="ENG"><s0>Synchronization</s0><s5>03</s5></fC03><fC03 i1="03" i2="X" l="SPA"><s0>Sincronización</s0><s5>03</s5></fC03><fC03 i1="04" i2="X" l="FRE"><s0>Signal vocal</s0><s5>04</s5></fC03><fC03 i1="04" i2="X" l="ENG"><s0>Vocal signal</s0><s5>04</s5></fC03><fC03 i1="04" i2="X" l="SPA"><s0>Señal vocal</s0><s5>04</s5></fC03><fC03 i1="05" i2="X" l="FRE"><s0>Traitement signal</s0><s5>05</s5></fC03><fC03 i1="05" i2="X" l="ENG"><s0>Signal processing</s0><s5>05</s5></fC03><fC03 i1="05" i2="X" l="SPA"><s0>Procesamiento señal</s0><s5>05</s5></fC03><fC03 i1="06" i2="X" l="FRE"><s0>Algorithme</s0><s5>06</s5></fC03><fC03 i1="06" i2="X" l="ENG"><s0>Algorithm</s0><s5>06</s5></fC03><fC03 i1="06" i2="X" l="SPA"><s0>Algoritmo</s0><s5>06</s5></fC03><fC03 i1="07" i2="X" l="FRE"><s0>Syllabe</s0><s5>07</s5></fC03><fC03 i1="07" i2="X" l="ENG"><s0>Syllable</s0><s5>07</s5></fC03><fC03 i1="07" i2="X" l="SPA"><s0>Sílaba</s0><s5>07</s5></fC03><fC03 i1="08" i2="X" l="FRE"><s0>Tonie</s0><s5>08</s5></fC03><fC03 i1="08" i2="X" l="ENG"><s0>Pitch(acoustics)</s0><s5>08</s5></fC03><fC03 i1="08" i2="X" l="SPA"><s0>Altura sonida</s0><s5>08</s5></fC03><fC03 i1="09" i2="X" l="FRE"><s0>Conception système</s0><s5>09</s5></fC03><fC03 i1="09" i2="X" l="ENG"><s0>System design</s0><s5>09</s5></fC03><fC03 i1="09" i2="X" l="SPA"><s0>Concepción sistema</s0><s5>09</s5></fC03><fC03 i1="10" i2="X" l="FRE"><s0>Son musical</s0><s5>10</s5></fC03><fC03 i1="10" i2="X" l="ENG"><s0>Musical sound</s0><s5>10</s5></fC03><fC03 i1="10" i2="X" l="SPA"><s0>Sonido musical</s0><s5>10</s5></fC03><fC03 i1="11" i2="X" l="FRE"><s0>Gauchissement</s0><s5>11</s5></fC03><fC03 i1="11" i2="X" l="ENG"><s0>Warping</s0><s5>11</s5></fC03><fC03 i1="11" i2="X" l="SPA"><s0>Torcimiento</s0><s5>11</s5></fC03><fC03 i1="12" i2="X" l="FRE"><s0>Robustesse</s0><s5>12</s5></fC03><fC03 i1="12" i2="X" l="ENG"><s0>Robustness</s0><s5>12</s5></fC03><fC03 i1="12" i2="X" l="SPA"><s0>Robustez</s0><s5>12</s5></fC03><fC03 i1="13" i2="X" l="FRE"><s0>Signal acoustique</s0><s5>31</s5></fC03><fC03 i1="13" i2="X" l="ENG"><s0>Acoustic signal</s0><s5>31</s5></fC03><fC03 i1="13" i2="X" l="SPA"><s0>Señal acústica</s0><s5>31</s5></fC03><fC03 i1="14" i2="X" l="FRE"><s0>Cantonais</s0><s4>CD</s4><s5>96</s5></fC03><fC03 i1="14" i2="X" l="ENG"><s0>Cantonese</s0><s4>CD</s4><s5>96</s5></fC03><fC03 i1="14" i2="X" l="SPA"><s0>Cantonés</s0><s4>CD</s4><s5>96</s5></fC03><fN21><s1>197</s1></fN21><fN44 i1="01"><s1>OTO</s1></fN44><fN82><s1>OTO</s1></fN82></pA></standard></inist><affiliations><list><country><li>Hong Kong</li></country><settlement><li>Sha Tin</li></settlement><orgName><li>Université chinoise de Hong Kong</li></orgName></list><tree><country name="Hong Kong"><noRegion><name sortKey="Chi Hang Wong" sort="Chi Hang Wong" uniqKey="Chi Hang Wong" last="Chi Hang Wong">CHI HANG WONG</name></noRegion><name sortKey="Kin Hong Wong" sort="Kin Hong Wong" uniqKey="Kin Hong Wong" last="Kin Hong Wong">KIN HONG WONG</name><name sortKey="Wai Man Szeto" sort="Wai Man Szeto" uniqKey="Wai Man Szeto" last="Wai Man Szeto">WAI MAN SZETO</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Musique/explor/OperaV1/Data/PascalFrancis/Checkpoint
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000279 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/PascalFrancis/Checkpoint/biblio.hfd -nk 000279 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Musique
|area= OperaV1
|flux= PascalFrancis
|étape= Checkpoint
|type= RBID
|clé= Pascal:07-0302216
|texte= Automatic lyrics alignment for Cantonese popular music
}}
| This area was generated with Dilib version V0.6.21. |  |