I HC QUC GIA H NI

TRNG I HC CNG NGH

L n Khu

TH NGHIM MT PHNG PHP TNG

HP TING NI T VN BN TING VIT

KHO LUN TT NGHIP I HC H CHNH QUY

Ngnh: Cng ngh thng tin

H NI - 2009

I HC QUC GIA H NI
TRNG I HC CNG NGH

L n Khu

TH NGHIM MT PHNG PHP TNG HP

TING NI TING VIT T VN BN

KHO LUN TT NGHIP I HC H CHNH QUY

Ngnh: Cng ngh thng tin

Cn b hng dn: TS. Bi Th Duy

H NI - 2009

Li cm n
Trc tin, ti mun gi li cm n su sc nht n thy gio ch nhim, TS.
Bi Th Duy, ngi tn tnh hng dn em trong sut qu trnh nghin cu kha
lun tt nghip cng qu trnh hc tp ti i hc Cng ngh.
Ti xin gi li cm n su sc n tt nhng thy c gio ca trng i hc
Cng ngh, nhng kin thc v kinh nghim qu bu m ti nhn c t thy c
trong sut bn nm ngi trn ging ng s l hnh trang tt nht gip ti vng bc
trong s nghip ca mnh.
Ti cng gi li cm n n tt c cc bn b, nhng ngi lun ng hnh,
ng vin, gip ti trong sut bn nm i hc.
Vi cc bn K50CA, K50KHMT v cc bn trong phng th nghim tng tc
ngi my, nhng trao i, gp ca cc bn v kha lun ny thc s gip ti rt
nhiu.
Cui cng, xin gi nhng li tri n n gia nh, nhng ngi thn yu nht ca
ti, lun quan tm, to iu kin cho ti.

Sinh vin

L n Khu

-i-

Tm tt
K t khi ra i, my tnh l mt cng c gip con ngi v cng hu ch.
Mc tiu bin my tnh thnh mt con ngi lm vic khng bit mt mi ang c
dn hon thin. Mt trng nhng yu cu thc hin c mc tiu l kh nng
my tnh c th c c cc vn bn hay c gi l tng hp ting ni. Trong
nhng nm qua, c nhiu nghin cu xung quanh ti tng hp ting ni. T y,
mt s h thng tng hp ting ni ra i v t hiu qu rt tt. Tuy vy, nhng h
thng ny ch yu phc v cho cc ngn ng thng dng nh ting Anh, ting Php,
cn i vi ting Vit, cc h thng tng hp ting ni cha c pht trin nhiu.
Trong kha lun ny, ti mun th nghim mt h thng tng hp ting ni dnh
cho ting Vit.

- ii -

Mc lc
Li cm n ...........................................................................................................i
Tm tt................................................................................................................ii
Mc lc ............................................................................................................. iii
Danh mc hnh nh .............................................................................................v
Danh mc bng biu...........................................................................................vi
Chng 1 Tng quan v h thng tng hp ting ni ..........................................1
1.1

Gii thiu ...............................................................................................1

1.2

ngha ca TTS ....................................................................................1

1.3

Qu trnh pht trin ca TTS trn th gii ..............................................2

1.4

TTS Vit Nam.....................................................................................2

1.5

Mc ch ca kha lun..........................................................................3

1.6

Cu trc ca kha lun ...........................................................................3

Chng 2 Cc phng php tng hp ting ni...................................................4

2.1

M hnh chung ca mt h thng TTS....................................................4

2.1.1

Phn tch vn bn ............................................................................4

2.1.2

Phn tch cch c...........................................................................5

2.1.3

To ra sng m thanh ......................................................................6

2.2

Phng php tng hp Formant .............................................................6

2.3

Cc phng php tng hp bng ghp ni..............................................8

2.3.1

Phng php tng hp bng ghp ni cc ting...............................8

2.3.2

Phng php tng hp bng ghp ni cc phone .............................9

2.3.3

Phng php tng hp bng ghp ni diphone ................................9

2.3.3.1 im pitch...............................................................................10
2.3.3.2 ng b im pitch theo min thi gian TD-PSOLA ..............11
2.4

Phng php m phng pht m ..........................................................12

- iii -

2.5

c im ca ting Vit .......................................................................13

2.6

Kt lun................................................................................................14

Chng 3 Xy dng TTS ting Vit s dng phng php ghp ni diphone ...16
3.1

Cc cng c thc hin ..........................................................................16

3.2

Ci t v to ra cc file khun mu .....................................................17

3.3

nh ngha tp phone ting Vit ...........................................................17

3.4

Xy dng tp cc diphone: ...................................................................22

3.4.1

Diphone gia m cm v ph m: .................................................23

3.4.2

Diphone gia m cm v nguyn m.............................................23

3.4.3

Diphone gia ph m v m cm ..................................................24

3.4.4

Diphone gia nguyn m v m cm.............................................24

3.4.5

Diphone gia ph m nguyn m ...............................................25

3.4.6

Diphone gia nguyn m ph m ...............................................26

3.5

Carrier v ngha ca n......................................................................26

3.6

nh x cc phone ting Vit sang ting Anh ........................................28

3.7

Thu m.................................................................................................29

3.8

nh nhn cc diphone ........................................................................30

3.9

Tm pitchmark......................................................................................30

3.9.1

Cc bc ly pitchmark tt .......................................................31

3.10

Kim th...........................................................................................32

3.11

Thm du cho ting Vit...................................................................32

Chng 4 Tng kt............................................................................................34

4.1

Kt qu thu c ..................................................................................34

4.2

Cc kh khn thch thc ......................................................................34

4.3

Cc hng nghin cu pht trin tip theo............................................35

Ti liu tham kho.............................................................................................36

- iv -

Danh mc hnh nh
Hnh 1 M hnh mt h thng tng hp ting ni.........................................................4
Hnh 2 M hnh 3 formant ni tip...............................................................................7
Hnh 3 M hnh 5 formant ca Klatt ............................................................................8
Hnh 4 im pitch trong phone..................................................................................10
Hnh 5 Ghp ni hai diphone .....................................................................................11
Hnh 6 Thut ton TD-PSOLA ..................................................................................12
Hnh 7 S thay i gi tr F0 ca cc thanh................................................................14
Hnh 8 S thay i gi tr F0 khi cc thanh i vi ch "chi".......................................14
Hnh 9 Biu din dng sng ca mt carrier v nh nhn diphone............................30
Hnh 10 Pitchmark ca sng "taa taa taa"...................................................................32

-v-

Danh mc bng biu

Bng 1 Cc nguyn m n ting Vit v tnh cht ....................................................18
Bng 2 Cc nguyn m i ca ting Vit v tnh cht...............................................19
Bng 3 Cc ph m ting Vit v tnh cht ................................................................21
Bng 4 Mt cch lit k cc diphone..........................................................................22
Bng 5 Phn loi cc phone .......................................................................................22
Bng 6 Diphone m cm ph m ............................................................................23
Bng 7 Diphone m cm nguyn m.......................................................................23
Bng 8 Diphone ph m m cm ............................................................................24
Bng 9 Diphone nguyn m m cm.......................................................................24
Bng 10 Diphone ph m nguyn m 1...................................................................25
Bng 11 Diphone ph m nguyn m 2...................................................................25
Bng 12 Diphone nguyn m ph m......................................................................26
Bng 13 Khai bo cc carrier .....................................................................................27
Bng 14 V d nh x phone ting Vit sang phone ting Anh ...................................28

- vi -

Chng 1 Tng quan v h thng tng hp ting ni

1.1 Gii thiu
Tng hp ting ni l vic to ra ting ni ca con ngi mt cch nhn to. Mt
h thng my tnh thc hin mc ch ny c gi l mt h thng tng hp ting
ni. Tng hp ting ni c th c thc hin bng bng phn mm hay nhng vo
phn cng ca my tnh.
Vic tng hp ting ni c th c thc hin bng nhiu phng php. Phng
php ph bin nht hin nay l phng php tng hp bng cch ghp ni cc on
ting ni nh hn c lu tr trong c s d liu. Vic lu tr c s d liu nhiu
hay t lm nh hng rt ln n kt qu thu c tt hay khng. i khi, v mc ch
cn phi gim ln ca c s d liu, ngi ta chp nhn lm gim cht lng ca
ting ni thu c trong mt mc cho php.
Cht lng ca mt h thng tng hp ting ni c nh gi da trn
ging i vi ting ni ca ngi tht v kh nng ngi nghe c th hiu c
ht ngha ca vn bn.
Mt h thng chuyn vn bn thnh ting ni (ting Anh l Text To Speech,
trong kha lun ny s c vit tt l TTS) l mt h thng c u vo l mt vn
bn v u ra l mt sng m thanh.

1.2 ngha ca TTS

Bi ton ny c rt nhiu ngha thc tin. Trn th gii, TTS ting Anh c
nhng ng dng ht sc thnh cng:
Gip ngi tn tt: y l ng dng c ngha ln nht ca TTS.
Trc y, ngi ta tng c cc loi bng ghi m cc cun truyn hay
sch dnh cho ngi tn tt. Tuy nhin s lng nhng loi sch, truyn
ny khng nhiu v cng vic c hin mt cch th cng v tn rt
nhiu thi gian. Vi s gip ca cc h thng TTS, cng vic c lm
t ng v cho hiu qu rt cao.
Cc thit b truyn thng a phng tin: Vi s pht trin v thnh cng
vt bc ca TTS cho ting Anh, cc phn mm hc ting Anh hay cc
t in in t cng s dng cc h thng TTS. Ngoi ra, cc tr chi
-1-

in t hin ny ng dng cng ngh ny rt rng ri.

Trong truyn thng: Mt trong nhng nguyn nhn gy ra nhiu tai nn xe
hi l ti x va li xe va c tin nhn. S vi s h tr ca TTS, ngi
li xe hon ton c th tp trung vo vic li xe m vn nghe c tin
nhn mnh nhn c. Ngoi ra, khi cng ngh GPRS cha pht trin th
vic check email khi phi i cng tc ti mt khu vc cha pht trin gp
rt nhiu kh khn. Khi ngi ta c nhng phn mm s dng TTS
check email qua in thoi di ng.
Hin nay, Vit Nam vic s dng cc h thng TTS vn cn cha nhiu.
Ch yu l vic c cc thng bo ti cc nh ga, sn bay hay ti c quan
nh nc c h thng xp hng.

1.3 Qu trnh pht trin ca TTS trn th gii

Ting ni nhn to c nghin cu trong mt thi gian di v c s tham gia
ca nhiu nh khoa hc. Nhng ngi u tin c tng v mt chic my c kh
nng ni c l Gerbert of Aurillac, Albertus Magnus (1198 1280) v Roger Bacon
(1214 1294). [18]
Tuy vy phi ti nm 1779, nh khoa hc ngi an Mch Christian
Kratzenstein mi xy dng thnh cng m hnh c kh tng hp 5 m /a/, /e/, /i/, /o/,
/u/. Thit b ny vn cha tng hp c mt cu ni hon chnh.
Thit b u tin c xem nh mt b tng hp ting ni l VODER (Voice
Operating Demonstrator) c nh khoa hc ngi M Homer Dulley gii thiu nm
1939 ti New York. H thng ny c th tng hp cc cu n gin nhng cn s iu
khin ht sc phc tp. [14]
Trong my thp k qua, cc h thng TTS c nhng bc pht trin vt bc.
Cht lng ca nhng h thng TTS c pht trin ngy cng cao v c ng
dng vi cc mc ch thng mi. a s cc h thng ny dnh cho ting Anh. Ngoi
ra, cng c mt s cc ngn ng khc nh ting Trung, ting Ty Ban Nha, nhng
ting Anh vn c nghin cu nhiu nht v vy ting Anh c h thng TTS chun
mc hn c.

1.4 TTS Vit Nam

TTS Vit Nam cng c nghin cu t kh lu. Hin nay c 2 chng
-2-

trnh thnh cng hn c l VnSpeech v VietSound.

Phn mm VnSpeech l h thng tng hp ting ni u tin ca Ting Vit,
phn mm ny s dng phng php tng hp Formant. H thng ny c th c c
hu ht cc m tit ting Vit mc nghe r tuy vy, mc t nhin khng cao.
Phn mm VietSound l phn mm c pht trin ti i hc Bch Khoa Thnh
ph H Ch Minh. Phn mm ny s dng gii thut TD-PSOLA dng tng hp cc
nguyn m n v phng php tng hp FORMANT tng hp cc ph m,
nguyn m v m vn n gin. Phn mm ny cng cha t n mc t nhin
gn ging vi ting ni con ngi. [2]
C hai phn mm trn u c nhc im l m thanh thu c ri rc, thiu t
nhin.

1.5 Mc ch ca kha lun

Mc ch ca kha lun ny l tm hiu v xy dng h thng tng hp ting ni
ting Vit da trn phng php ghp ni diphone. H thng cn c kh nng tng
hp mt ting ni c lin mch v c kh nng nghe hiu c.

1.6 Cu trc ca kha lun

Kha lun ny c trnh by thnh 4 chng. Chng 2 s nu ra l thuyt mt
h thng tng hp ting ni; cc phng php tng hp ting ni thng dng hin nay.
Da trn c im ring ca ting Vit, chng ta c th so snh v c s la chn
phng php tng hp ting ni cho ting Vit ph hp nht. Chng 3 s l cc bc
c th c th xy dng c mt h thng tng hp ting ni bng phng php
ghp ni diphone. Chng 4 s l tng kt cho ton b qu trnh th nghim phng
php ny.

-3-

Chng 2 Cc phng php tng hp ting ni

2.1 M hnh chung ca mt h thng TTS
Thng thng, h thng TTS bao gm 3 bc:
Phn tch vn bn
Phn tch cch c
To ra sng m thanh

Chia cc cm t

Ng iu
Vn bn

Phn tch
vn bn

di ngn

To
sng m

Ting ni

Phn tch
cch c

Hnh 1 M hnh mt h thng tng hp ting ni

2.1.1 Phn tch vn bn
Phn tch vn bn l vic chuyn cc k hiu, cc s, cc ch vit tt ra thnh cc
cu ch y . V d nh cu Phong tro sinh vin tnh nguyn do TW on TNCS
H Ch Minh pht ng c hng ng ca hn 10000 sinh vin trn c nc
cn phi c chuyn thnh Phong tro sinh vin tnh nguyn do Trung ng on
Thanh nin Cng sn H Ch Minh pht ng c hng ng ca hn mi nghn
sinh vin trn c nc.
thc hin vic phn tch vn bn tt, ta cn c:
Mt module chuyn s thnh dng ch vit.
Mt c s d liu cc ch vit tt thng dng.

-4-

 Mt c s d liu cc khun dng thng dng nh ngy thng, gi,

Tuy vy, ta cng s gp phi nhiu kh khn do nhng tnh hung nhp nhng.
V d nh cm 1/2 c th c hiu l ngy mng mt thng hai hoc mt phn
hai. Mt v d khc l khi ta gp mt dy s 38533580, ta cn phi xc nh xem
y l s m (ba mi tm triu nm trm ba mi ba ngn nm trm tm mi) hay
y l s in thoi (ba tm nm ba ba nm tm khng). Nhng trng hp nh th
ny i hi ta phi xc nh c vn cnh ca vn bn u vo.
2.1.2 Phn tch cch c
Vic phn tch cch c thc cht chnh l qu trnh tin x l cho vic tng hp
ting ni. V vy, qu trnh ny cn ph thuc vo vic chng ta s s dng phng
php no thc hin vic tng hp ting ni.
Cng phi ni thm rng ting Vit c mt thun li rt ln l mi cch vit ch
c mt cch c khng nh ting Anh mt cch vit c th c nhiu cch c ph
thuc vo ng cnh.
Nu vic tng hp ting ni c thc hin bng cc phng php ghp ni, th
vic bt buc i vi chng ta l phi phn chia cu cn tng hp thnh cc n v
c sn trong c s d liu ca chng ta. Hy xt v d ta cn tng hp cu Xin cho
bng phng php ghp ni diphone. Cc diphone c trong c s d liu l m
cm x, x i, i n, n m cm, m cm ch, ch , o. Khi ta
cn tch on text Xin cho thnh m cm x i n m cm ch o m
cm.
ting ni tng hp c thu c cht lng tt th phn tch ngn iu l v
cng quan trng. Ngn iu gm: cao thp, di ngn, cng .
cao thp (pitch) hay tn s trn mt cu ph thuc vo nhiu yu t trong
c loi cu (cu k, cu hi, cu cm thn); ngi ni (gii tnh, trng thi cm xc).
V d cu k thng thp ging cui cu cn cu hi li cao ging cui cu. Ngi
ni l nam thng ni vi cao thp hn.
di ngn (duration) l c im v thi gian pht m mt t hay mt m v.
Thng thng hai ting lin tip m to thnh t khong ngh gia hai ting s ngn
hn hai ting lin tip nhng khng to thnh mt t. i khi, di ngn cng c
th hin khi ngi ni mun nhn mnh mt t no trong cu. [2]
Cng th hin to nh ca ting ni. mc m tit, cc nguyn m

-5-

thng c cng mnh hn ph m. mc cm, cc m tit phn cui ca cch

pht m c th c cng yu hn.
Mt h thng TTS cn phn tch c cch c mc cng gn vi thc t cng
tt. y l mc tiu ca mi h thng TTS cho cc ngn ng khc nhau, tuy vy cha
c mt h thng no c th thc hin hon ho iu ny.
2.1.3 To ra sng m thanh
y l qu trnh trc tip to ra tn hiu m thanh. Cht lng ting ni tng hp
c ph thuc rt nhiu vo phn ny. Trn th gii c rt nhiu phng php
c a ra tng hp ting ni nh phng php tng hp Formant, phng php
ghp ni Diphone,
Cc phng php c th c chia lm 4 nhm:
Phng php tng hp da trn h lut: phng php Formant
Phng php tng hp bng ghp ni:
o Phng php tng hp bng ghp ni phones
o Phng php tng hp bng ghp ni na phones
o Phng php tng hp bng ghp ni diphone
Phng php tng hp da trn cc m hnh:
o Phng php tng hp da trn m hnh Markov n (HMM)
o Phng php tng hp da trn m hnh m ting ni v nhiu
(Harmonic plus Noise HNM)
Phng php tng hp da trn m phng pht m

2.2 Phng php tng hp Formant

Phng php ny cn c tn gi khc l phng php tng hp da trn h lut
(rule-based). y l phng php khng da vo nhng on ting ni thu sn ca
con ngi. Phng php tng hp Formant s s dng ting ni tng hp c to ra
da trn c s l thuyt m hc ca qu trnh to ting ni. Ph bin nht hin nay
chnh l m hnh ngun m b lc ( source-filter model) to ra c tn hiu ting
ni.
Formant l mt s cng hng m thanh. y chng ta c th hiu tn hiu

-6-

ting ni l kt qu ca ngun kch hu thanh hoc v thanh c cng hng hay

phn cng hng ca tuyn m, sau nh hng bi s tn x ca ting ni qua mi
v mi.
Phng php tng hp Formant u tin c Walter Lawrence a ra vo nm
1953, phng php ny s dng 3 formant c ni song song. 3 formant cng l s
lng formant ti thiu c th to ra c mt ting ni nghe c. Di y l
mt m hnh 3 formant c ni ni tip [14]:

Hnh 2 M hnh 3 formant ni tip

u vo ca m hnh ny l 12 tham s: tn s chung (F0), 3 tn s ca cc
Formant v 3 bin ca cc Formant, cng ca tn s thp, cng ca tn s
cao, Do c nhiu tham s nn vic iu khin l rt phc tp. Tuy vy, phng
php ny mi ch a ra c mt ting ni vi cht lng nghe c. Ting ni vn
cn ri rc, khng trn chu, lin mch hay ni cch khc l khng t nhin.
Nm 1980, Dennis Klatt a ra mt m hnh phc tp gm 5 formant v cn
ti 39 tham s iu khin v c cp nht 5 mili giy mt ln. Di y l m hnh
c Klatt a ra [14]:

-7-

Hnh 3 M hnh 5 formant ca Klatt

Cho n nay, y vn l m hnh tt nht cho phng php ny. Phng php
formant c nhng c im ni tri so vi cc phng php khc l khng cn phi
lu tr c s d liu, thi gian tng hp l rt nhanh. y l phng php hin nay rt
thch hp cho nhng ng dng trn cc thit b nh PDA, PC Pocket v c im ca
nhng thit b ny l phn cng yu.
Tuy nhin, phng php ny v mt cht lng ca ting ni vn khng tt.
Ting ni vn b ri rc, khng t nhin. Hn na, phng php ny rt kh xy dng.
Ta cn phi c mt s hiu bit su sc v mt m hc mi c th thc hin c
phng php ny.

2.3 Cc phng php tng hp bng ghp ni

Trong cc phng php ny, ting ni s c tng hp t cc on ting ni
nh hn c lu tr sn trong c s d liu. i vi ting Vit, c th l:
phone, diphone, ting,
2.3.1 Phng php tng hp bng ghp ni cc ting
R rng y l mt phng n khng kh thi, i vi ting Vit, s lng ting l
rt ln, iu ny lm cho c s d liu phi lu tr l rt ln. Mt nhc im na ca
cch lm ny l gia cc ting s khng c trn, do cc ting c thu ring bit ti
-8-

cc thi im khc nhau.

2.3.2 Phng php tng hp bng ghp ni cc phone
Phone: L m v hay chnh l n v m nh nht to ra ting ni. Thng thng
i vi mi ngn ng th mi ch ci trong bng ch ci l mt phone. Trong ting
Vit, ngoi cc phone l ch ci ra cn c cc phone l t hp ca cc ch ci nh: th;
gh; kh; gi; nh; ng; ngh m cm (silence) c th coi l mt phone c bit. Thng
thng mi m v c mt cch c ring, tuy nhin khng phi mi cch c ch tng
ng vi mt m v. Trong ting Vit, mt s m v c cch c ging nhau tuy cch
vit khc nhau (chng hn: ng v ngh, i v y, g v gh ).
S lng phone ca ting Vit c du l 95 phone v c s d liu ca ta ch cn
bao gm 95 phone ny. C th thy ngay c s d liu nh l mt u im ln ca
phng php ny.
Tuy vy, cht lng ting ni tng hp ca phng php ny li khng cao. Hy
xt v d cn tng hp cu Hai bn ht hay. T hai c ghp t cc phone
h, a, i. T hay c ghp t cc phone h, a, y. R rng trong c s d
liu cch c cc phone, h, a, i, y th phone i v phone y c cch c
ging ht nhau nhng khi ghp vi cc phone khc li cho ta hai cch c hon ton
khc nhau. Cch tng hp ny khng t c yu cu u tin ca mt h thng
tng hp ting ni l ting ni sinh ra phi hiu c, n lm thay i hon ton
ngha ca vn bn.
2.3.3 Phng php tng hp bng ghp ni diphone
y l phng php c pht trin t nhng nm 70 ca th k trc. Cho ti
nay, phng php ny l mt trong nhng phng php hiu qu nht v c ng
dng rng ri cho nhiu ngn ng.
Diphone: Mt diphone c bt u t im gia ca phone trc n im gia
ca phone sau trong hai phone ng cnh nhau ca mt cp phone. Vi mt t c th
c mt, hai hoc nhiu diphone. V d nh t ba ch c mt diphone l b a nhng t
ban c hai diphone l b a v a n. Cc t ch c mt phone c coi l mt diphone
ca phone vi m cm, chng hn t a c coi l mt diphone ca asilence.
Phng php tng hp diphone c thc hin theo 4 bc:
Lit k tt c cc phone v cc c tnh ca cc phone ny.

-9-

 Lit k tt c cc cch ghp ni cc cp phone-phone to thnh

diphone. Do c nhng cp phone-phone khng xut hin nn s lng
diphone khng bao gi qu bnh phng s lng phone.
Xy dng c s d liu cch c cho cc diphone ny.
Ghp ni cc diphone: y chnh l qu trnh quan trng nht ca phng
php ny. y, thut ton thng dng nht l ng b im pitch.

2.3.3.1 im pitch
im pitch (pitch mark) l im c tn s l cc i a phng trn mt sng
m. Di y l hnh nh v d v im pitch trong phone /u/.[15]

Hnh 4 im pitch trong phone

Gia hai diphone gn ghp ni vi nhau, bao gi ta cng c mt phone ging
nhau v d nh a b v b c. Vic chng ta cn lm l chnh sa sng m ca
phone b diphone th nht hoc diphone th hai hoc c hai diphone sau cho chng
c th chng kht c ln nhau.[15]

- 10 -

Hnh 5 Ghp ni hai diphone

Vic ghp ni hai diphone c th c thc hin bng thut ton PSOLA (pitch
synchronous overlap add) c gi l ng b im pitch.

2.3.3.2 ng b im pitch theo min thi gian TD-PSOLA

Ngi ta pht trin nhiu phin bn ca thut ton PSOLA nh: TD-PSOLA
(time domain pitch synchronous overlap add), MBROLA (multi band overlap add),
LP-PSOLA (linear pitch synchronous overlap add). Tt c cc phin bn ny u c
mt tng chung l sa i trc tip sng m thanh m khng s dng cc thng s
no ca n.
Thut ton TD-PSOLA c hng truyn thng Php pht trin vo u nhng
nm 1990 v da trn tng: Nu x(n) tun hon trong khong [, +] th ta c
th to ra mt sng mi s(n) t x(n) vi cc im pitch c dch chuyn t T0 v T
m ta mong mun. Thut ton c th hin bi cng thc bin i:

si (n) x (n) w(n iT0 )

s ( n)

s (n i(T T )
i

y w(x) l mt ca s c chn. C th hiu rng, s(P) mi ph thuc vo

cc im nm trong ca s ca x(P0) c m P0 v P l hai im tng ng ca sng
c v sng mi. Cch lm ny ngi ta chng minh c l bin sng khng b
thay i trong qu trnh bin i sng. [14]

- 11 -

Hnh 6 Thut ton TD-PSOLA

Trong hnh trn, tn hiu pha bn tri c gin ra khp vi cc im
pitch mong mun. Cc hnh bn phi l bin ng s tng ng v ta c th nhn thy
l bin ny khng b thay i.

2.4 Phng php m phng pht m

Tng hp m phng pht m l cc k thut tng hp ging ni da trn m hnh
my tnh ca c quan pht m ca ngi v qu trnh pht m xy ra ti . H thng
tng hp m phng pht m u tin l ASY c pht trin phng th nghim
Haskins vo gia nhng nm 1970 bi Philip Rubin, Tom Baer, v Paul Mermelstein.
Tng hp m phng pht m tng ch l h thng dnh cho nghin cu khoa hc
cho mi n nhng nm gn y. L do l rt t m hnh to ra m thanh cht lng
cao hoc c th chy hiu qu trn cc ng dng thng mi. Mt ngoi l l h thng
da trn NeXT; vn c pht trin v thng mi ha bi Trillium Sound Research
Inc, Canada. H thng to ra mt my tng hp ging ni da trn m phng pht m
hon chnh, da trn m hnh ng dn sng tng ng vi c quan pht m ca
ngi. N c iu khin bi M hnh Phn Ring bit ca Carr; bn thn m hnh
ny li da trn cng trnh ca Gunnar Fant v cc ngi khc Phng th nghim
Cng ngh Ging ni Stockholm thuc Vin Cng ngh Hong gia Thy in v tng
hp ging ni cng hng tn s. Cng trnh ny cho thy cc cng hng tn s
trong ng cng hng c th c iu khin bng cch thay i tm tham s tng
ng vi cc cch pht m t nhin ca c quan pht m ca ngi. H thng bao gm
- 12 -

mt t in pht m cng vi cc quy tc pht m ty thuc ng cnh gip ghp ni

m iu v to ra cc tham s pht m; m phng theo nhp iu v ng iu thu c
t cc kt qu nghin cu ng m hc. [18]
c th thc hin c phng php ny i hi thi gian, chi ph v cng
ngh. Phng php ny kh c th ng dng ti Vit Nam trong thi im hin nay.

2.5 c im ca ting Vit

i vi bi ton TTS, ting Vit so vi cc ngn ng khc c rt nhiu thun li.
Mi cch vit ch c duy nht mt cch c. Tuy nhin, mt trong nhng kh khn ln
nht ca ting Vit chnh l vn thanh iu. Vic mi nguyn m c 6 thanh
(ngang, sc, huyn, ng, hi, nng) li lm cho vic tng hp gp nhng kh khn
khc. Vic c khng du chng ta hu ht c th hiu c nhng nh vy vn c th
gy ra nhng hiu lm. Tuy nhin, nu ta sinh c sng m cho ting Vit khng
du, th ta c th bin i sng m thu c sng m th hin ting Vit c du.
Mt m tit ting Vit khi c c 5 loi m thanh: m u (ph m), m trung
bnh (bn nguyn m), m trung tm (nguyn m hoc nguyn m i), m cui
(nguyn m hoc bn nguyn m) v thanh iu (du). Khi thay cc thanh iu vo
cng t, gi tr F0 thay i nh sau: [3]
Vi thanh ngang, gi tr F0 bt u ln nht v duy tr cho ti khi kt thc
m tit.
Thanh huyn gi tr F0 bt u thp hn thanh ngang, thanh sc v thanh
ng.
Thanh ng gi tr F0 bt u cao, ti gia m tit th gim xung, v tng
ln cao nht khi n cui m tit. Trong hu ht cc trng hp, cc m
tit c thanh ng c gi tr F0 cc tiu ri vo khong gia n 2/3 ca F0
ti thi im ban u.
Thanh hi gi tr F0 gim dn n khong 2/3 gi tr F0 ban u ri tng
tr li.
Thanh sc gi tr F0 gi n nh trong khong 2/3 thi gian ca m tit ri
sau tng nhanh.
Thanh nng gi tr F0 gim nhanh v thi gian ko di thng ch bng
2/3 thi gian cc thanh khc.

- 13 -

Di y l th m t s bin thin ca gi tr F0 cc thanh v v d vi vic

ghi m ch chi cng vi 6 thanh ln lt l ngang, huyn, ng, hi, sc, nng.[9]

Hnh 7 S thay i gi tr F0 ca cc thanh

Hnh 8 S thay i gi tr F0 khi cc thanh i vi ch "chi"

2.6 Kt lun
Vi mc ch xy dng c mt h thng tng hp ting ni m m thanh thu
- 14 -

c phi c trn, t nhin cao nht, phng php ghp ni bng diphone l
vt tri hn c. Yu cu v trn v t nhin ca ting ni chnh l im mnh
ca phng php ny. Cc phng php khc u khng so snh c vi phng
php ghp ni diphone tiu ch ny. Hn na, phng php ny li c u im l
vic xy dng khng phc tp. V vy, ti quyt nh la chn phng php ghp ni
diphone xy dng h thng TTS ting Vit.
Cng vi nhng c im ca ting Vit trn, ti quyt nh p dng phng
php ny vi ting Vit khng du v thay i tn s chung F0 to ra thanh iu
(du) cho ting ni c tng hp.

- 15 -

Chng 3 Xy dng TTS ting Vit s dng phng

php ghp ni diphone
3.1 Cc cng c thc hin
Ti xy dng h thng TTS ting Vit da trn b cng c:
Speech Tools Library 2.0: y l mt tp hp cc lp, hm, i tng
c vit bng ngn ng C++ cn thit i vi x l m thanh. Th vin
ny gip ta c kh nng c, ghi, thay i cc sng m. Th vin cng
cung cp nhiu nh dng khc nhau cc file ch s nh (LPC, ceptra, F0)
v cc hm cn thit chuyn i gia cc nh dng . Th vin ny
c pht trin ti trung tm nghin cu ting ni thuc i hc
Edinburgh, Anh. [6]
Festvox 2.1 l b cng c ch yu c vit bng shell Linux v ngn ng
PERL h tr vic xy dng c s d liu phc v cho vic tng hp ting
ni. C s d liu c xy dng trn Festvox m bo c s tng
thch vi h thng tng hp ting ni Festival. B cng c ny c pht
trin ti i hc Carnegie Mellon, Hoa K. Mc ch pht trin ca h
thng ny l gip cho vic xy dng mt ging c mi hay mt ngn
ng mi tr nn d dng hn v mi ngi c th t xy dng mt ging
c cho ring mnh. [7]
Festival 1.96 c vit bng C++ c th coi l mt frame work tng hp,
cho php xy dng cc h thng tng hp ting ni bng cc phng php
khc nhau. Nhn ca h thng ny c th ni chnh l th vin Speech
Tools. Festival ng thi con cung cp sn nhng ging c chun ting
Anh gip cho nhng ngi s dng rt thun li trong vic xy dng mt
h thng TTS cho ngn ng khc. H thng ny ban u c pht trin
ti trung tm nghin cu ting ni thuc i hc Edinburgh, Anh. Hin
nay, h thng ny cn c pht trin ng thi bi trng i hc
Carnegie Mellon, Hoa K. [5]
C 3 cng c trn u l nhng phn mm m ngun m, c pht trin s
dng trn Linux. y l mt b cng c tng hp hon chnh dnh cho ting Anh.

- 16 -

3.2 Ci t v to ra cc file khun mu

Vic ci t cc cng c ny cng cn c ch :
Cn ci bn gcc c 2.7.2 bin dch Speech Tools Library.
Cn ci t Speech Tools trc, sau n Festvox ri mi n Festival.
Cn chnh li ng dn mc nh ca Festvox v Speech Tools.
Sau khi vic ci t hon tt, chng ta c th bt u xy dng h thng TTS
ting Vit bng lnh: $FESTVOXDIR/src/diphones/setup_diphone vnu vn ldk
to ra cc th mc v file khun mu phc v cho vic thc hin. Trong vnu l tn
n v, vn l tn ngn ng, ldk l tn ngi c. Sau khi thc hin lnh ny, ta s c
mt th mc lm vic l ~/data/vnu_vn_ldk_diphone. Tt c cc cng vic tip theo
ca chng ta u thc hin t th mc ny.

3.3 nh ngha tp phone ting Vit

Cng vic tip theo ca chng ta l nh ngha tp phone ting Vit trong
festvox/vnu_vn_ldk_phoneset:
Chng ta s s dng mt phone c bit l m cm (ting Anh m l silence,
trong danh sch ca ta s c k hiu l pau).
Ting Vit cn gm c 24 ph m tnh c ph m n v i l b, c(k), ch, d, ,
g, gi, h, kh, l, m, n, ng(ngh), nh, p, ph, q, r, s, t, tr, th, v, x. y, 2 cp phone k v c,
ng v ngh c cch pht m ging nhau, nn ta s ch nh ngha mt ln.
Ngoi ra, ting Vit bao gm 12 nguyn m n a, , , e, , i, o, , , u, , y.
Nh ni mc 2.6, chng ta s ch thc hin vic tng hp ting ni cho ting Vit
khng du.
tng cht lng ca ting ni c tng hp, ti cho rng chng ta c th coi
c cc nguyn m i v d nh ao, au, oi, u l mt phone mc d chng c th
c tng hp t nhng nguyn m n. Cch lm ny s khng lm gim i cht
lng ca ting ni ( trn) do cc t vn c ghp nh m cm.
y, ti k hiu cc phone theo cch g ting Vit TELEX. Cc ch ci ch du
s c vit thng, cn li vit hoa. V d nh phone u g theo cch g TELEX
l uwu nn s c k hiu l UwU.
i vi mi phone, ta cn bit cc thng s v phone l:

- 17 -

 Loi phone: nguyn m hay ph m tng ng l + hoc . y chng

ta phi lu rng ta chia phone l nguyn m hay ph m da trn cch
pht m ca chng (m hc). Nguyn m l m m khi pht m, dng
khng kh sau khi i qua thanh qun i thng ra ngoi, khng gp vt cn.
Ph m l m m khi pht m, dng khng kh sau khi i qua thanh qun
gp vt cn trn ng i v d nh vm ming, rng, mi. Vi cch nh
ngha nh trn, phone y trong ting Vit c coi l nguyn m.
di ca phone nu l nguyn m: di, ngn hay l nguyn m i
tng ng l l, s, d
Nu l nguyn m, cao ca phone (vheight): cao, trung bnh, thp
tng ng l 1 2 3
Nu l nguyn m, phone c pht m trn ming khng (vrnd) (+ -)
Nu phone l ph m (ctype), phone l loi m g: m mi (n), m xt (f),
m nc (l), m dng (s), m dng v xt (a).
Nu l ph m v tr gp vt cn (cplace): mi (l), vm ming (p), rng (a,
d, v), c mi v rng (b).
Ti xy dng bng phone ting Vit cho cc nguyn m v ph m nh sau:
Bng 1 Cc nguyn m n ting Vit v tnh cht
Th t

Phone

K hiu

di

cao

Pht m trn ming

1.

Di

Thp

Khng

2.

Aw

Ngn

Cao

Khng

3.

Aa

Ngn

Cao

Khng

4.

Ngn

Thp

Khng

5.

Ee

Di

Thp

Khng

6.

Ngn

Cao

Khng

7.

Ngn

TB

- 18 -

8.

Oo

Ngn

TB

9.

Ow

Ngn

TB

Khng

10.

Ngn

Cao

11.

Uw

Di

Cao

Khng

12.

Ngn

Cao

Khng

Bng 2 Cc nguyn m i ca ting Vit v tnh cht

Th t

Phone

K hiu

di

cao

Pht m trn ming

1.

ai

AI

Nguyn m i

Cao

Khng

2.

ao

AO

Nguyn m i

TB

3.

au

AU

Nguyn m i

TB

4.

ay

AY

Nguyn m i

TB

5.

AaU

Nguyn m i

Thp

6.

AaY

Nguyn m i

Cao

Khng

7.

eo

EO

Nguyn m i

TB

8.

EeU

Nguyn m i

Cao

Khng

9.

ia

IA

Nguyn m i

TB

Khng

10.

IEe

Nguyn m i

TB

Khng

11.

iu

IEeU

Nguyn m i

TB

Khng

12.

iu

IU

Nguyn m i

Cao

Khng

13.

oa

OA

Nguyn m i

TB

Khng

- 19 -

14.

OAw

Nguyn m i

Cao

Khng

15.

oe

OE

Nguyn m i

Cao

Khng

16.

oi

OI

Nguyn m i

Cao

Khng

17.

oo

OO

Nguyn m i

TB

18.

OoI

Nguyn m i

TB

Khng

19.

OwI

Nguyn m i

TB

Khng

20.

ua

UA

Nguyn m i

TB

Khng

21.

UAa

Nguyn m i

Cao

Khng

22.

UEe

Nguyn m i

TB

Khng

23.

ui

UI

Nguyn m i

Cao

Khng

24.

uy

UYEe

Nguyn m i

TB

Khng

25.

UOo

Nguyn m i

TB

26.

ui

UOoI

Nguyn m i

TB

Khng

27.

UOw

Nguyn m i

TB

Khng

28.

uy

UY

Nguyn m i

Cao

Khng

29.

uya

UYA

Nguyn m i

Cao

Khng

30.

UwA

Nguyn m i

Cao

Khng

31.

UwI

Nguyn m i

Cao

Khng

32.

UwOw

Nguyn m i

TB

Khng

33.

UwOwU

Nguyn m i

TB

34.

UwU

Nguyn m i

TB

- 20 -

Bng 3 Cc ph m ting Vit v tnh cht

Th t

Phone

K hiu

Loi ph m

V tr cn

1.

m dng

Mi

2.

m dng

Mi

3.

ch

CH

m dng

Mi

4.

m dng

Rng

5.

Dd

m dng

Rng

6.

m dng

Rng

7.

gi

GI

m dng

Rng

8.

m xt

Rng

9.

kh

KH

m dng

Mi

10.

m nc

Rng

11.

m mi

Mi

12.

m mi

Rng

13.

ng

NG

m mi

Rng

14.

nh

NH

m dng

Mi

15.

m dng

Mi

16.

ph

PH

m dng

Mi

17.

m dng

Rng

18.

m xt

Rng

- 21 -

19.

m xt

Rng

20.

m dng

Rng

21.

tr

TR

m dng

Rng

22.

th

TH

m xt

Rng

23.

m xt

Mi v rng

24.

m xt

Vm ming

T bng tng hp trn, ti nh ngha cc phone ting Vit trong file

festvox/vnu_vn_ldk_phoneset.scm.

3.4 Xy dng tp cc diphone:

y l qu trnh lit k tt c cc kh nng ghp ca cc phone vi nhau. Mt
cch n gin chng ta c th vit on chng trnh:
Bng 4 Mt cch lit k cc diphone
for (phone u trong tp phone)
for (phone v trong tp phone)
tp diphone kt qu = add(diphone(u v))

Trong ting Vit khng phi cp phone phone no cng tn ti, v vy, cch
lm ny gy ra s lng ph v c s d liu phi lu tr, tuy khng nh hng n cht
lng ting ni tng hp thu c sau cng nhng lm cho c s d liu b tng ln
nhiu ln. Theo cch nh ngha cc phone nh trn, s khng tn ti cc diphone dng
nguyn m nguyn m hoc ph m ph m. Ti s ch nh ngha nhng diphone
c tn ti. d dng hn cho vic xy dng, ti chia cc phone vo 5 tp:
Bng 5 Phn loi cc phone
Cc tp d liu

Cc phn t

8 phone ph m c th ng cui

C, CH, M, N, NG, NH, P, T

(consonants_can_stay_last)

- 22 -

16 phone ph m khng th ng cui

(consonants_cannot_stay_last)

B, D, Dd, G, GI, H, KH, L, PH, Q, R,

S, TR, TH, V, X

13 phone nguyn m c th ng cui

A, E, Ee, I, O, Oo, Ow, U, Uw, OA,

(vowels_can_stay_last)

OE, UY, Y

24 phone nguyn m bt buc phi ng cui AI, AO, AU, AY, AaU, AaY, EO,
(vowels_must_stay_last)

EeU, IA, IEeU, IU, OI, OoI, OwI,

UA, UEe, UI, UooI, UOw, UYA,
UwA, UwI, UwOwU, UwU

9 phone nguyn m khng th ng cui Aa, Aw, IEe, OAw, OO, UAa,
(vowel_cannot_stay_last)
UYEe, UOo, UwOw
Sau khi chia cc phone vo 5 tp nh trn, ta c th thc hin vic lit k cc
php ghp ni d dng hn.
3.4.1 Diphone gia m cm v ph m:
Mi ph m u c kh nng ng u ca mt ting v vy ta s c 24
diphone gia m cm v ph m:
Bng 6 Diphone m cm ph m
(set! silc-carrier '(() (A T A pau)))
(define (list-silc)
(mapcar
(lambda (c)
(set! count (+ 1 count)) ;;; to count
(list
(list (string-append silence "-" c))
(append (car silc-carrier)(list silence c)(car(cdr silc-carrier)))
)
) (append consonants_can_stay_last consonants_cannot_stay_last)
)
)

3.4.2 Diphone gia m cm v nguyn m

Mi nguyn m u c kh nng ng u ca mt ting v vy ta s c 46
diphone gia m cm v nguyn m:
Bng 7 Diphone m cm nguyn m
(set! silv-carrier '(() (N N A pau)))

- 23 -

(define (list-silv)
(mapcar
(lambda (v)
(list
(list (string-append silence "-" v))
(append (car silv-carrier)(list silence v)(car(cdr silv-carrier)))
)
) (append vowels_can_stay_last vowels_cannot_stay_last
vowels_must_stay_last)
)
)

3.4.3 Diphone gia ph m v m cm

Diphone ph m v m cm cn xt n khi ph m ng cui mt ting. y
s ch c cc ph m trong tp consonants_can_stay_last tham gia. Ta s thu c 8
diphone.
Bng 8 Diphone ph m m cm
(set! csil-carrier '((pau T A T A) ()))
(define (list-csil)
(mapcar
(lambda (c)
(list
(list (string-append c "-" silence))
(append (car csil-carrier)(list c silence)(car(cdr csil-carrier)))
)
) consonants_can_stay_last
)
)

3.4.4 Diphone gia nguyn m v m cm

Diphone gia nguyn m v m cm cn xt n khi c nguyn m ng cui
mt ting. y s ch c cc nguyn m thuc tp vowel_can_stay_last v
vowels_must_stay_last tham gia. Ta s thu c 37 diphone.
Bng 9 Diphone nguyn m m cm
(set! vsil-carrier '((pau T A T ) ()))
(define (list-vsil)
(mapcar
(lambda (v)
(list
(list (string-append v "-" silence))
(append (car vsil-carrier)(list v silence)(car(cdr vsil-carrier)))
)
) (append vowels_can_stay_last vowels_must_stay_last)
)
)

- 24 -

3.4.5 Diphone gia ph m nguyn m

Theo cch nh ngha nh trn, mi cp ph m nguyn m u c th ghp
to thnh diphone. Tuy nhin y, ta s tch lm 2 phn. Nhm 1 s gm tt c
cc ph m c ghp vi cc nguyn m thuc hai tp vowels_can_stay_last v
vowels_must_stay_last. Nhm 2 s gm tt c cc ph m c ghp vi cc nguyn
m thuc tp vowels_cannot_stay_last. L do ca vic tch cng vic lm hai phn l
do chng ta trong lc chng ta to danh sch cc diphone, chng ta ng thi cn lm
lun vic nhng cc diphone vo carrier. V s l thun li hn cho chng ta trong qu
trnh thu m nu chng ta tch lm hai phn. Danh sch diphone ca chng ta sau khi
thc hin xong bc ny s c thm 1104 diphone
Bng 10 Diphone ph m nguyn m 1
(set! cvl-carrier '((pau T A ) (pau)))
(define (list-cv1)
(apply append
(mapcar
(lambda (v)
(mapcar
(lambda (c)
(list
(list (string-append c "-" v))
(append (car cv1-carrier)(list c v)(car(cdr cv1-carrier))))
)(append consonants_can_stay_last consonants_cannot_stay_last)
)
)(append vowels_can_stay_last vowels_must_stay_last)
)
)
)

Bng 11 Diphone ph m nguyn m 2

(set! cv2-carrier '((pau T A ) (N pau)))
(define (list-cv2)
(apply append
(mapcar
(lambda (v)
(mapcar
(lambda (c)
(list
(list (string-append c "-" v))
(append (car cv2-carrier)(list c v)(car(cdr cv2-carrier))))
)(append consonants_can_stay_last consonants_cannot_stay_last)
)
) vowels_cannot_stay_last
)
)
)

- 25 -

3.4.6 Diphone gia nguyn m ph m

y chnh l cng on kh khn nht trong vic xy dng tp cc diphone cho
ting Vit. Nguyn nhn l do ta khng th a ra mt quy tc chung no cho vic lit
k danh sch ca cc diphone gia nguyn m ph m. cng on ny, ti hon
lm th cng, lit k danh sch cc diphone ny. C th chng ta c 89 diphone.
Bng 12 Diphone nguyn m ph m
(set! vc-carrier '((pau T A T) ( pau)))
(set! valid_vc '(
(A C) (A CH) (A M) (A N) (A NG) (A NH) (A T)
(Aw C) (Aw M) (Aw N) (Aw NG) (Aw t)
(AA C) (AA M) (AA N) (AA NG) (AA t)
(E C) (E M) (E N) (E NG) (E t)
(Ee CH) (Ee M) (Ee N) (Ee NG) (Ee NH) (Ee T)
(I CH) (I M) (I N) (I NG) (I t)
(O C) (O M) (O N) (O NG) (O t)
(Oo C) (Oo M) (Oo N) (Oo NG) (Oo t)
(Ow C) (Ow M) (Ow N) (Ow NG) (Ow t)
(U C) (U M) (U N) (U NG) (U t)
(Uw C) (Uw M) (Uw N) (Uw NG) (Uw t)
(Y T) (Y CH)
(OA C) (OA CH) (OA M) (OA N) (OA NG) (OA T)
(OE N) (OE T)
(UY T)
(IEe C) (IEe M) (IEe N) (IEe NG) (IEe T)
(OAw C) (OAw M) (OAw N) (OAw NG) (OAw T)
(OO NG)
(UAa N) (UAa T)
(UYEe N) (UYEe T)
(UOo C) (UOo M) (UOo N) (UOo NG) (UOo T)
))
(define (list-vc)
(mapcar
(lambda (z)
(set! v (car z))
(set! c (car (cdr z)))
(list
(list (string-append v "-" c))
(append (car vc-carrier) (list v c) (car (cdr vc-carrier))))
)
valid_vc)
)

3.5 Carrier v ngha ca n

Ta hon thnh vic to danh sch diphone bng cch gi: festival b
festvox/diphlist.scm
festvox/vn_schema.scm
(diphone-gen-schema
vn
etc/vndiph.list). Lc ny, chng ta c th xem ton b danh sch cc diphone v
carrier cha n trong file etc/vndiph.list

- 26 -

Sau khi hon thnh vic to danh sch 1309 diphone, nu ta thu m ngay cc
diphone ny thc hin ghp ni th chng ta hon ton c th thu c mt ting
ni mc trung bnh. Nguyn nhn ca iu ny l do ta thu tng diphone ti cc thi
im khc nhau nn khi ghp hai diphone, tn s ti im cn ghp l khng tng
ng nhau. Ngoi ra, cn do cch c cc diphone di hoc ngn khc nhau ti mi
thi im nn ting ni sau khi ghp khng c nh mong mun. tng cng cht
lng cho ting ni tng hp, ngi ta a ra khi nim carrier.
tng cht lng cho ting ni, ng thi vi vic to ra danh sch cc
diphone, ngi ta ngh ra mt gii php khc phc nhc im ny. Thay v ch c
mt diphone, ta s c mt cu trong c cha diphone . Diphone sau s c
trch ra, vic ny gip gim thiu nhng nh hng do m iu ca ngi c v khi
c mt on di c cha diphone, ngi c c xu hng c u hn v ta c th
thu c mt diphone mong mun. Cu gm nhiu diphone v khng c ngha ny
chnh l carrier.
Ta phi nhng cc diphone cn thu m vo carrier theo ca ta. Cc on code
pha trn y c mt bc thc hin vic nhng cc diphone nay vo cc carrier
(cc on code in nghing). Ti quy nh vi mi loi diphone th carrier li c mt
nh dng ring nh sau:
Bng 13 Khai bo cc carrier
(set!
(set!
(set!
(set!
(set!
(set!
(set!

silc-carrier '(() (A T A pau)))

silv-carrier '(() (N N A pau)))
csil-carrier '((pau T A T A) ()))
vsil-carrier '((pau T A T ) ()))
cv1-carrier '((pau T A ) (pau)))
cv2-carrier '((pau T A ) (N pau)))
vc-carrier '((pau T A T) ( pau)))

ngha ca on khai bo trn l to ra dng ca cc carrier:

Vi cc diphone dng m cm ph m nh m cm B ta c carrier l
silence B A T A silence.
Vi cc diphone dng silence nguyn m nh silence A ta c carrier l
silence A N N A silence.
Vi cc diphone dng ph m silence nh T silence ta c carrier l
silence T A T A T silence.
Vi cc diphone dng nguyn m silence nh Ow silence, ta c carrier
l silence T A T Ow silence.

- 27 -

 Vi cc diphone dng ph m nguyn m (loi 1) nh B O ta c

carrier l silence T A B O silence.
Vi cc diphone dng ph m nguyn m (loi 2) nh T IEe ta c
carrier l silence T A T I Ee N silence.
Vi cc diphone dng nguyn m ph m nh UYEe T ta c carrier l
silence T A T UYEe T silence
iu quan nht l cc carrier khng c ngha c th nn ngi c khng th
hin s bin thin v ngn iu v duration (khong thi gian ko di ca m v) khi
c chng. c bit vi cc diphone c ly ra t gia ca mt carrier, nh hng ti
im khp ni s c lm gim ti mc cc tiu.

3.6 nh x cc phone ting Vit sang ting Anh

Ngoi vic nhng cc diphone vo carrier, ta cn phi nh x mi phone ting
Vit sang mt phone c cch c gn ging trong ting Anh. Mc ch ca vic nh x
cc phone ting Vit sang ting Anh l Festival c th c c v c th t ng
trch c diphone mong mun ra khi carrier.
Festival c cung cp 4 b phone chun (2 Anh Anh, 2 Anh M). Gi s ta c
mt carrier silence a n a silence v ta mong mun trch c diphone a
silence ra khi carrier. Vi vic ta nh x phone ting Vit sang phone ting Anh,
Festival s t c carrier trn theo ging c ca Festival. Nh vy, khi sau khi ta thu
m carrier ca ta v so snh vi carrier do Festival c, Festival c th t trch ly
diphone a silence m ta mong mun. Di y l v d bng nh x m ti thc
hin trong file vn_schema.scm [13]:
Bng 14 V d nh x phone ting Vit sang phone ting Anh
Phone ting Vit

Phone ting Anh

Phone ting Vit

Phone ting Anh

aa

Ow

er

ow

dh

eh

Uw

uh

Aw

ae

GI

jh

- 28 -

Sinh khi thc hin vic nh x ny xong, chng ta c th sinh ra cch c ca

Festival cho cc carrier ca chng ta bng lnh: festival b festvox/diphlist.scm
festvox/vn_schema.scm
(diphone-gen-waves
prompt-wav
prompt-lab
etc/vndiph.list) Lnh ny cng ng thi sinh ra nhn ca cc diphone c
Festival c. Nhn y c ngha l thi im c ca cc diphone.

3.7 Thu m
Sau khi sinh c danh sch cc diphone, ta c th kim tra li trong file
etc/vndiph.list s c 1309 diphone ting Vit.
thu m t c kt qu cao, ta cn cc iu kin sau:
V phng thu: Phng thu phi m bo cc yu t v cch m. y l iu
rt quan trng nh hng n cht lng ting ni c tng hp. Ngoi
ra, nu thu trong nhiu ngy, phng thu cn phi c m v nhit
tng ng nhau.
V thit b thu: Chng ta cn mt micro tt v card sound tt. Micro tt l
micro c kh nng lc c nhiu u vo, m thanh thu t trung
thc cao. Card sound c nhim v chnh l chuyn tn hiu ri rc (digital)
u ra thnh tn hiu sng (analog). Card sound tt s gip cho cht
lng ting ni tng hp c trn hn. Ngoi ra, card sou
V ngi c: Chng ta cn mt ngi c ging c chun, khng mang
tnh a phng. Ging c khng qu cao hoc qu thp. Ngi c cn
phi thu m trong trng thi khe mnh, khng b cc bnh tai, mi, hng.
Nu thu m trong nhiu ngy th nn thu m vo cng mt thi im trong
ngy.
Mt phng thu studio vi h thng m thanh hin i v MC chuyn nghip l
mt iu kin l tng. Tuy nhin, trong khun kh kha lun ny, ti khng c
kh nng c c iu kin l tng nh vy. Ti thc hin vic thu m ny trn
my tnh c nhn v mt micro khng tht tt.
Festival c h tr chng ta hm prompt-them cho php chng ta thu m lin tip
cc diphone theo th t t carrier th X tr i: bin/prompt-them etc/vndiph.list X.
y X mc nh bng 1.

- 29 -

3.8 nh nhn cc diphone

Sau khi thc hin vic thu m xong, chng ta c tp m cc carrier. trch
cc diphone ra, ta thc hin vic nh nhn cc diphone vi hm make_labs ca
festival: bin/make_labs prompt-wav/*.wav. Nhn y l thi im chng ta c
tng diphone trong carrier. T nhn ny c th d dng sinh ra cch c ca cc
diphone. Sau qu trnh trn, vi mi file wav thu m ging c, chng ta c mt file
lab lu thng tin v im bt u v im kt thc ca diphone. Di y l hnh nh
biu din dng sng ca mt carrier v diphone c c nh nhn [2]:

Hnh 9 Biu din dng sng ca mt carrier v nh nhn diphone

3.9 Tm pitchmark
Hm make_pm_wave tm ra cc im pitch trong biu din dng sng ca
diphone thu c. bin/make_pm_wave etc/vndip.list
Tip , hm make_pm_fix di chuyn cc im pitch v cc im ph hp nht
sao cho biu din dng sng phone khp ni trong hai diphone cn ghp ni ging
nhau. bin/make_pm_fix etc/vndiph.list.

- 30 -

Lc ny, ta c mt c s d liu cch c cc diphone y .

3.9.1 Cc bc ly pitchmark tt
Festival h tr vic ly pitchmark t ng tuy nhin vic ly c pitchmark
tt l rt quan trng, mt on carrier c qu nhiu, hay qu t pitchmark u khng
tt. Ly pitchmark t ng rt d b ri vo trng hp ny. y l cch ti thc hin
c th ly c mt pitch mark tt da theo hng dn ca [15].
Script make_pm_wave c c gi vi mt vi tham s m ta cn phi quan tm
nh sau:
min l khong thi gian ngn nht gia hai pitchmark (c tnh bng
giy)
max l khong thi gian di nht gia hai pitchmark (c tnh bng
giy)
def l chu k pitchmark mc nh. Thng thng c t l 0.01 giy.
wave_end t pitch mark cui cng kt thc ca sng.
lx_lf cn di ca tn s
lx_hf cn trn ca tn s
Cc bc ly pitch ca 1 file, v d file wav/vn_0001.wav:
Sa gi tr min v max cho ph hp vi ging ngi c. Mt ngi c
l nam nn t min = 0.005, max = 0.012 (tc l 200 n 80 Hz). Nu
ngi c l n, nn t min = 0.0033, max = 0.7 (tng ng vi (300
ti 140 Hz).
Chy script bin/make_pm_wave wav/vn_0001.wav ly pitchmark.
Chy script make_pmlab_pm. Script ny i file pitchmark thnh mt file
c th biu din c bng cng c emulabel (cng c c sn trong
Festival): bin/make_pmlab_pm pm/vn_0001.pm
Xem cc pitchmark bng cch gi emulabel etc/emu_pm vn_0001

- 31 -

Hnh 10 Pitchmark ca sng "taa taa taa"

Ta phi lp li vic hiu chnh cc thng s cho ti khi thu c mt pitch mark
nh .

3.10 Kim th
Sau khi hon thnh vic nh pitchmark, ta c th th nghim h thng ca
chng ta bng cch load diphone chng ta va thu c:
festival festvox/vnu_vn_ldk_diphone.scm (voice_vnu_vn_ldk_diphone)
festival> (SayPhones (pau x i n ch a o))
Thc t cho thy y l giai on tn nhiu thi gian nht. Giai on ny i km
vi vic thu i thu li cc diphone, nh pitchmark li.

3.11 Thm du cho ting Vit

Th vin Festival c cung cp cho chng ta chng trnh ToBI cho php chng
ta truy cp trc tip vo sng m thanh (utterance). s dng c chng trnh ny
ta thc hin cc bc sau: [5]
festival/ %FESTIVALDIR%/lib/tobi_rules.scm
festival> (require tobi_rules)
festival> (setup_tobi_f0_method)
Tt c cc d liu trong th vin festival c lu tr di dng utterance. Mt
utterance c th dng: xu (Words), sng m (Wave), s (Number). Festival ng

- 32 -

thi cng cung cp cho chng ta cc hm truy cp, thay i gi tr cc utterance

ny. Di y l cc cu lnh khi to mt utterance dng xu, tng hp utterance
thnh dng sng v pht ra loa:
festival>(set! myUTT (Utterance Words (chao)))
festival>(utt.synth myUTT)
festival>(utt.play myUTT)
on chng trnh trn s pht ra ch chao.
Vic b du cho mt ting chnh l vic thay i tn s F0 ca sng m thanh.
Cc utterance c gi tr accent (trng m) v tone (m). Ta c th thay i 2 gi tr ny
to ra thanh iu. ToBI cung cp mt s gi tr thay i. Ta c th thay i L*,
L+, L-, H+, H-, H%, !H [11]
Da trn cc nghin cu mc (2.5) v qua qu trnh kim th, ti thay i
cc gi tr sng m to ra thnh cng 4 / 6 thanh iu ca ting Vit.
y l cc lnh cn thc hin to ra ting: Cho
festival>(set! myUTT (Utterance Words ((chao ((accent L*) (tone L-))))))
festival>(utt.synth myUTT)
festival>(utt.play myUTT)
Vi gi tr accent l L* v tone l H-H%, ta c th to ra m cho.
Vi gi tr accent l H* v tone l H-H%, ta c th to ra m cho.

- 33 -

Chng 4 Tng kt
4.1 Kt qu thu c
H thng TTS cho ting Vit m ti xy dng to ra c mt ting ni
tha mn yu cu quan trng nht l pht m khng sai v con ngi c th nghe hiu
c. Ting ni c tng hp c t nhin, khng ri rc. Cc t trong cu c
c mt cch lin mch, trn chu. Kt qu thu c ny c th ni l t c mc
ch ban u t ra khi thc hin kha lun ny.
C th kt lun rng, vi h thng TTS cho ting Vit, phng php ghp ni
diphone th hin c nhiu u im vt tri so vi cc phng php tng hp khc
nh Formant. C th khng nh rng, ti thi im hin nay, y l phng php
thch hp nht.
th nghim thnh cng vic thay i tn s ca sng m to ra du cho
ting Vit. Tuy vy, ti mi ch thay i c tn s ca sng m to ra 4 trong s
6 thanh ca ting Vit.
Trong khun kh kha lun ny, ti cng cha ch n x l ng iu ca vn
bn trong khi tng hp. y chnh l im m TTS ting Anh ang vt xa cc h
thng TTS ca cc ngn ng khc

4.2 Cc kh khn thch thc

Trong qu trnh thc hin vic th nghim tng hp ting ni ting Vit s dng
phng php ghp ni diphone, ti gp nhiu kh khn, trong c c nhng kh
khn v ch quan ln khch quan.
Mt kh khn rt ln ti gp phi khi thc hin ti ny l vic s dng b 3
th vin m ngun m Festival, Festvox, Speech Tools. Ba th vin ny c cp
nht cc phin bn mi hn nhng hng dn s dng li khng c cp nht ng
thi. V vy, ti mt rt nhiu thi gian xem li m ngun ca 3 th vin ny.
Bn thn ting Vit tuy c nhiu thun li hn so vi cc ngn ng khc nhng
li c nhng c trng ring v thanh iu gy kh khn cho vic tng hp.
Mt kh khn na l ti khng c mt phng thu m bo, khng c mt micro
tht tt v khng c mt ging c tt.

- 34 -

y l ln u tin ti ri xa Windows v thc s lm vic nghim tc trn mi

trng Linux. Nhng kh khn do mi trng lm vic mi l khng th trnh khi.
Tuy vy, sau mt thi gian nghin cu, tm hiu, nhng kh khn ny khng cn l
cn tr ln.
D vy, ti hi lng vi nhng kt qu t c.

4.3 Cc hng nghin cu pht trin tip theo

ti tng hp ting ni ting Vit s dng phng php ghp ni diphone m
ti thc hin cn nhiu hn ch, cn rt nhiu hng c th tip tc nghin cu,
pht trin tip:
Ta c th xy dng li tp phone y (c du) cho ting Vit. Pht trin theo
hng t nh nhn, khng ph thuc vo ging c ca Festival. Cch lm ny s rt
vt v trong vic nh nhn do s phi thc hin ton b bng tay, nhng s mang li
mt ging ni tng hp chnh xc v thanh iu, trn chu v t nhin.
Ta c th pht trin tip theo hng nghin cu su hn v k thut sa i sng
m c th to ra thanh iu. Nu thnh cng, y s l cch tng hp hiu qu nht,
c v cht lng cng nh tit kim v c s d liu phi lu tr.
Tp trung nghin cu v ng iu ca ting Vit v thc hin mt h thng TTS
c ng iu.

- 35 -

Ti liu tham kho

[1] Mai Ngc Ch, V c Nghiu, Hong Trng Phin: C s ngn ng
hc v Ting Vit, NXB Gio dc (2000)
[2] Nguyn Th Hng, Tng hp ting ni t vn bn ting Vit bng
phng php ghp ni diphone, (2005)
[3] on Thin Thut, Ng m ting Vit, NXB i hc Quc Gia H Ni
(1999)
[4] http://vi.wikipedia.org/wiki/Tng_hp_ging_ni
[5] Alan W Black, Paul Taylor, Richard Caley, The Festival Speech
Synthesis System (1999)
[6] Alan W Black, Paul Taylor, Richard Caley, Simon King, Edinburgh
Speech Tools Library, (1999)
[7] Alan W Black, Kevin A Lenzo, Building Synthetic Voices, (2007)
[8] Nguyen Tien Dung, Hansjrg Mixdorff, Luong Chi Mai, Ngo Huy Hoang,
Vu Kim Bang, Fujisaki Model based F0 contours in Vietnamese TTS
(2004)
[9] Tran Do Dat, Eric Castelli, Jean-Francois Serignat, Trinh Van Loan, Le
Xuan Hung, Influence of F0 on Vietnamese syllable perception
[10] Thierry Dotoit High Quality Text-to-Speech Synthesis: A Comparison
of Four Candidate Algorithms (1994)
[11] Janet Fletcher Intonation and Prosody in Australian English and New
Zealand English, STT 2006 workshop Auckland, New Zeland
[12] Carolie Hemptinne Intergration of the harmonic plus noise model
(HNM) into the hidden Markov model-based speech synthesis system
(HTS) (2006)
[13] James L.Hieronymus, Bell Laboratories, Murray Hill, ASCII Phonetic
Symbols for the Worlds Languages
[14] Sami Lemetty, Review of Speech Synthesis Technology, (1999)
[15] J.A. Louw, A Short Guide to Pitch-marking in the Festival Speech
- 36 -

Synthesis System and Recommendations for Improvements

[16] Yannis Stylianou, Thierry Dutoit, Juergen Schroeter Diphone
Concatenation using a Harmonic plus Noise Model of Speech
[17] David Vandromme Harmonic Plus Noise Model for Concatnenative
Speech Synthesis (2005)
[18] http://en.wikipedia.org/wiki/Speech_synthesis

- 37 -