- Universiti Teknologi Malaysia

PSZ 19:16(PIND. 1/97)
UNTYERSITITNTXOTOGI MALAYSIA
BORANG PENGESAHAN STATUS TESIS
SESI PENGAJIAN: 1999/2fiX)
t
(HURUF BESAR)
(PSlWSarjana/Doktor
Falsafah)*ini disimpandi perpustakaan
Yb:"TtTtesis
'eknologi
Malaysiadengansyarat-syarat
kegunaansepertiberikut:
is adalahhakmitik Universiti TeknologiMalaysia.
rustakaanuniversiti Teknologi Malaysiadibenarkanmembuat
salinanuntuk
pengajian sahaja.
takaandibenarkanmembuatsalinantesisini sebagaibatranpertukaran
anftra
i pengajiantinggi.
tandakan(r')
jf]
(Mengandungimaklumatyang berdarjah
keselamatan
ataukepentingan-MalaysLseperfiyang
terrnaktubdi dalarnAKTA RAHSIA nesfr,tt thZ)
TERHAD
(Me'ngandungi
maklumatTERHAD yang telatr
ditentukanoleh organisasi/badan
di ;an;
penyelidikandiialankan)
TTDAKTERHAD
'at'rra-'
.
TAFiGAN PENULIS)
Tetap: LpI SE2r.Kc. MELt\yU SUBANG.
4Or5O
SHAHALAM.
SE
:
20 ApRIL 2(M)
Tarikh: ?0 APRIL 2000
* Po0ongyang tidak berkenaan
:*{. Jika tesisini
SULIT atauTERHAD, sila lampirkansuratdaripadapihak
,ffigo** -*r*""Sd;ffi;-ilp*,oi, iniperru
ffiffiffi
Tesndiuraksudkan
seb-aglltesls
bagr
IjazahDoktorFarsafrhdansa{anaswara
perryelidikaq
ataudis€rtaitagi- perga.iian
- soa.ut"4u r.rosus-aan
pefiJi&lq uru,,
LaporanProjekSarjans
Muda(pSM)-.
KE ATAS PERTUTURANBERANIMASI D4NGAN
IINAKAN TEXT-TO-AT]DIO-VISUALSPEECH
SYNTIIESIS(TTAVS)
ROSEDIANA BINTI NORDIN
Laporan projek ini Dikemukakan
SebagaiMemenuhi SebahagianDaripada Syarat
PenganugerahanIjazah Sarjana Muda SainsKomputer
Fakulti SainsKomputer Dan SistemMaklumat
Universiti TeknologiMalaysia
APRTL,2fi)0
I
I
t*
t
ABSTRAK
t
lKajianterhadaptingkahlaku manusiatelahsekianlamamenjaditopik utama
oleh pengkaji-pengkaji.Oleh itu, pelbagaisistemyangmampu
balassepertimanusiatelah dibangunkanatausedangdalampercubaan.
lakutersebuttermasuklahpertuturanmanusiadimanaprojek ini akan
mengenaibahagianutamayangterlibat iaitu muka. Kajian projek ini
bertujuanuntuk membuktikanmanusiajuga boleh berinteraksidengan
denganmenggunakanbahasatabii manusia.pertuturanberanimasiini
menjadi satucaraterbarudalamkomunikasipadamasadepan.
yangakandigunadalammenghasilkanpergerakanbibir, matadan rahang
Text-To-Audio-visual
speech(TTAVS)iaitu dalampengecaman
inputdari
kekunci(teks)dan dibuktikandengankaedahramalanlinear.selain itu,
untuk merekabenhrkmodel mukayang akandikaji ialah model
berparamater.
I
t,
p
t,
t*
t .
vl
ABSTRACT
t
Stuidieson human'sbehaviourhavebeenthe main topic in researcher'sarea.
thereis varioussystemthat can act like a humanhavebeendevelopedor in
modeat the meantime. Human'sbehavioursuchashuman,sarticulation
b-ediscussedandthis study, focusesmainly on faceportion. The purposeof
on this project is to prove that humancan interactwith computerusingnatural
This animationtalking will also allow new waysof comrrnunication
in the
. Methodologythat woutd be usedin productionof lips, eyesandjaw movement
ext-To-Audio-visualSpeech(TTAVS) that is a text recognitionwhile input
keyboardand would be provedwith linear prediction.Approachto designa
modelthatwouldbe focusedon is parametricmodel.
SU1}4BER RUJTII(AN
Amano,J. and sekiyama,K. (1997a)."The McGurkEffect is InfluencedbyThe
StimulusSet Size."KanazawaUniversity:Jepun.
Beskow,J. andElenius,K. (1997)."OLGA - A DialogueSystemwith An Animated
Talking Agent." Deparbnentof speech,Music andHearing:Stockholm.
Beskow,J., Dahlquist,M., Granstr0m,B., Lundeberg,M., Spens,K.E. andOhman,T.
(1997)."The TelefaceProject- Multimodal SpeechCommunicationfor the
HearingImpaired."Proceedings
of Eurospeech'97.
Rhodos,Greece.
Fisher,C.G. (1968)."ConfirsionAmong VisuallyPerceivedConsonants."
Journal
Speechand HearingResearch.
cohen,M.M. andMassaro,D.w. (1993)."Modelingcoarticulationin Synthetic
Visual Speech." Proceedings
of ComputerAnimation'93,N.MagnenatThalmann,D. ThalmanrqSpringer-Verlag,
Tokyo.
Cohen,M.M., Beskow,J. andMassaro,D.W. (1993)"RecentDevelopmentsin Facial
Animation : An Inside View. " UC-SantaCruz PerceptualScienceLaboratory:
California.
I
Dix" A., Finlay,J., Abowd G. andBeale,R. (1993).'oHuman-computer
Interaction."
lst. ed.UnitedKingdom : PrenticeHall.
i
i
Ez.zat,T. andPoggio,T. (1998)."MikeTalk : A TalkingFacialDisplayBasedon
i .
ffi:
Morphing Visemes."ProceedingsOf The ComputerAnimation Conference,
Philadelphia,Pennsylvania.
59
.,
:
"Videorealistic
Talking Faces:A Morphing
, T. and Poggio, T. (1997).
Approach,." Proceedingsof the AudioVisual SpeechProcessingWorkshop.
Rhodes:Greece.
H.E. andPenker,M.(1998)." IIML Toolkit." Canada: JohnWiley andSons.
,
H. (1971)."ComputerDisplayof CurvedSurfaces."IEEE Transactions.
Harun(1992)."KepintaranBuatan:KomputeratauFalsafah."Kuala
Lumpur. : DewanBahasadanPustaka.
D.R.,Pearce,A. andWyvill, B. (1986)."AnimatingSpeech: An Automated
ApproachUsing SpeechSynthesized
by Rules."The Visual Computer.
Kulju,J., SamsM andKashi,K. (1998)."A FinnishTalkingHead" Proceedings
of
FinnishFonetiksSymposium,HelsinkiUniversityof Technology,Perancis.
Lewis,J. (1990)."AutomatedLip-Sync: BackgroundandTechniques."New York
Institute of Technology,New York.
Maddix,F. (1990)."Human-Computer
Interaction."lst.ed. England.Ellis Horwood
Limited.
Parke,F.I. (1974)."A ParametricModel for HumanFaces."Universityof Utah : Ph.D
Dissertation.
Parke,F.I. (1975)."A Model for HumanFacesthat Allows SpeechSynchronized
Animation." Journalof ComputersandGraphics.
Parke,F.I., (1982)."Parameterized
Modelsfor FacialAnimation."IEEE Computer
Graphics.
60
,I.,N.M. Thalmann and D. Thalmann(Eds.) (1991). "Control
izationfor FacialAnimation."ComputerAnimation'9l
:Springer-Verlag.
O. andSundblad,Y. (1997)."OLGA- A Multimodal Interactive
trnformationrAssistant"
Centerfor UserOrientedIT Design: Sweddh.
ille,I. (1995)."SoftwareEngineering."
England: AddisonWesley
LongmanLimited.
K. (1997b)."Faceor Voice?Determinantof Compellingness
to The
McGurkEffect." KanazawaUniversity : Jepun.
N. (1996)"ContinousSpeechRecognitionin The WNG{OLM Dialogue
System."Departmentof Speech,Music andHearing,KTH : Sweden.
Beier.andS.Neely.(1992)."Featured-based
ImageMetamorphosis."Proceedings
in SIGGRAPH'92, Chicago.
!
I
I