Refine
Document Type
- Part of a Book (5) (remove)
Has Fulltext
- yes (5)
Is part of the Bibliography
- no (5) (remove)
Keywords
- Visualisierung (5) (remove)
The author presents MASSY, the MODULAR AUDIOVISUAL SPEECH SYNTHESIZER. The system combines two approaches of visual speech synthesis. Two control models are implemented: a (data based) di-viseme model and a (rule based) dominance model where both produce control commands in a parameterized articulation space. Analogously two visualization methods are implemented: an image based (video-realistic) face model and a 3D synthetic head. Both face models can be driven by both the data based and the rule based articulation model.
The high-level visual speech synthesis generates a sequence of control commands for the visible articulation. For every virtual articulator (articulation parameter) the 3D synthetic face model defines a set of displacement vectors for the vertices of the 3D objects of the head. The vertices of the 3D synthetic head then are moved by linear combinations of these displacement vectors to visualize articulation movements. For the image based video synthesis a single reference image is deformed to fit the facial properties derived from the control commands. Facial feature points and facial displacements have to be defined for the reference image. The algorithm can also use an image database with appropriately annotated facial properties. An example database was built automatically from video recordings. Both the 3D synthetic face and the image based face generate visual speech that is capable to increase the intelligibility of audible speech.
Other well known image based audiovisual speech synthesis systems like MIKETALK and VIDEO REWRITE concatenate pre-recorded single images or video sequences, respectively. Parametric talking heads like BALDI control a parametric face with a parametric articulation model. The presented system demonstrates the compatibility of parametric and data based visual speech synthesis approaches.
Projektionsverhältnisse zwischen Körper, Linien und Zeichen stehen im Zentrum des Beitrags von Li-Chun Lee, der sich den Visualisierungsformen von Pulskurven im europäischen und chinesischen Kontext widmet. Mit Rekurs auf Maurice Merleau-Ponty verfolgt Lee die Frage, wie die leibliche Phänomenalität des Pulses in eine für medizinische Analysen genaue Zeichenform übersetzt werden kann. Lee kann in der Gegenüberstellung von sprachlich-metaphorischen, technischen und grafischen Übersetzungsprozessen eine Situation skizzieren, in welcher unterschiedliche Zeichenregime des Pulses und Genauigkeitsvorstellungen aufeinanderstoßen.
We measure face deformations during speech production using a motion capture system, which provides 3D coordinate data of about 60 markers glued on the speaker's face. An arbitrary orthogonal factor analysis followed by a principal component analysis (together called a guided PCA) of the data has showed that the first 6 factors explain about 90% of the variance, for each of our 3 speakers. The 6 derived factors, therefore, allow us to efficiently analyze or to reconstruct with a reasonable accuracy the observed face deformations. Since these factors can be interpreted in articulatory terms, they can reveal underlying articulatory organizations. The comparison of lip gestures in terms of data derived factors suggests that these speakers differently maneuver the lips to achieve contrast between /s/ and /R/. Such inter-speaker variability can occur because the acoustic contrast of these fricatives is shaped not only by the lip tube but also by cavities inside the mouth such as the sublingual cavity. In other words, these tube and cavity can acoustically compensate each other to produce their required acoustic properties.
Judith Sieber zeichnet die Entwicklung und Verwendung von statistischen Grafen in William Playfairs "Commercial and Political Atlas" (1786) nach. Dabei arbeitet sie die gesellschaftspolitische Ausrichtung der sich etablierenden Methode der visuellen Statistik heraus. In der Wiedergabe des Übergangs vom Vertrauen in numerische Genauigkeit (tabellarische Vermittlung von ökonomischem Wissen) zu Playfairs Anwendung visueller Statistik, die auf größtmögliche Einfachheit und Anschaulichkeit abzielt, erläutert sie Playfairs Gewichtung von Anschaulichkeit vor Genauigkeit im Kontext der schottischen Aufklärung. Hierbei wird deutlich, dass der Wendepunkt zur anschaulichen Darstellungsform begleitet ist von Fragen nach der Zugänglichkeit und Sichtbarmachung von Wissen sowie der politischen Rolle der eigenen Wissenschaftsdisziplin.