Artículos de revistas
Facial Movement Analysis In Asl
Registro en:
Universal Access In The Information Society. , v. 6, n. 4, p. 363 - 374, 2008.
16155289
10.1007/s10209-007-0096-6
2-s2.0-38949213461
Autor
Vogler C.
Goldenstein S.
Institución
Resumen
In the age of speech and voice recognition technologies, sign language recognition is an essential part of ensuring equal access for deaf people. To date, sign language recognition research has mostly ignored facial expressions that arise as part of a natural sign language discourse, even though they carry important grammatical and prosodic information. One reason is that tracking the motion and dynamics of expressions in human faces from video is a hard task, especially with the high number of occlusions from the signers' hands. This paper presents a 3D deformable model tracking system to address this problem, and applies it to sequences of native signers, taken from the National Center of Sign Language and Gesture Resources (NCSLGR), with a special emphasis on outlier rejection methods to handle occlusions. The experiments conducted in this paper validate the output of the face tracker against expert human annotations of the NCSLGR corpus, demonstrate the promise of the proposed face tracking framework for sign language data, and reveal that the tracking framework picks up properties that ideally complement human annotations for linguistic research. © Springer-Verlag 2007. 6 4 363 374 Bauer, B., Kraiss, K.-F., Video-based sign recognition using self-organizing subunits (2002) International Conference on Pattern Recognition Blake, A., Isard, M., (1999) Active Contours: The Application of Techniques from Graphics, Vision, Control Theory and Statistics to Visual Tracking of Shapes in Motion, , Springer, Berlin Blanz, V., Vetter, T., A morphable model for the synthesis of 3D faces (1999) SIGGRAPH, pp. 187-194 Brandão, B., Wainer, J., Goldenstein, S., Subspace hierarchical particle filter (2006) Brazilian Symposium in Computer Graphics and Image Processing (SIBGRAPI) Canny, J., A computational approach to edge detection (1986) IEEE Trans. Pattern Anal. Mach. Intell., 8, pp. 679-698 Canzler, U., Kraiss, K.-F., Person-adaptive facial feature analysis for an advanced wheelchair user-interface (2004) Conference on Mechatronics and Robotics, 3, pp. 871-876. , In: Drews, P. (ed.) Sascha Eysoldt Verlag, Aachen Cootes, T.F., Edwards, G.J., Taylor, C.J., Active appearance models (2001) IEEE Trans. Pattern Anal. Mach. Intell., 23 (6), pp. 681-685 Cootes, T.F., Taylor, C.J., Active shape models - Their training and application (1995) Comput. Vis. Image Underst., 61 (1), pp. 38-59 DeCarlo, D., Metaxas, D., Stone, M., An anthropometric face model using variational techniques (1998) Proceedings of the SIGGRAPH, pp. 67-74 Dimitrijevic, M., Ilic, S., Fua, P., Accurate face models from uncalibrated and ill-lit video sequences (2004) Proceedings of IEEE Computer Vision and Pattern Recognition, pp. 1034-1041 Ding, L., Martinez, A.M., Three-dimensional shape and motion reconstruction for the analysis of american sign language (2006) Proceedings of IEEE Workshop on Vision for Human-computer Interaction (V4HCI) Dinges, D.F., Rider, R.L., Dorrian, J., McGlinchey, E.L., Rogers, N.L., Cizman, Z., Goldenstein, S.K., Metaxas, D.N., Optical computer recognition of facial expressions associated with stress induced by performance demands (2005) Aviation, Space and Environmental Medicine, 76 (6 SUPPL.), pp. B172-B182 Essa, I., Pentland, A., Coding, analysis, interpretation and recognition of facial expressions (1997) IEEE PAMI, 19 (7) Fang, G., Gao, W., Chen, X., Wang, C., Ma, J., Signer-independent continuous sign language recognition based on SRN/HMM (2001) Gesture and Sign Language in Human-computer Interaction. International Gesture Workshop, 2298, pp. 76-85. , In: Wachsmuth I., Sowa T. (eds.) Lecture Notes in Artificial Intelligence, Springer, Berlin Fischler, M., Bolles, R., Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography (1981) Commun. ACM, 24 (6), pp. 381-395 Goldenstein, S., A gentle introduction to predictive filters (2004) Revista De Informatica Teórica E Aplicada, 11 (1), pp. 61-89 Goldenstein, S., Vogler, C., Metaxas, D., Statistical Cue Integration in DAG Deformable Models (2003) IEEE Trans. Pattern Anal. Mach. Intell., 25 (7), pp. 801-813 Goldenstein, S., Vogler, C., Metaxas, D., 3D facial tracking from corrupted movie sequences (2004) Proceedings of IEEE Computer Vision and Pattern Recognition Goldenstein, S., Vogler, C., Velho, L., Adaptive deformable models (2004) Proceedings of SIBGRAPI, pp. 380-387 Goldenstein, S., Vogler, C., When occlusions are outliers (2006) Proceedings of IEEE Workshop on 25 Years of RANSAC Kass, M., Witkin, A., Terzopoulos, D., Snakes: Active Contour Models (1988) Int. J. Comput. Vis., 1, pp. 321-331 Metaxas, D., (1996) Physics-based Deformable Models: Applications to Computer Vision, Graphics and Medical Imaging, , Kluwer Academic Publishers, Dordrecht Murase, H., Nayar, S.K., Visual learning and recognition of 3-d objects from appearance (1995) Int. J. Comput. Vis., 14, pp. 5-24 Neidle, C., Kegl, J., MacLaughlin, D., Bahan, B., Lee, R.G., The syntax of American Sign Language (2000) Language, Speech, and Communication, , MIT, Cambridge Neidle, C., Sclaroff, S., (2002) Data Collected at the National Center for Sign Language and Gesture Resources, Boston University, Under the Supervision of C. Neidle and S. Sclaroff, , http://www.bu.edu/asllrp/ncslgr.html, Available online at Pighin, F., Szeliski, R., Salesin, D., Resynthesizing facial animation through 3D model-based tracking (1999) Proceedings of International Conference of Computer Vision, pp. 143-150 Romdhani, A., Vetter, T., Efficient, robust and accurate fitting of a 3D morphable model (2003) Proceedings of International Conference of Computer Vision, pp. 59-66 Rousseeuw, P.J., Van Driessen, K., A fast algorithm for the minimum covariance determinant estimator (1999) Technometrics, 41, pp. 212-223 Samaras, D., Metaxas, D., Fua, P., Leclerc, Y.G., Variable albedo surface reconstruction from stereo and shape from shading (2000) Proceedings of IEEE Computer Vision and Pattern Recognition, pp. 480-487 Shi, J., Tomasi, C., Good features to track (1994) Proceedings of IEEE Computer Vision and Pattern Recognition, pp. 593-600. , In: Simoncelli, E., (1999) Handbook of Computer Vision and Applications, Vol. II, Chapter Bayesian Multi-scale Differential Optical Flow, pp. 397-422. , Academic, Dublin Stolfi, J., Figueiredo, L., (1997) Self-validated Numerical Methods and Applications, , 21° Colóquio Brasileiro de Matemática, IMPA Tao, H., Huang, T., Visual estimation and compression of facial motion parameters: Elements of a 3D model-based video coding system (2002) Int. J. Comput. Vis., 50 (2), pp. 111-125 Vogler, C., Goldenstein, S., Stolfi, J., Pavlovic, V., Metaxas, D., Outlier rejection in high-dimensional deformable models (2006) Image Vis. Comput., , (in press) Vogler, C., Metaxas, D., Handshapes and movements: Multiple-channel ASL recognition (2004) Proceedings of the Gesture Workshop, Vol. 2915 Lecture Notes in Artificial Intelligence, pp. 247-258. , In: Volpe G., et al. (eds) Springer, Berlin von Agris, U., Schneider, D., Zieren, J., Kraiss, K.-F., Rapid signer adaptation for isolated sign language recognition (2006) Proceedings of IEEE Workshop on Vision for Human-computer Interaction (V4HCI) Wen, Z., Huang, T., Capturing subtle facial motions in 3D face tracking (2003) Proceedings of International Conference of Computer Vision, pp. 1343-1350 Zhu, Z., Ji, Q., Robust real-time face pose and facial expression recovery (2006) Proceedings of IEEE Computer Vision and Pattern Recognition Zieren, J., Kraiss, K.-F., Robust person-independent visual sign language recognition (2005) Proceedings of the 2nd Iberian Conference on Pattern Recognition and Image Analysis IbPRIA. Volume Lecture Notes in Computer Science