This project is just getting under way (September 2001). Some of our past research forming the base for the current project is detailed at:

Selected Online Resources

Research on Vision-based Gesture Analysis and Multimodal Interfaces

GeoVISTA Center's Collaborative Visualization Overview

GeoVISTA Center's Geovirtual Environments Overview

SIGGRAPH

Related Publications

Brewer, I. (2002). Cognitive Systems Engineering and GIScience: Lessons learned from a work domain analysis for the design of a collaborative, multimodal emergency management GIS. Proceedings, GIScience 2002, Boulder, CO, pp. 22-25.

Brewer, I. & McNeese, M. D. 2003, Using Cognitive Systems Engineering to Develop Collaborative Geospatial Military Technologies. Proceedings of the International Conference on Military Geology and Geography, United States Military Academy, West Point, NY, 15-18 June, 2003.

Cai, G. 2002, GeoVIBE: A visual interface for geographical information in digital libraries. In K. Börner & C. Chen (Eds.), Visual Interfaces to Digital Libraries (Vol. LNCS: 2539, pp. 171-187): Springer-Verlag.

Cai, G. (2002). GeoVSM: An Integrated Retrieval Model For Geographical Information. Lecture Notes in Computer Science, International Conference on Geographical Information Sciences (GIScience 2002), Boulder, CO.

Cai, G., MacEachren, A. M., Fuhrmann, S., & Brewer, I. in press, Natural Conversational Interfaces to Geospatial Databases. Transactions in GIS.

Cai, G., Wang, H., & MacEachren, A). Communicating Vague Spatial Concepts in Human-GIS Interactions: A Collaborative Dialogue Approach. COSIT 2003: Conference on Spatial Information Theory, Ittingen, Switzerland, 24-28 September. {preprint}

Fuhrmann, S., Brewer, I., & MacEachren, A. M. (2003), Collaborative emergency management with multimodal GIS. ESRI User Conference, San Diego, CA, July 6-9, 2003.

Fuhrmann, S. & Pike, W. in press, Toward usability assessment methods for user-centered collaborative geovisualization tool design. In J. Dykes & A. M. MacEachren & M.-J. Kraak (Eds.), Exploring Geovisualization. Amsterdam: Elsevier.

Kettebekov, S., Yeasin, M., & Sharma, R. in press, Prosody based audio-visual co-analysis for coverbal gesture recognition. IEEE Transactions on Multimedia, special issue on Multimodal Interfaces.

Kettebekov, S., Yeasin, M., & Sharma, R. in press, Prosody Based Co-analysis for Continuous Recognition of Coverbal Gestures. Proceedings, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Madison, WI, June, 2003, pp. 565-570.

Kettebekov, S., Yeasin, M., Krahnstoever, N., & Sharma, R. (2002). Prosody Based Co-analysis of Deictic Gestures and Speech in Weather Narration Broadcast. Workshop on Multimodal Resources and Multimodal System Evaluation. (LREC 2002), Las Palmas, Spain, June 1, 2002, pp. 57-62.

Kettebekov, S., Yeasin, M., & Sharma, R. (2002). Prosody Based Co-analysis for Continuous Recognition of Coverbal Gestures. Fourth International Conference on Multimodal Interfaces (ICMI), Pittsburgh, USA, October 14-16, 2002, pp. 161-166.

Krahnstoever, N. & Sharma, R. 2002, Robust probabilistic estimation of uncertain appearance for model based tracking. Proceedings, IEEE Workshop on Applications of Computer Vision, Orlando, Dec. 5-6, pp. 28-33.

Krahnstoever, N. & Sharma, R. 2003, Appearance management and cue fusion for 3D model-based tracking. Proceedings, IEEE Conference on Computer Vision and Pattern Recognition (CVPR'03), Madison, WI, June, 2003, pp. 249-257.

Krahnstoever, N. & Sharma, R. 2004, Articulated Models From Video. Proceedings, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Washington DC, June, 2004.

Krahnstoever, N., Yeasin, M., & Sharma, R. 2003, Automatic Acquisition and Initialization of Articulated Models. Machine Vision and Applications, 14(4), 218-228.

Krahnstoever, N., Kettebekov, S., Yeasin, M., & Sharma, R. 2002a. A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays (Technical Report CSE-02-010): Dept. of Computer Science and Engineering, 220 Pond Lab, University Park, PA.

Krahnstoever, N., Kettebekov, S., Yeasin, M., & Sharma, R. (2002b). A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays. Fourth International Conference on Multimodal Interfaces (ICMI), Pittsburgh, PA USA, October 14-16, pp. 349-354.

Krahnstoever, N., Yeasin, M., & Sharma, R. (2001). Automatic Acquisition and Initialization of Kinematic Models. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Technical Sketches, Kauai Marriott, Hawaii, USA, Dec.

Krahnstoever, N., Yeasin, M., & Sharma, R. to appear, 2002. Automatic Acquisition and Initialization of Articulated Models. Machine Vision and Applications.

MacEachren, A. M., Cai, G., Sharma, R., Rauschert, I., Brewer, I., Bolelli, L., Shaparenko, B., Fuhrmann, S., & Wang, H. in press, Enabling collaborative geoinformation access and decision-making through a natural, multimodal interface. International Journal of Gegraphical Information Science.

MacEachren, A. M. (in press). Moving geovisualization toward support for group work. In J. Dykes & A. M. MacEachren & M.-J. Kraak (Eds.), Exploring Geovisualization, Elsevier Science, Tarrytown, NY.

MacEachren, A. M. & Brewer, I. (in press). Developing a conceptual framework for visually-enabled geocollaboration. International Journal of Geographical Information Science.

MacEachren, A. M., Brewer, I., Cai, G., & Chen, J. (2003). Visually-Enabled Geocollaboration to Support Data Exploration and Decision-Making. International Cartographic Conference, Durban, South Africa, August 10-16, 2003.

MacEachren, A. M. & Cai, G.(in press). Geocollaboration for decision-making: Visual mediation to enable human-system and human-human dialogue. International Advanced Workshop on Virtual Geographic Environments and Geocollaboration, The Chinese University of Hong Kong, December 15-16, 2003.

MacEachren, A. M., Gahegan, M., Pike, W., Brewer, I., Cai, G., Lengerich, E., & Hardisty, F. 2004, Geovisualization for knowledge construction and decision-support. Computer Graphics & Applications, 24(1), 13-17.

MacEachren, A. M., Gahegan, M., & Pike, W. Visualization for Constructing and Sharing Concepts. Proceedings of the National Academy of Science, invited paper for Sackler Colloquium on Mapping Knowledge Domains, Irvine, CA, May 9-11, 2003.

Ozyildiz, E., Krahnstoever, N., & Sharma, R. 2002. Adaptive Texture and Color Segmentation for Tracking Moving Objects. Pattern Recognition, 35(10), 2013-2020.

Polat, E., Yeasin, M., & Sharma, R. 2003, 2D/3D model-based tracking framework. Pattern Recognition, 36(9), 2127-2141.

Rauschert, I., Agrawal, P., Fuhrmann, S., Brewer, I., Wang, H., Sharma, R., Cai, G., & MacEachren, A. (in press). Designing a Human-Centered, Multimodal GIS Interface to Support Emergency Management. ACM GIS'02, 10th ACM Symposium on Advances in Geographic Information Systems, Washington, DC, USA, November, 2002.

Rauschert, I., Fuhrmann, S., Brewer, I., & Sharma, R. (2002). Approaching a New Multimodal GIS-Interface. Proceedings, GIScience 2002, Boulder, CO.

Sharma, R., Kettebekov, S., & Yeasin, M. 2002. Method of Visual and Acoustic Signal Co-analysis for Co-verbal Gesture Recognition, Dept. Of Computer Science & Eng., Technical Report (Vol. CSE-02-015). USA: Pennsylvania State University.

Sharma, R., Yeasin, M., Krahnstoever, N., Rauschert, I., Cai, G., Brewer, I., MacEachren, A. M., & Sengupta, K. 2003, Speech-gesture driven multimodal interfaces for crisis management. Proceedings of the IEEE, 91(9), 1327-1354.