Category: Verbal and Nonverbal

Bringing together multimodal and multilevel approaches to study the emergence of social bonds between children and improve social AI

Bonnaire, J., Dumas, G., and Cassell, J. (2024). Bringing together multimodal and multilevel approaches to study the emergence of social bonds between children and improve social AI. In Frontiers in Neuroergonomics Volume 5 – 2024.

  • Rapport
  • Verbal and Nonverbal

Artificial intelligence for a social world

Cassell, J. (2019). Artificial intelligence for a social world. Issues in Science and Technology, 35(4), 29-36.

  • Embodied Conversational Agents
  • Social Skills
  • Verbal and Nonverbal
  • Virtual Peers

“I think it might help if we multiply, and not add”: Detecting indirectness in conversation

Goel, P., Matsuyama, Y., Madaio, M., & Cassell, J. (2019). “I think it might help if we multiply, and not add”: Detecting indirectness in conversation. In Proceedings of the 9th International Workshop on Spoken Dialogue System Technology(pp. 27-40). https://doi.org/10.1007/978-981-13-9443-0_3

  • Computational Models of Behavior
  • Conversation
  • Verbal and Nonverbal

Curious Minds Wonder Alike: Studying Multimodal Behavioral Dynamics to Design Social Scaffolding of Curiosity

Sinha, T., Bai, Z., Cassell, J. (2017, September), “Curious Minds Wonder Alike: Studying Multimodal Behavioral Dynamics to Design Social Scaffolding of Curiosity”, In proceedings of 12th European Conference on Technology Enhanced Learning (pp 270-285). Springer International Publishing

  • Computational Models of Behavior
  • Conversation
  • Education
  • Multimodal
  • Peers
  • Verbal and Nonverbal

A New Theoretical Framework for Curiosity for Learning in Social Contexts

Sinha, T., Bai, Z., Cassell, J. (2017, September), “A New Theoretical Framework for Curiosity for Learning in Social Contexts”, In proceedings of 12th European Conference on Technology Enhanced Learning (pp 254-269). Springer International Publishing   [*Best Paper Nominee (Top 4.2% of all paper submissions)*]

  • Computational Models of Behavior
  • Conversation
  • Education
  • Multimodal
  • Peers
  • Verbal and Nonverbal

Using Temporal Association Rule Mining to Predict Dyadic Rapport in Peer Tutoring

Madaio, M., Ogan, A., Cassell, J. (2017). Using Temporal Association Rule Mining to Predict Dyadic Rapport in Peer Tutoring. In Proceedings of the 10th International Conference on Educational Data Mining, 2017. (in press).

  • Education
  • Embodied Conversational Agents
  • Machine Learning
  • Multimodal
  • Peer-Tutoring
  • Peers
  • Rapport
  • Social Skills
  • Verbal and Nonverbal

The Impact of Peer Tutors’ Use of Indirect Feedback and Instructions

Madaio, M. A., Cassell, J., & Ogan, A. (2017, June). The Impact of Peer Tutors’ Use of Indirect Feedback and Instructions. In Proceedings of the Twelfth International Conference of Computer-Supported Collaborative Learning, 2017[*Best Student Paper Nominee*]

  • Conversation
  • Direction-Giving
  • Education
  • Multimodal
  • Peer-Tutoring
  • Peers
  • Rapport
  • Social Skills
  • Verbal and Nonverbal

Socially-Aware Animated Intelligent Personal Assistant Agent

Matsuyama, M., Bhardwaj, A., Zhao, R., Romero, O., Akoju, S., Cassell, J. (2016, September). Socially-Aware Animated Intelligent Personal Assistant Agent, 17th Annual SIGDIAL Meeting on Discourse and Dialogue

  • Architectures
  • Computational Models of Behavior
  • Embodied Conversational Agents
  • Implementation
  • Machine Learning
  • Multimodal
  • Natural Language Generation (NLG)
  • Rapport
  • Verbal and Nonverbal

Socially-Aware Virtual Agents: Automatically Assessing Dyadic Rapport from Temporal Patterns of Behavior

Zhao, R., Sinha, T., Black, A., & Cassell, J. (2016, September). “Socially-Aware Virtual Agents: Automatically Assessing Dyadic Rapport from Temporal Patterns of Behavior”, 16th International Conference on Intelligent Virtual Agents (IVA) [*Best Student Paper*]

  • Computational Models of Behavior
  • Conversation
  • Education
  • Machine Learning
  • Multimodal
  • Peer-Tutoring
  • Rapport
  • Verbal and Nonverbal

Automatic Recognition of Conversational Strategies in the Service of a Socially-Aware Dialog System

Zhao, R., Sinha, T., Black, A., & Cassell, J. (2016, September). “Automatic Recognition of Conversational Strategies in the Service of a Socially-Aware Dialog System”, 17th Annual SIGDIAL Meeting on Discourse and Dialogue

  • Computational Models of Behavior
  • Conversation
  • Education
  • Machine Learning
  • Multimodal
  • Peer-Tutoring
  • Rapport
  • Verbal and Nonverbal