Understanding LLM Behavior through Cognitive Tasks
Creating systems through which cognitive tasks can be administered to LLM in a reproducible way and which can allow comparison across LLM implementations and prompting regimes.
Bottom-up understanding of LLM is difficult, so we adopt a top down approach to characterising cognition in LLM through the use of decision making tasks and other cognitive tasks used in cognitive science.
Behavioral Analysis: Analyze the output of LLMs in terms of cognitive behaviour. Identify patterns and regularities in their responses, shedding light on how LLMs mimic or diverge from human cognitive processes.
Cognitive Understanding of LLMs: Develop cognitive models that simulate perceiving and processing language, making decisions, and generating responses.
Manage Cookie Consent
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
The technical storage or access that is used exclusively for statistical purposes.The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.