log in  |  register  |  feedback?  |  help  |  web accessibility
Logo
PhD Proposal: Generation and Analysis of Strategies in an Evolutionary Social Learning Game
James Ryan Carr - University of Maryland, College Park
Tuesday, March 6, 2012, 12:00-1:00 pm Calendar
  • You are subscribed to this talk through .
  • You are watching this talk through .
  • You are subscribed to this talk. (unsubscribe, watch)
  • You are watching this talk. (unwatch, subscribe)
  • You are not subscribed to this talk. (watch, subscribe)
Abstract

THE PRELIMINARY ORAL EXAMINATION FOR THE DEGREE OF Ph.D. IN COMPUTER SCIENCE FOR

                           James Ryan Carr

Evolutionary game theory has frequently been used to investigate behavioral phenomena   observed in nature. Cultaptation is an evolutionary simulation game that aims to investigate the phenomenon of social learning, or learning from the behavior of others. Games like Cultaptation have proven significantly more difficult to analyze than classical EGT problems, due to the complications introduced by allowing social learning: agents can live for multiple generations, interact with one another, and their fitness at each generation is determined by all of their previous actions.

My work has had two main objectives: (1) to study the nature of Cultaptation to see what types of strategies are effective; and (2) more generally, to develop ways of analyzing evolutionary environments with social learning. My results to date include the following:

1. I show how lookahead search techniques can be used to analyze the reproductive success of existing strategies by calculating their expected utility to within any epsilon > 0.

2. I show how to compute a near-best response strategy for Cultaptation using a finite-horizon lookahead search.

3. I present the Cultaptation Strategy Learning Algorithm, which attempts to find a Cultaptation strategy that is a near-best response to itself, and is therefore a symmetric near-Nash equilibrium.

4. I present experiments that examine the nature of strategies generated with CSLA, and show how such experiments can be used to glean insights into the nature of Cultaptation and social learning in general.

My proposed extensions to this work include:

1. I will develop an improved version of CSLA, which will use analytic methods in place of the simulations used by the current version. This will make it possible to prove that either CSLA returns an epsilon-Nash equilibrium strategy or no such strategy exists for the given parameters, which will provide a much stronger justification for using strategies generated by CSLA to examine properties of social learning in Cultaptation.

2. I will use the insights gleaned from my experiments with CSLA strategies to design a strategy to play in the Cultaptation tournament. This strategy will perform a relaxed lookahead search that will allow it to approximate the effects its actions will have several rounds in the future, which will give it an advantage over the greedy, discount-reward scheme used by the current best strategies. If successful, this strategy will exhibit how the lessons learned from examining CSLA strategies can be applied to improve the social learning capabilities of agents in other environments

Examining Committee:

Dr. Dana Nau                                         -          Chair

Dr. V.S. Subrahmanian                          -          Dept’s Representative

Dr. Michele Gelfand                              -          Committee Member

EVERYBODY IS INVITED TO ATTEND THE PRESENTATION

This talk is organized by Jeff Foster