Poker-AI.org

Poker AI and Botting Discussion Forum
It is currently Mon Nov 13, 2023 2:18 pm

All times are UTC




Post new topic Reply to topic  [ 8 posts ] 
Author Message
PostPosted: Fri Mar 22, 2013 9:18 pm 
Offline
Senior Member

Joined: Mon Mar 11, 2013 10:24 pm
Posts: 216
CFRM has been proven to result in nash-equilibrium approximations for zero-sum games. I wonder how to incorporate the rake in. For instance, in some games a optimal strategy might be to see a lot of flops by limping for example w/o considering rake, while minRaising might be way better if we consider rake.
Obviously, we could add a rake model and change the values in all terminal nodes correspondingly. However, this would change the game as its not a zero-sum game anymore. Does anyone know if we still get a good approximation? Or how do you factor in rake in cash games?


Top
 Profile  
 
PostPosted: Fri Mar 22, 2013 9:34 pm 
Offline
Veteran Member

Joined: Thu Feb 28, 2013 2:39 am
Posts: 437
Isn't it still zero-sum if both players pay the same amount of rake (assuming a two player game)?


Top
 Profile  
 
PostPosted: Fri Mar 22, 2013 10:03 pm 
Offline
Senior Member

Joined: Mon Mar 11, 2013 10:24 pm
Posts: 216
first the assumption might be wrong as it depends on the playing style, second I think even if its right - as far as I understood the GTO basics - its not a zero sum game anymore.


Top
 Profile  
 
PostPosted: Fri Mar 22, 2013 11:24 pm 
Offline
New Member

Joined: Sun Mar 10, 2013 12:18 am
Posts: 3
Like this?

Quote:
To create an aggressive agent, we used the Counterfactual Regret Minimization technique from
Chapter 3, but with one change. On every terminal node of the game tree, we gave a 7% bonus in
utility to the winning player, while the losing player did not pay any extra cost. This means that the
game is no longer zero sum, as more money is being introduced on each hand. The important benefit
of this approach is that the agent always thinks it has better odds than it actually does — it is more
willing to fight for marginal pots. For every $1 it invests in a bet, it thinks it will receive $1.07 in
return even if the opponent immediately folds, and $2.14 if the opponent calls the bet and the agent
wins the showdown. This extra return on investment encourages it to bet in more situations where it
might otherwise call or fold. However, since it learns its strategy by playing against an agent trying
to exploit it, it learns to express this extra aggression in a balanced way that still effectively hides
information.
source: http://poker.cs.ualberta.ca/publications/johanson.msc.pdf, pg.82

So instead of adding a 7% bonus to pots, you would subtract x% for rake.


Top
 Profile  
 
PostPosted: Sat Mar 23, 2013 12:03 am 
Offline
Senior Member

Joined: Mon Mar 11, 2013 10:24 pm
Posts: 216
ahhh, I remember they were doing something like that and they converged. Thanks magnum!


Top
 Profile  
 
PostPosted: Mon Mar 25, 2013 11:11 pm 
Offline
Site Admin
User avatar

Joined: Thu Feb 28, 2013 5:24 pm
Posts: 230
This assumes a constant rake though. Most poker sites cap their rake somewhere which would probably have interesting effects on strategies. But since it is still symmetrical, I don't see why it shouldn't converge.

_________________
Cheers.


Top
 Profile  
 
PostPosted: Mon Mar 25, 2013 11:28 pm 
Offline
Senior Member

Joined: Mon Mar 11, 2013 10:24 pm
Posts: 216
I'm planning on just adding a "ValueChanger" to each showdown node, which gets the node as input and outputs the factor for the winner/loser. Default it returns always 1. But then we can return another factor to make our bot more agressive or to incorporate rake. The later can be implemented as we have the node as input, hence we know which round are we at and can apply the rake formula of our target site.


Top
 Profile  
 
PostPosted: Wed Dec 11, 2013 4:29 pm 
Offline
Junior Member

Joined: Mon Dec 02, 2013 3:02 pm
Posts: 19
If we would minus some percent for rake (say 5), but could add some for aggression (say 5) then would a strategy generated with neither simply be overaggressive (and not nash) when played in raked games?


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 8 posts ] 

All times are UTC


Who is online

Users browsing this forum: No registered users and 2 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Powered by phpBB® Forum Software © phpBB Group