Poker-AI.org

Re: Online CFRM for postflop decisions

2013-07-05T09:00:41+00:00

The problem is you cannot judge a priory how big this gap is - it might be that its a minor issue and the improvement in speed outweights the accuracy

Statistics: Posted by liuyelian — Fri Jul 05, 2013 9:00 am

Re: Online CFRM for postflop decisions

2013-07-11T17:18:11+00:00

The online calculation can be a good idea, but river only .
It allows to use a wide abstraction because the game tree is so small.

Statistics: Posted by Isildur11 — Sun Jun 30, 2013 9:31 pm

Re: Online CFRM for postflop decisions

2013-05-03T11:37:11+00:00

If you don't have the resources UoA has available I'm pretty sure you are not using close 10k buckets per street even offline... Furthermore, a ton of buckets don't necessarily lead to better results. And finally, a human implicitly creates maybe 20 buckets in his head with way less accuracy.

Statistics: Posted by proud2bBot — Fri May 03, 2013 11:37 am

Re: Online CFRM for postflop decisions

2013-05-03T02:08:36+00:00

proud2bBot wrote:

which abstraction are you talink about? say we use 100 buckets with imperfect recall and LUTs, I'd guess we reach a decent strategy at least in a short time.

yes. but what would be the point when we can use 10000 buckets offline?

Statistics: Posted by somehomelessguy — Fri May 03, 2013 2:08 am

Re: Online CFRM for postflop decisions

2013-05-03T02:01:30+00:00

which abstraction are you talink about? say we use 100 buckets with imperfect recall and LUTs, I'd guess we reach a decent strategy at least in a short time.

Statistics: Posted by proud2bBot — Fri May 03, 2013 2:01 am

Re: Online CFRM for postflop decisions

2013-05-03T01:57:39+00:00

proud2bBot wrote:

obviously I was thinking about using buckets... No one is using a non-bucketing approach even offline for the full game.

well, we probably can't reduce the abstraction, so what's the point?

in no limit this idea would hold some merit however. if we are facing an unexpected bet size, we may solve with that bet size included in the abstraction to remove the issue.

the problem is that to get results in time we have to abstract, a lot. probably too much.

Statistics: Posted by somehomelessguy — Fri May 03, 2013 1:57 am

Re: Online CFRM for postflop decisions

2013-05-03T00:26:57+00:00

obviously I was thinking about using buckets... No one is using a non-bucketing approach even offline for the full game.

Statistics: Posted by proud2bBot — Fri May 03, 2013 12:26 am

Re: Online CFRM for postflop decisions

2013-05-02T19:24:05+00:00

proud2bBot wrote:

how many iterations did you go through per second? I never tried it but the arguments for quick convergence are:
- the board is fixed, so you only have to cope with 47*46 different turn/rivers
- the game tree is way smaller as you cut off a lot of the preflop branches
- you don't deal any2 ranges anymore

let's do some rough estimates:

140 preflop hands.
200 river sequences.

140*47*46*200 = 60536000 information sets

and so we need about 600 million iterations. we won't get that in a few seconds.

obviously it's not as many when removing isomorphs, but still not doable without buckets.

Statistics: Posted by somehomelessguy — Thu May 02, 2013 7:24 pm

Re: Online CFRM for postflop decisions

2013-05-02T19:01:56+00:00

Statistics: Posted by proud2bBot — Thu May 02, 2013 7:01 pm

Re: Online CFRM for postflop decisions

2013-05-02T17:40:51+00:00

no, you won't get good results in time. maybe with heavy postflop abstraction.

you could still use the method of predefined preflop ranges for offline calculation though.

Statistics: Posted by somehomelessguy — Thu May 02, 2013 5:40 pm

Re: Online CFRM for postflop decisions

2013-05-02T17:34:31+00:00

But then you calculate only a subgame with strong restrictions (the given ranges for your and your opponents). Within the sub-game, you'll get an optimal solution, but it might be quite a bit off from the unrestricted nash solution. The problem is you cannot judge a priory how big this gap is - it might be that its a minor issue and the improvement in speed outweights the accuracy, but it might also be the other way... Moreover, you cannot calculate the unabstracted game and the abstracted game and generalize the difference to other games (e.g. other stack sizes, other board textures, ...)
Speed-wise it should be doable online as the game is much smaller and you can change the card generation such that only hands part of the ranges are generated.

Statistics: Posted by proud2bBot — Thu May 02, 2013 5:34 pm

Re: Online CFRM for postflop decisions

2013-05-02T16:36:59+00:00

proud2bBot wrote:

haven't looked into CFRD into detail, but your first approach will not work: you are basically assuming any2 ranges in limped pots as well as in 4 bet pots...

Not if I consider preflop ranges from an expert model for example.

Statistics: Posted by LOLWorld — Thu May 02, 2013 4:36 pm

Re: Online CFRM for postflop decisions

2013-05-01T22:38:07+00:00

haven't looked into CFRD into detail, but your first approach will not work: you are basically assuming any2 ranges in limped pots as well as in 4 bet pots...

Statistics: Posted by proud2bBot — Wed May 01, 2013 10:38 pm

Re: Online CFRM for postflop decisions

2013-05-01T17:39:48+00:00

Isn't it the same idea that imperfect recall?
Both player will have all possible hole cards with the same probability, I know it isn't correct but on the other hand we have the benefit of a smaller tree.
Does it introduce a huge bias?
You can also have ranges from your expert model or precalculated with CFR-D http://poker-ai.org/phpbb/viewtopic.php?f=25&t=2433

Statistics: Posted by LOLWorld — Wed May 01, 2013 5:39 pm

Re: Online CFRM for postflop decisions

2013-05-01T17:23:49+00:00

Realtime equilibrium computation is an easy way to face the problems of Sparbot/GS3: strategy knitting just don't work as good as is expected to. And you still need reach probabilities for every information set (it'll be a hard time to get a good estimation of them).
However, if I recall correctly, some of Tartanians solve their LP in realtime, so theoretically you may try to run CFRM the same way but it'll be hard to get good results in 2-3 seconds.

Statistics: Posted by sn0w — Wed May 01, 2013 5:23 pm

Re: Online CFRM for postflop decisions

2013-05-01T17:05:20+00:00

The problem is that you can't view the postflop state isolated: CFRM needs to know with what ranges you and your opponent are going to the flop...

Statistics: Posted by proud2bBot — Wed May 01, 2013 5:05 pm

Online CFRM for postflop decisions

2013-05-01T16:28:30+00:00

Did some of you guys tried to compute online CFRM for postflop decisions?
As you know the flop, the remaining game tree is way smaller.
Is it enough to compute a good NE approximation of LHE HU in a short time or is it still intractable even with super computers?

Statistics: Posted by LOLWorld — Wed May 01, 2013 4:28 pm