Poker-AI.org

Poker AI and Botting Discussion Forum
It is currently Mon Nov 13, 2023 5:17 pm

All times are UTC




Post new topic Reply to topic  [ 9 posts ] 
Author Message
PostPosted: Sat May 27, 2017 2:50 pm 
Offline
Junior Member

Joined: Sat May 27, 2017 2:35 pm
Posts: 33
I searched the forum and surprisingly this question hasn't been asked yet.

I've read through the pandora's box that's in the archive and impressive speeds were achieved. I've seen this too https://github.com/ashelly/PET but tried one of them (SpecialK) and could not reproduce anything close to the speed shown on a comparable system through Python ctypes (0.1MH/S achieved vs the 24MH/s shown). I tried Python directly using lookups on the 126MB "HandRanks.dat" table but could only achieve ~0.12MH/S.

So the question is:

In C or C++, what is the fastest hand evaluator for 5 or 7 (or even 6) cards that does not rely on a large lookup table? (Large being defined as anything >10MB)

Side note: The library would probably be wrapped for Python use for machine learning so technically C or C++ isn't a great requirement although I am more familiar with those languages.

Thank you


Top
 Profile  
 
PostPosted: Sat May 27, 2017 6:15 pm 
Offline
Site Admin
User avatar

Joined: Sun Feb 24, 2013 9:39 pm
Posts: 642
Sorry, don't know the answer to your question, but I am suspicious of the results presented at https://github.com/ashelly/PET . I've just tested my java version of the twoplustwo evaluator and get 136 Mh/s vs his 21 Mh/s, on roughly comparable machines

Quote:
I tried Python directly using lookups on the 126MB "HandRanks.dat" table but could only achieve ~0.12MH/S.

My evaluator does this too, so it looks like your performance problem is something to do with Python


Top
 Profile  
 
PostPosted: Sat May 27, 2017 11:20 pm 
Offline
Junior Member

Joined: Sat May 27, 2017 2:35 pm
Posts: 33
spears wrote:
Sorry, don't know the answer to your question, but I am suspicious of the results presented at https://github.com/ashelly/PET . I've just tested my java version of the twoplustwo evaluator and get 136 Mh/s vs his 21 Mh/s, on roughly comparable machines

Quote:
I tried Python directly using lookups on the 126MB "HandRanks.dat" table but could only achieve ~0.12MH/S.

My evaluator does this too, so it looks like your performance problem is something to do with Python


Yeah the results aren't ideal but they're the only one of its kind I found. Do you know of any other poker evaluator test comparisons?

Second, I'm surprised by your speeds in relation to mine. Python's performance isn't great in general but I would have thought for a simple case like this it wouldn't be off by a few factors.

A few things to note are that my speed were with "random" lookups with a comparison. So I was pitting AsTs vs 3s3c (what should be close to a perfect flip) on a random 5-card board. I was doing one initial lookup of the board, then using the integer returned to do two additional lookups for hero and villain each. Also, something I read on StackOverflow with regards to the 2p2 LUT: "The [2p2 LUT] algorithm has very poor locality of reference, execution time is going to be dominated by the speed of the memory bus since the array is too large to fit in the cache.". So there might be other factors at play here? (My CPU is a Core i3 4350, what's yours?)

I'll try some other evaluators out in the meantime, (this one looks promising for now https://github.com/zekyll/OMPEval - also has an included comparison) :)


Top
 Profile  
 
PostPosted: Sun May 28, 2017 2:31 am 
Offline
Senior Member
User avatar

Joined: Sun Mar 10, 2013 10:31 am
Posts: 139
viewtopic.php?f=24&t=2390&start=20#p7205


Top
 Profile  
 
PostPosted: Sun May 28, 2017 8:43 am 
Offline
Site Admin
User avatar

Joined: Sun Feb 24, 2013 9:39 pm
Posts: 642
I assume you have found these java comparisons:
Enumeration http://www.poker-ai.org/archive/www.pok ... &sk=t&sd=a
Random http://www.poker-ai.org/archive/www.pok ... 913#p28913
and the wayback machine
http://web.archive.org/web/201001052021 ... -poker-bot

I think the evaluation methodology of the random test is flawed and shows the twoplustwo based evaluators in an unreasonably poor light. You can do monte carlo simulation without reseting the state in the LUT, so I would expect to get results much closer to the enumeration results

My cpu = Q8200 @2.33GHz and the test was an enumeration of hand ranks. Because this is so simple, once you start doing something useful like finding the chance of a hand winning the speed drops dramatically, but that is true of all the evaluators.

I don't know much about Python but guess it's an order of magnitude slower than C. Maybe calls from Python to C are slow.

If I was after a small memory C++ evaluator I'd take a look at poker stove.

Why do you need a small LUT?


Top
 Profile  
 
PostPosted: Sun May 28, 2017 11:45 am 
Offline
Junior Member

Joined: Sat May 27, 2017 2:35 pm
Posts: 33
nefton wrote:
http://poker-ai.org/phpbb/viewtopic.php?f=24&t=2390&start=20#p7205


Speed?

spears wrote:
I assume you have found these java comparisons: ...

I think the evaluation methodology of the random test is flawed and shows the twoplustwo based evaluators in an unreasonably poor light. You can do monte carlo simulation without reseting the state in the LUT, so I would expect to get results much closer to the enumeration results

My cpu = Q8200 @2.33GHz and the test was an enumeration of hand ranks. Because this is so simple, once you start doing something useful like finding the chance of a hand winning the speed drops dramatically, but that is true of all the evaluators.

I don't know much about Python but guess it's an order of magnitude slower than C. Maybe calls from Python to C are slow.

If I was after a small memory C++ evaluator I'd take a look at poker stove.

Why do you need a small LUT?


What do you mean by resetting the state of the LUT? You mean reloading the table each iteration?

Yes, so I can confirm it's not related to my CPU. You're likely right that it's a problem with Python and I'll have to fiddle with it to see how fast I can get it to go.

I don't really need a small LUT at this time but one of the reasons for a fast hand evaluator is for use in machine learning. So I thought if I were ever to stick it on a server for computing power, the memory/disk usage should be as low as possible.


Top
 Profile  
 
PostPosted: Sun May 28, 2017 3:14 pm 
Offline
Site Admin
User avatar

Joined: Sun Feb 24, 2013 9:39 pm
Posts: 642
Quote:
What do you mean by resetting the state of the LUT?


To "navigate" the LUT you start with an empty hand. Then you find a state corresponding to a single card, then the state corresponding to two cards, etc until you find the state corresponding to seven cards whereupon you can find the hand rank. But suppose you are on the flop and you have hero and villains hole cards. Then you find the state for the flop and hole cards just once. If you are just finding the hand rank of random 7 card hands you have to start from no cards, aka "reset the state"


Top
 Profile  
 
PostPosted: Sun May 28, 2017 3:22 pm 
Offline
Senior Member
User avatar

Joined: Sun Mar 10, 2013 10:31 am
Posts: 139
3 Mh/s


Top
 Profile  
 
PostPosted: Sun May 28, 2017 6:01 pm 
Offline
Junior Member

Joined: Sat May 27, 2017 2:35 pm
Posts: 33
spears wrote:
Quote:
What do you mean by resetting the state of the LUT?


To "navigate" the LUT you start with an empty hand. Then you find a state corresponding to a single card, then the state corresponding to two cards, etc until you find the state corresponding to seven cards whereupon you can find the hand rank. But suppose you are on the flop and you have hero and villains hole cards. Then you find the state for the flop and hole cards just once. If you are just finding the hand rank of random 7 card hands you have to start from no cards, aka "reset the state"


I see, I didn't know that was the methodology


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 9 posts ] 

All times are UTC


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Powered by phpBB® Forum Software © phpBB Group