Poker-AI.org

Poker AI and Botting Discussion Forum
It is currently Mon Nov 13, 2023 11:56 am

All times are UTC




Post new topic Reply to topic  [ 1 post ] 
Author Message
 Post subject: parallelize mccfr
PostPosted: Fri Mar 12, 2021 5:27 pm 
Offline
New Member

Joined: Fri Mar 12, 2021 3:53 pm
Posts: 9
Entire games with hierarchical abstraction can be parallelized fairly straightforwardly. The first round runs one thread, and when it reaches the second round, each thread samples chance from a different 'public bucket' (and weighs the values), ensuring that no threads share the same infoset on a future street.

However, I can not find such a simple way to parallelize single street subgames with mccfr. Here are some ideas that I've had:

1) Preventing threads from sampling the same hand - I believe this could undersample hands that you are more likely to have. It may work with a uniform distribution of hands.

2) Allowing race conditions - I've found one thread on this forum from a decade ago that had tried this unsuccessfully.

3) Using locks - This seems expensive and unlikely to give much speedup.

4) Using an iterative algorithm - I've implemented vector form cfr both recursively and iteratively, but the sampling in external sampling mccfr makes it much more suitable to recursion.

5) Parallelizing getting ev for each action - I've never used nested parallelism. I'm guessing there is some overhead even when using threadpools, but this is the best solution I've come up with.

I've tried to download Amax's river solver, but the link seems to be dead.

Does anyone have any experience or ideas?


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 1 post ] 

All times are UTC


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Powered by phpBB® Forum Software © phpBB Group