| Poker-AI.org http://poker-ai.org/phpbb/ |
|
| Looking for C++ programmer for DeepCFR implementation http://poker-ai.org/phpbb/viewtopic.php?f=33&t=3482 |
Page 1 of 1 |
| Author: | FlashPlayer [ Mon Sep 06, 2021 5:32 pm ] |
| Post subject: | Looking for C++ programmer for DeepCFR implementation |
. |
|
| Author: | llllllllll [ Tue Sep 07, 2021 8:10 am ] |
| Post subject: | Re: Looking for C++ programmer for DeepCFR implementation |
You really should not be using vector form cfr as a base for deep cfr. Deep cfr does a bunch of external sampling mccfr iterations and then a ton (iirc 32k in the experiments) of stochastic gradient descent iterations. This is called a single deep cfr iteration. "Intel tbb lib, SIMD, hand isomorphism, O(n) showdown calculations and other optimization hacks - all this will be needed in final realization." If you wanted to make a really optimized implementation you would do it all on gpu (only moving the new samples to cpu to add to the memory buffer) with large batched inference calls. So then why are you using intel tbb? What is the purpose of hand isomorphism when the network generalizes over the card embeddings? O(n) showdown calculations are not possible if you are sampling chance (as is done in external sampling) Anyway the real bottleneck is in training the neural network each iteration, you may aswell just use python for everything and not worry too much about optimizing the mccfr iterations Training will also be very expensive, gl |
|
| Page 1 of 1 | All times are UTC |
| Powered by phpBB® Forum Software © phpBB Group http://www.phpbb.com/ |
|