shalako wrote:
Quote:
Or I'm loosing my time with it and there are better ways to test our bots (at least the Java based ones) that I'm not aware of?
I like to test live in play money games as you get to see a wide range of player types. It is slow but it works. I watch it play and take notes of issues.
I also like to test it against itself vs random boards and situations to ensure its actions are polarized. I use this for leak testing quite extensively. An example is running thru 100k hands preflop and see what its PFR, 3 Bet, OOP call etc percentages are. These percentages change based on the player type but its important that the baseline strategy is near GTO as possible. I do this for flop games as well to see how it handles a turn barrel, river check raise, how often it c-bets etc.
Yes, there is nothing like testing it in the "production" environment
Unfortunately I'm not there yet, still working on the AI.
But there are cases where you need to run thousands (millions?) of hands (for training ANNs, for gathering statistics on PT, etc...) so I think that for these situations OTB is still a valid option, right?
Well, if someone is interested, I just uploaded my version to GitHub:
https://github.com/corintio/opentestbed It has initial support for Tournaments
Any comments, patches, issue reports are welcome!