Poker-AI.org

Poker AI and Botting Discussion Forum
It is currently Mon Nov 13, 2023 6:46 pm

All times are UTC




Post new topic Reply to topic  [ 10 posts ] 
Author Message
 Post subject: New Open Test Bed
PostPosted: Fri Oct 18, 2013 1:29 pm 
Offline
Regular Member
User avatar

Joined: Wed Oct 02, 2013 5:00 pm
Posts: 64
Hi there,

I'm making some improvements to the old Open Test Bed project (Tournaments for example), and would like to know if people here still uses it. Does it make sense to take over the project (I've being talking with the original author about that), so we can continue to push it forward?

Or I'm loosing my time with it and there are better ways to test our bots (at least the Java based ones) that I'm not aware of?

UPDATED: Here's the full source: https://github.com/corintio/opentestbed

-Corintio


Last edited by corintio on Fri Oct 18, 2013 9:53 pm, edited 1 time in total.

Top
 Profile  
 
 Post subject: Re: New Open Test Bed
PostPosted: Fri Oct 18, 2013 8:31 pm 
Offline
Veteran Member

Joined: Mon Mar 04, 2013 9:40 pm
Posts: 269
Quote:
Or I'm loosing my time with it and there are better ways to test our bots (at least the Java based ones) that I'm not aware of?


I like to test live in play money games as you get to see a wide range of player types. It is slow but it works. I watch it play and take notes of issues.

I also like to test it against itself vs random boards and situations to ensure its actions are polarized. I use this for leak testing quite extensively. An example is running thru 100k hands preflop and see what its PFR, 3 Bet, OOP call etc percentages are. These percentages change based on the player type but its important that the baseline strategy is near GTO as possible. I do this for flop games as well to see how it handles a turn barrel, river check raise, how often it c-bets etc.


Top
 Profile  
 
 Post subject: Re: New Open Test Bed
PostPosted: Fri Oct 18, 2013 9:23 pm 
Offline
Veteran Member

Joined: Thu Feb 28, 2013 2:39 am
Posts: 437
If you setup the ACPC server we can all compete.


Top
 Profile  
 
 Post subject: Re: New Open Test Bed
PostPosted: Fri Oct 18, 2013 9:52 pm 
Offline
Regular Member
User avatar

Joined: Wed Oct 02, 2013 5:00 pm
Posts: 64
shalako wrote:
Quote:
Or I'm loosing my time with it and there are better ways to test our bots (at least the Java based ones) that I'm not aware of?


I like to test live in play money games as you get to see a wide range of player types. It is slow but it works. I watch it play and take notes of issues.

I also like to test it against itself vs random boards and situations to ensure its actions are polarized. I use this for leak testing quite extensively. An example is running thru 100k hands preflop and see what its PFR, 3 Bet, OOP call etc percentages are. These percentages change based on the player type but its important that the baseline strategy is near GTO as possible. I do this for flop games as well to see how it handles a turn barrel, river check raise, how often it c-bets etc.

Yes, there is nothing like testing it in the "production" environment :) Unfortunately I'm not there yet, still working on the AI.

But there are cases where you need to run thousands (millions?) of hands (for training ANNs, for gathering statistics on PT, etc...) so I think that for these situations OTB is still a valid option, right?

Well, if someone is interested, I just uploaded my version to GitHub: https://github.com/corintio/opentestbed It has initial support for Tournaments

Any comments, patches, issue reports are welcome!


Top
 Profile  
 
 Post subject: Re: New Open Test Bed
PostPosted: Fri Oct 18, 2013 9:55 pm 
Offline
Regular Member
User avatar

Joined: Wed Oct 02, 2013 5:00 pm
Posts: 64
Nasher wrote:
If you setup the ACPC server we can all compete.

I plan to do that, but is ACPC faster than OTB for simulations? Do you know if the current version of ACPC is compatible with the Java version protocol?


Top
 Profile  
 
 Post subject: Re: New Open Test Bed
PostPosted: Fri Oct 18, 2013 10:14 pm 
Offline
Veteran Member

Joined: Thu Feb 28, 2013 2:39 am
Posts: 437
I would think ACPC is faster. I don't know about the protocol.


Top
 Profile  
 
 Post subject: Re: New Open Test Bed
PostPosted: Sat Oct 19, 2013 8:53 am 
Offline
Junior Member

Joined: Wed Sep 04, 2013 6:05 pm
Posts: 47
ACPC protocol seems to be plain text :

http://www.computerpokercompetition.org ... otocol.pdf

So I don't see issue to have java client...

By the way I think that there is a java client for ACPC in the FO2 sources... but for ACPC v1 and not v2...

Regards,

MrNice


Top
 Profile  
 
 Post subject: Re: New Open Test Bed
PostPosted: Mon Oct 21, 2013 9:53 am 
Offline
New Member

Joined: Thu Mar 07, 2013 6:11 pm
Posts: 5
Another option could be http://www.cubeia.org/index.php/poker

bob


Top
 Profile  
 
 Post subject: Re: New Open Test Bed
PostPosted: Sat Nov 09, 2013 1:20 pm 
Offline
Senior Member
User avatar

Joined: Sun Mar 10, 2013 10:31 am
Posts: 139
Why not to write somthing like ACPC, but based on hppt protocol.
In that case Server will be a simple php page(or some pages) at any hosting.
And no any problem like:
[strike]server must have statik IP[/strike]
[s]sevrer and its owner had to wait a long for anoter side configure his software[/s]
and more more more...


Top
 Profile  
 
 Post subject: Re: New Open Test Bed
PostPosted: Sat Nov 09, 2013 1:31 pm 
Offline
Site Admin
User avatar

Joined: Sun Feb 24, 2013 9:39 pm
Posts: 642
bob101 wrote:

Nice find


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 10 posts ] 

All times are UTC


Who is online

Users browsing this forum: No registered users and 3 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Powered by phpBB® Forum Software © phpBB Group