Image Image Image




Post new topic Reply to topic  [ 84 posts ]  Go to page 1, 2, 3, 4, 5  Next
Author Message
 Post subject: Public SNG Testbed
PostPosted: Fri Aug 28, 2009 10:36 am 
Offline
PokerAI fellow
User avatar

Posts: 1673
Favourite Bot: none
Today we are finally releasing a public version of the SNG-Testbed that we developped in a private lab of this forum and mentionned in some previous threads (e.g. this one).

What is it?
  • Goal of said testbed is to be able to run bots against each others in a sit'n go tournament format by simulating the full game mechanisms, including all the events of the Poker Academy Meerkat's API.
  • This testbed allows you to test your SNG aware Meerkat bot much faster that you would in Poker Academy. Such utlra speed (when the bots aren't the bottleneck) runs at millions tourneys per day (On Core i7 about 100000 tourneys per hour).
  • Some simple bots are included, mostly for test purpose and to guide you in developing yours.

The private SNG-testbed forum
Apart from helping you test your own bots faster, one of the goal of this release is to give you a chance to apply to the private subforum. When you feel confident enough about your bot, you can submit it and we will run it against our most advanced private bots.
If your implementation beats ours and shows us that you are a great addition to the group then we will grant you access to a lot more exciting content in there.

To name a few that will give you access to a more advanced version of the testbed, including multi-threading, a GUI to configure the testbed more easily and show the results in much nicer graphs. We are also working on a joint effort to build a more advanced SNG bot, that can also beat real money games.

Now more on this public testbed version:
  • We have included two source files were you can edit configuration and have some insight to how the testbed works in general.
  • GenericDealerOld.java is the entry point, here you can set the output level, your performing bots and the option wether to run HU or fullring with a bunch of default bots. Java programmers will also be able to do some more stuff by modifying the methods in there but do that at your own risk.
  • GameDescription.java lets you set the configuration of the SNGs, stuff like stack size, blind structure, hands per blind level etc.
  • Another file is a helper file that lets you create a bot more easily. HandHelper.java has static methods that check things like "isAA(int[] cards)" etc. Just have a look at it for a total set of methods.
  • The provided SimpleBot.java shows you how to create a bot in general. It uses some of the HandHelper methods for demonstration and implements all needed methods to implement the Meerkat Player interface.
  • All the rest core of the testbed is provided as class files in the sng-testbed-v1.jar library and not released as source code.
  • We also include the meerkat-api.jar library and eclipse .project and .classpath files so you can directly import the project into your eclipse IDE and get going instantly. If you are using a different IDE make sure to include both jars into your build path when building the project and running it.

If you have any questions please use this thread to ask or PM me for more private questions etc.

I hope this will motivate you and I am happily awaiting your submissions!


Attachments:
Public-SNG-Testbed_v1.zip [92.95 KB]
Downloaded 588 times

_________________
Cheers.
Top
 Profile  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Fri Aug 28, 2009 11:39 am 
Offline
Senior member
User avatar

Posts: 451
Favourite Bot: gimmick
Quote:
you can submit it and we will run it against our most advanced bots


Would be way much better if that part is made using a network protocol, instead of requiring submitting binaries.
I believe adapting an already working testing framework to work using a network protocol should be rather easy.


Top
 Profile E-mail  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Fri Aug 28, 2009 11:51 am 
Offline
PokerAI fellow
User avatar

Posts: 1673
Favourite Bot: none
So far no network protocol is in plan and this is currently not the point of the testbed. If you already have an existing framework and a bot for it you can try to code an adapter to the meerkat api and plug it into this testbed. So porting your already existing bots to the testbed is now up to you as we don't want to do that job for you as it was in the past (we got a couple of bots that didn't run out of the box and we had to make changes to get them running which we don't have the time for anymore).

Submitting binaries is also not quite the point. If you want to enter the lab then you have to submit sources aswell to meet the requirements. There is a huge amount of content in there and you have to show first that you are willing to share before we can let you in.

_________________
Cheers.


Top
 Profile  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Fri Aug 28, 2009 12:59 pm 
Offline
Senior member
User avatar

Posts: 166
Favourite Bot: Homebrew
I guess his point is that he is willing to share, but not willing to give away his code unless he knows that it meets the requirements to get into the forum. That is quite understandable, as I would never give away my logics unless I know what I get for.

A solution might be to:
  1. Submit encrypted binary
  2. You check if it is good enough to take him into the forum
  3. Then he shares the source in exchange for access.

How ever, as I concentrate on limit cashgames, I´m not your target audience. ;)


Top
 Profile  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Fri Aug 28, 2009 1:05 pm 
Offline
PokerAI fellow
User avatar

Posts: 1673
Favourite Bot: none
That we could agree on but he still needs to make sure its running in the testbed. We don't want to put any more work in fixing submitted bots.

_________________
Cheers.


Top
 Profile  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Fri Aug 28, 2009 2:37 pm 
Offline
Senior member
User avatar

Posts: 206
Favourite Bot: i7 860
Cool, thanks. What can we come up for the .Net audience?
:drink


Top
 Profile E-mail  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Fri Aug 28, 2009 2:42 pm 
Offline
PokerAI fellow
User avatar

Posts: 2342
Favourite Bot: My next one
Singularity wrote:
Cool, thanks. What can we come up for the .Net audience?
:drink

If you already coded a Meerkat adapter for your C# code that should run fine. There was a sample in a thread around here, I'll see if I can dig it.


Top
 Profile E-mail  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Sat Aug 29, 2009 10:43 am 
Offline
Senior member
User avatar

Posts: 451
Favourite Bot: gimmick
skyd1v3r wrote:
I guess his point is that he is willing to share, but not willing to give away his code unless he knows that it meets the requirements to get into the forum. That is quite understandable, as I would never give away my logics unless I know what I get for.


Exactly that.


Top
 Profile E-mail  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Sat Aug 29, 2009 11:02 am 
Offline
Senior member
User avatar

Posts: 451
Favourite Bot: gimmick
Coffee4tw wrote:
Submitting binaries is also not quite the point. If you want to enter the lab then you have to submit sources aswell to meet the requirements. There is a huge amount of content in there and you have to show first that you are willing to share before we can let you in.


I'm working on cash games so it's just curiosity.

Just some question.
In the lab, is there full access to source code of the bots i have to beat to enter, too?

I mean if i provide source code of a good bot and get back source code of a good bot it's ok.
If i provide source code of good bot and don't get back source code of a good bot because the sources are not availables, it's not ok.
If i provide source code of a good bot and don't get back source code of a good bot because my bot wasn't considered good enough, it's not ok, either.


Top
 Profile E-mail  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Sat Aug 29, 2009 11:21 am 
Offline
PokerAI fellow
User avatar

Posts: 1673
Favourite Bot: none
In the lab we are all working together on several projects hosted on a central SVN server. That way everyone has access to any source code developed in there.
So once you get in you'll have access to everything. But not before you get in.

_________________
Cheers.


Top
 Profile  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Tue Sep 01, 2009 6:09 pm 
Offline
Senior member
User avatar

Posts: 451
Favourite Bot: gimmick
Is this TestBed usable for cash games, too?

How many changes does it need if i want to use for cash games instead of SNG?

I have my own testbed for cash games but it is not particoularly efficient and doen not support meerkat.


Top
 Profile E-mail  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Tue Sep 01, 2009 6:39 pm 
Offline
Junior member
User avatar

Posts: 23
Favourite Bot: mine
Are there any requirements for the bots beside the obvious that it is working?
p.E.
- Speed (you would not be able to test a bot playing 60 hph)
- Hardware Requirements (p.E. Multicore and/or Cuda-Devices)
- Memory Usage
- Disk Usage
- OS used

Are there any statistics and or hand histories of the bots to beat released?


Top
 Profile E-mail  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Tue Sep 01, 2009 8:48 pm 
Offline
PokerAI fellow
User avatar

Posts: 7731
Favourite Bot: V12
Johanson wrote:
Is this TestBed usable for cash games, too?
How many changes does it need if i want to use for cash games instead of SNG?
I have my own testbed for cash games but it is not particoularly efficient and doen not support meerkat.


It's not good for cash games out of the box, but it can be trivially adapted to support them. It's in our todo list. I guess should be there very soon.

_________________
indiana


Top
 Profile E-mail  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Wed Sep 02, 2009 5:01 pm 
Offline
Regular member
User avatar

Posts: 70
Location: Brazil
Favourite Bot: Ciclone
Coffee4tw,

Its possible to run the bots that is in Poker Academy on Testbed ?


Top
 Profile E-mail  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Wed Sep 02, 2009 5:16 pm 
Offline
PokerAI fellow
User avatar

Posts: 7731
Favourite Bot: V12
Ciclone wrote:
Its possible to run the bots that is in Poker Academy on Testbed?

No.

.

_________________
indiana


Top
 Profile E-mail  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Wed Sep 02, 2009 10:18 pm 
Offline
PokerAI fellow
User avatar

Posts: 1673
Favourite Bot: none
Perhaps not right out of the box. If you developed your bot in java against the meerkat API then yes it could run but you might need to make some adjustments. See the sample bot for more info.

If you meant to ask if you can run bots that PA provides, then no you can't. Only self-developed bots can be run in the testbed.

_________________
Cheers.


Top
 Profile  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Thu Sep 03, 2009 1:44 pm 
Offline
Regular member
User avatar

Posts: 70
Location: Brazil
Favourite Bot: Ciclone
Guys,

To minimize the variance, how many tournaments you are running to prove that your bot is a winning bot ?
1.000, 10.000, 100.000, 1.000.000 ?


Top
 Profile E-mail  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Thu Sep 03, 2009 1:51 pm 
Offline
PokerAI fellow
User avatar

Posts: 7731
Favourite Bot: V12
Ciclone wrote:
To minimize the variance, how many tournaments you are running to prove that your bot is a winning bot ? 1.000, 10.000, 100.000, 1.000.000 ?


To minimize the variance: 1.000.000
To prove that your bot is a winning bot: The number of toruneys required to prove that [with sufficiently high confidence] depends on observed ROI and Variance.

_________________
indiana


Top
 Profile E-mail  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Fri Sep 04, 2009 3:01 pm 
Offline
Senior member
User avatar

Posts: 138
Favourite Bot: Custom
Not really looked at the code yet but is it possible to import the hands into poker tracker. If not how hard would it be to store the hands locally and create in the same format.


Top
 Profile  
 
 Post subject: Re: Public SNG Testbed
PostPosted: Fri Sep 04, 2009 3:28 pm 
Offline
PokerAI fellow
User avatar

Posts: 7731
Favourite Bot: V12
@bob101 - I don't get your question. Do you mean to dump the hands that are played in the SNG Testbed in PT format? What is PT HH format anyway - do you mean the PT DB format?

_________________
indiana


Top
 Profile E-mail  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 84 posts ]  Go to page 1, 2, 3, 4, 5  Next


Who is online

Users browsing this forum: No registered users and 14 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to: