AI Ladder, v0.5

Release v0.5:
========

Download: for latest release, please check the last few posts in this thread.
For latest tarball from git, you can download from:
http://github.com/hughperkins/ailadder/archives/master

Dev:
===

Source-code: http://github.com/hughperkins/ailadder/

Staging website: http://manageddreams.com/ailadderstaging/
Reload staging db from git (implies purges all data): http://manageddreams.com/ailadderstaging/reloaddb.cgi
Update staging website from git: http://manageddreams.com/ailadderstaging/updatesite.cgi

Original thread initiator:

Idea: create an AI ladder

The way it could work is
- you have a standard map/mod that will be used for all game.
- you have a machine that runs automatically matches between the latest versions of each AI, maybe three matches between each pair of AIs?
- then, there could be either a grid showing which AI beat which AI
- or, possibly some sort of ladder system, ordering the AIs from 1 through to n.

Excellent idea!!. Also it should host the replays somewhere, and maybe the possibility to connect to live games? xD

would be easier if someone helped hoijui with his headless spring branch.

I can run the actual matches if we get headless spring... and could provide for joining games in progress if I finished my dedicated server clone...

Well, I know just the map for an AI ladder



12x12, wind or solar avaliable, chokes and open area, geo access, no typemaps, largely flat but with kbot only ramps.

I used to do alot of this back when NTAI, KAI, RAI and AAI all worked well.

the general rule should be that AIs can have maphacks but no resource hacks.

This is the current heirachy in BA 1v1ing:

E323AI
KAI
RAI
AAI

doesn't test their water ability though

what about small supreme battlefield v2?

AIs and water dont mix

if they never play in water they'll never learn to swim.

Eventually we could have a couple of different ladders for different game types once more AIs support them. Something along the lines of:

• Land + maphack
• Land + no cheats at all
• Islands
• Water

I agree with making the initial test map a small land map with geos and chokepoints, it lowers the bar to entry while still allowing a variety of strategies.

How about creating a webinterface to the server that allows one to create a maplist through which it iterates, select the ai's, and push "go". And after some playing the server returns statistics + demos of the played games to your mail adress via url or something.

this!

no use in talking about the other stuff really, its all easy peasy comapred to this.. i would say.

Sea & AIs

NTai and OTAI both attempted to play games with ships, hovercraft, and submarines to varying lengths

Website

I would rather have a distinction between AIs of different versions, so an AI could appear multiple times in a league, say ABCAI revision 2 holds spot #2 and revision 4 holds #1 because it works better.

I'd also like any such site to be passive, so it didn't actually run the tests itself but collected and displayed them based on win loss statistics sent in.

University & AF

This kind of statistical tool would be very useful for my final year analysis and presentation depending on what I finally do. If somebody can describe how to build the client end, I may do this all as a proof of concept.

I'll provide code, servers, and magic duct tape if I get a proper headless spring.

How would you detect which AI won the battle?

patch spring.

Couldnt it be figured out by reading infolog.txt?

probably yes, but it'd be unnecessarily complex. it'd take about one extra line in spring.

you mean using the autohost loopback?

nah, just print the surviving/winning teams to the infolog at game over. currently only losers are printed, and they use mod-defined death strings.

Is that not something we can also do in our AIs or in widgets in the meantime? Winning AIs can be inferred sincetheyll be the AIs at the end of the game that did not get lost messages.