Your Country Needs You!

This forum is for general discussions and questions, including Collectors Corner and anything to do with Computer chess.

Moderators: Harvey Williamson, Steve B, Watchman

Forum rules
This textbox is used to restore diagrams posted with the fen tag before the upgrade.
Post Reply
User avatar
spacious_mind
Senior Member
Posts: 4000
Joined: Wed Aug 01, 2007 10:20 pm
Location: Alabama
Contact:

Post by spacious_mind »

Chessmaster Ireland wrote:Nick

Here are the results of Komodo 9 running on a Android Hudl2
Intel Atom Quad-Core 1.83GHz with 2GB RAM

GAME 1. White = 2904. Black = 2672. Average = 2788
GAME 2. White = 3112. Black = 2688. Average = 2900
GAME 3. White = 3081. Black = 2759. Average = 2920
GAME 4. White = 2563. Black = 2945. Average = 2754
GAME 5. White = 2847. Black = 3090. Average = 2968

ELO AVERAGE = 2866

Regards
Bryan
Thank you. Game 1 and 4 seem to be below expectations for it otherwise it would be close to being right at the top. Can you email the game moves please and I will paste them into my list. Would be nice to see where it missed.

regards
Nick
Nick
User avatar
Bryan Whitby
Senior Member
Posts: 1001
Joined: Wed Feb 18, 2009 9:57 pm
Location: England

Post by Bryan Whitby »

Nick
I have just emailed you Komodo 9 test moves
Bryan
User avatar
spacious_mind
Senior Member
Posts: 4000
Joined: Wed Aug 01, 2007 10:20 pm
Location: Alabama
Contact:

Post by spacious_mind »

Chessmaster Ireland wrote:Nick
I have just emailed you Komodo 9 test moves
Bryan
Hi Bryan,

Thanks I will take a look. I am curious about where it lost points as it should be ranking right at the top.

Best regards
Nick
User avatar
spacious_mind
Senior Member
Posts: 4000
Joined: Wed Aug 01, 2007 10:20 pm
Location: Alabama
Contact:

Post by spacious_mind »

Hi Bryan,

I took a closer look at Test Games 1 & 4 and compared to Stockfish 6:

Test Game 1 - Komodo 9 - Stockfish 6 Comparison

Image

I highlighted some surprising weaker moves in yellow. 11. Nxc8 is interesting to me. From the top programs only Stockfish and Komodo play it. I know it's not the right move though because at deeper depth you will probably see it kicked out again.


Test Game 4 - Komodo 9 - Stockfish 6 Comparison

Image

Same with these highlighted yellow moves. With deeper search they will probably be kicked out again.

Just out of interest, plugged in Stockfish 6 score for Test Game 1 and 4 into Komodo 9 to see what it's rating would have been if Komodo 9 would have scored the same as Stockfish in these two test games:

Image

Well with a better game 1 and 4 it would have slotted into 3rd place. It looks like Game 2 is also below expectations. In game 5 it scored very well.

It would be interesting to see these two programs play each other without opening book to see who would come out on top. My early suspicion would be Stockfish 6.

After seeing the moves that were played, I am at least relieved that the evaluations don't seem to be wrong.

Best regards
Nick
User avatar
Bryan Whitby
Senior Member
Posts: 1001
Joined: Wed Feb 18, 2009 9:57 pm
Location: England

Post by Bryan Whitby »

Hi Nick

Thanks for the very interesting reply.

I will have a play around with Komodo's settings a little to see if I can make it a any stronger for the two games that you have highlighted. If I succeeded then I will retest the others also.

Regards
Bryan
User avatar
Bryan Whitby
Senior Member
Posts: 1001
Joined: Wed Feb 18, 2009 9:57 pm
Location: England

Post by Bryan Whitby »

Hi Nick

I have had a play around with Komodo settings and can get it's white score up to 3062 from 2563 in Game 4 but it's blacks score then goes down from 2945 to 2856. I have tried various settings but can't seem to get white and blacks scores to both go up on the same settings.

Maybe you should just use Komodo's default setting score of 2563 & 2945.

Regards
Bryan
User avatar
spacious_mind
Senior Member
Posts: 4000
Joined: Wed Aug 01, 2007 10:20 pm
Location: Alabama
Contact:

Post by spacious_mind »

Chessmaster Ireland wrote:Hi Nick

I have had a play around with Komodo settings and can get it's white score up to 3062 from 2563 in Game 4 but it's blacks score then goes down from 2945 to 2856. I have tried various settings but can't seem to get white and blacks scores to both go up on the same settings.

Maybe you should just use Komodo's default setting score of 2563 & 2945.

Regards
Bryan
Hi Bryan,

You could if you wanted to, play the 5 tests with your custom setting and see what the end result is compared to the standard setting. Might be interesting to see how configurable Komodo 9 is. I have already included your standard setting results into the rating list. I have just not done an updated post. Waiting to add a few more tests before I post it.

ps I just received Quad Core Gavon 3 which should be comparable to your unit. I might try and do Stockfish 6 with it to see how it scores.

Best regards
Nick
User avatar
Bryan Whitby
Senior Member
Posts: 1001
Joined: Wed Feb 18, 2009 9:57 pm
Location: England

Post by Bryan Whitby »

Hi Nick

Unfortunately, I can't seem to set Komodo on the settings I previously had that increased it's white score but decreased it's black's and visa versa. There are so many permutations that I have given up trying to find it so we are stuck with Komodo's default Hudl2 settings.

However, I have just emailed you the ChessGenius v4.0.0 results running on my Apple iPad 3 which resulted in the following scores.

Game 1: 2920 - 2512 = 2716
Game 2: 2578 - 2522 = 2550
Game 3: 2788 - 2473 = 2631
Game 4: 2005 - 2042 = 2024
Game 5: 2460 - 2427 = 2444

ELO = 2473

I am now starting to test ChessTiger iPad 3

Regards
Bryan
User avatar
spacious_mind
Senior Member
Posts: 4000
Joined: Wed Aug 01, 2007 10:20 pm
Location: Alabama
Contact:

Post by spacious_mind »

Here is the updated list of all the programs tested so far. We now have gone past the 2nd century with a total 2013 programs tested so far.

Some new additions are:
Revelation Rebell 5.0 scored 2256 ELO (Amazing score)
Revelation MM IV scored 2164 ELO
Systema Gemini Plus scored 1642 ELO
Gavon 3 Stockfish 6.0 scored 3069 ELO (Leader)

The following were tested by Bryan B:

Android 1.83 GHz Komodo 9 scored 2858 ELO
IPAD 3 1 GHz Chess Genius - Richard Lang scored 2413 ELO
IPAD 3 1 GHZ Chess Pro - Christophe Theron scored 2514 ELO

Below is the latest complete rating list.

COMPLETE RATING LIST


Image
Image

Best Regards
Nick
User avatar
Bryan Whitby
Senior Member
Posts: 1001
Joined: Wed Feb 18, 2009 9:57 pm
Location: England

Post by Bryan Whitby »

Shredder jumps into the lead in the iPad league with a very respectable average score of 2789 and place 16 overall.
User avatar
Bryan Whitby
Senior Member
Posts: 1001
Joined: Wed Feb 18, 2009 9:57 pm
Location: England

Post by Bryan Whitby »

HIARCS iPad 3 scores a great 2915 ELO
User avatar
spacious_mind
Senior Member
Posts: 4000
Joined: Wed Aug 01, 2007 10:20 pm
Location: Alabama
Contact:

Post by spacious_mind »

Chessmaster Ireland wrote:HIARCS iPad 3 scores a great 2915 ELO
Hi Bryan

That is impressive. Are you interested in testing in the forthcoming tournament as well?

Best regards
Nick
User avatar
Bryan Whitby
Senior Member
Posts: 1001
Joined: Wed Feb 18, 2009 9:57 pm
Location: England

Post by Bryan Whitby »

Well after three test games, Droidfish running the new Stockfish 7 on my Android 5.1 tablet has a combined rating of a massive 3293!!

Hopefully will complete last two games by tomorrow night.

Bryan
User avatar
Bryan Whitby
Senior Member
Posts: 1001
Joined: Wed Feb 18, 2009 9:57 pm
Location: England

Post by Bryan Whitby »

Slight drop in the last two games but Stockfish 7 finishes with an impressive combined rating of 3202
User avatar
spacious_mind
Senior Member
Posts: 4000
Joined: Wed Aug 01, 2007 10:20 pm
Location: Alabama
Contact:

Post by spacious_mind »

Chessmaster Ireland wrote:Slight drop in the last two games but Stockfish 7 finishes with an impressive combined rating of 3202
Now that is impressive! What are the specs for your tablet?

Best regards
Nick
Post Reply