Tuning and Making Books CTG

Post Reply
User avatar
eliasgino2007
Co-Admin
Co-Admin
Posts: 1676
Joined: 01 Nov 2007 14:36
Location: Brasil
Contact:

Tuning and Making Books CTG

Post by eliasgino2007 »

Welcome all, 8)

Tuning Books CTG:

By goldminer_999

Here is one way to hand tune the book that I have found very successful although it takes some time and effort. Use the book to play some engine games. Then play back over the games until you reach the point where either the book line ends and there are no more book moves, or the point at which you begin to get negative evaluations. Then set your engine on infinite analysis for a while so it goes quite deep in it's search and by doing this you will find the best next move - then add this move to the book line to extend it. Then next time your engine plays the same line it will make this better stronger move!

To manually edit the book go into Fritz and do File/Open/Openings Book and select the book you want to edit. Then select the Openings Book tab on right hand side of screen. Basically you can either:


  • Add a new move to the book, To do this right click somewhere in that book area (not on a move just in empty space) and tick Allow Move Adding. then when you play back through a game and want to add new line, just make the move on the actual board and then select new main line from the options. This will then have added the move to the book. You can do this for as many moves as you like so you can extend a book line quite significantly.
  • Change the 'weighting' of an existing move making it more/less likely to be chosen. This is shown in the Prob / % column. To change it right click on the actual move itself and do change weight. The value is from -125 (very unlikely to be picked) to +125 (very likely to be picked). You can change these manually to any value. Actually this is what the automatic book learning does based on whether games are won or lost - but this is how you do it manually.
  • Mark moves either red (means they won't be played ever) or green (mean they will be picked, with a probablility given by the % column). To make a move red right click on it and select Don't play in tournament
    To make a move green right click on it and select Main Move. You might want to make a move red if you find that at some point in the book line you had a negative evaluation and therefore you can mark that move red so it won't be played again.
[/color]

There is a lot more to it than this but this should give you enough to start editing your book. I hope this helps you.

Enjoy!!!


By eliasgino2007! :ok

User avatar
eliasgino2007
Co-Admin
Co-Admin
Posts: 1676
Joined: 01 Nov 2007 14:36
Location: Brasil
Contact:

Re: Tuning Books CTG

Post by eliasgino2007 »

Welcome all, 8)

Tuning and Making Books CTG:

By Dagh Nielsen

Let me try to give a brief introduction to book making and tuning, as it applies to the Chessbase CTG books.

There are essentially 4 components in making/tuning a book:

  • Choosing and importing games to the book.
  • Choosing which openings/lines to play by coloring red and green.
  • Expanding the book by manually adding green moves to the lines you have chosen to play (or maybe by "adding priority analysis" or games).
  • Adjusting the weights of moves, often done automaticly through play on the playchess.com server,but can also be done manually.
Any combination of these 4 can be applied by the book-maker to reach a desired result.

The very basic behaviour of any opening book is that it recognizes a position and decides that it will tell which move to play, instead of letting the engine decide. The task of the book-maker is to decide in which positions he wants the book to make that decision, and to make sure that the book makes a good decision.

Very obvious, but there's several ways to go about it, since different parameters in the book determine how it makes those decisions. You would want to play around with these parameters so they match your general approach - what parts of 1-4 above do you use, and where do you put in most of your efforts. Also, what are the playing conditions, etc.

The parameters are:
  • "Tournament book" - I think it is essential to turn this ON, or your color marking will not have any effect as far as I understand.
  • "Variety of play" - Should book only play move with the best stat, or also try others?
  • "Influence of learn value" - This concerns the weights associated to the moves. If you play on server, and a move gives some bad results and thus gets a negative weight, then the book will tend to avoid this move if you put this parameter in the high end.
  • "Learning strength" - How fast do you want the weights to be changed? One bad result or several bad (good) results are needed before the weight of a move changes a lot?
  • "Minimum games" - how many times does a move need to be "played" in your book (based on the imported games) before the book will consider the stats of the moves in order to reach a decision?
And then one of the most important "parameters" in my view: Move coloring. If you make a move green, a higher preference is given to this move. If you color a move red (and at least one other move in the position is green), the book will not make this move.

Before going on to some practical hints and considerations, just one general remark: How would YOU determine the success of your opening book? This can be answered in as many ways as there are book makers, and I think it is sensible to think about it once in a while while you work on your book. Is blitz Elo on playchess server your success criteria (or maybe only slow game Elo?)? Do you find it funny to make weird lines work out OK? Do you want a broad book playing "everything", or do you want a narrow book focusing on a few pet lines?

Fun can be had in many ways, and while I also find it very funny to compete on Elo, it is certainly also funny sometimes to give yourself a few personal challenges, like, "I really want this crazy gambit to work out OK", or, "I want my book to know this opening to depth 30 in all lines!", or whatever. My point is, success (and fun!) is how YOU define it, not ONLY Elo.

OK, some practical hints and considerations:
  • Most people agree that the decision on which games to base your book on is quite important. They should be high quality Smile Once they are in, there's sadly no way getting them out. I think one good approach is using a collection of recent high level games from the playchess server. These games have been played by engines using already very strong books.
  • One can also take some already made (by another person) book, and use this as basis for further tweaking/expansion (for personal use only ). For example, the Rybka book by Jeroen Noomen and the Takker TourbookII are quite strong, but some lines are not really covered by these. Instead, one could use a more broad book like for example the Fritz 9 book as start. Either way, the advantage of this approach is that then one can focus on a few pet lines and improve them, while your book is also covered reasonably well in lines you do not care to work further on. But in the end, I think most people will want to make their own book from scratch Smile There is also a chance that this will give higher diversity on the playchess server.
  • By choosing a good base of games, you are already on your way to a fine book. You can then let it play a lot of server games in order to tune the weights, and you will have a fine book in the end.
    HOWEVER! You will only get so far doing this. To further improve your book (and make it more personal!), you need to get some dirt under your nails Smile This means analysing played games, or variations you want your engine to play, and then expand the book in these lines by adding green moves.
    And maybe choosing which variations/moves NOT to play by marking these moves red. Improving your book in this way is an endless task, but also where all the fun lies IMHO Smile You can ALWAYS further improve your book by doing some work in your personal analysis laboratory.
  • In Fritz 9, you can choose some keyboard shortcuts for coloring moves under "tools - customize".
    This can save you a lot of time and frustration.
  • Parameters - There are as many preferred ways to combine these as there are bookmakers. I suggest playing around with them so they fit your CURRENT task. To make an analogy, Magnus Carlsen and his trainer for some time defined success as how much Magnus learned, and not the score on the tournament table. Likewise, for some time, you can "experiment" with new lines and choose loose parameters, and maybe later, when you have drawn some conclusions from the games and added some analysed moves and you are satisfied with the result, you can go back to some "bests of the bestests setting".
  • Go and kibbitz some games in the engine room on the playchess server. They will get added automaticly to one of your databases. You can then either import these into your book, or just use them as inspiration for further manual research. Some people on the server are paranoid about kibbitzers following them and thus learning all their secrets Smile Well, I really have no opinion on this, and I understand the pros and cons. I don't know if it would be a good idea if they made a "no kibbitzers" playing mode.
  • Maybe get some good friends on the server and exchange games with them. Not all people are too paranoid, or maybe you just want to conspire with others and help justify the paranoia.
At any rate, have fun book-cooking and competing! And in a few years time when you have grown exhausted from this, maybe we can meet in normal playing room and have a good old-fashioned game of human blitz Very Happy. [/color]

Enjoy!!!


By eliasgino2007! :ok

User avatar
blackmagic
Advanced Member
Advanced Member
Posts: 51
Joined: 28 Sep 2009 16:54

Re: Tuning and Making Books CTG

Post by blackmagic »

[Event "Blitz 35m"]
[Site "?"]
[Date "2010.06.25"]
[Round "?"]
[White "RobboLito 0.085g3 x64"] with zeeman 3.4 final (single core)
[Black "Deep Rybka 4"] with Rybka 4 opening book (quad)
[Result "1/2-1/2"]
[ECO "B90"]
[Annotator "bugs"]
[PlyCount "123"]
[TimeControl "2100"]

{810MB, ZEEMAN 3.4 final.ctg} 1. e4 {B 0} c5 {2} 2. Nf3 {B 0} d6 {1} 3. d4 {B 0
} cxd4 {11} 4. Nxd4 {B 0} Nf6 {12} 5. Nc3 {B 0} a6 {10} 6. Be3 {B 0} Ng4 {14}
7. Bg5 {B 0} h6 {10} 8. Bh4 {B 0} g5 {11} 9. Bg3 {B 0} Bg7 {10} 10. h3 {B 0}
Ne5 {9} 11. f3 {B 0} Nbc6 {27} 12. Bf2 {B 0} Ng6 {11} 13. Qd2 {B 0} Nxd4 {14}
14. Bxd4 {B 0} Bxd4 {11} 15. Qxd4 {B 0} Be6 {6} 16. Bc4 {B 0} Bxc4 {18} 17.
Qxc4 {B 0} Rc8 {65} 18. Qd4 {B 0} Qc7 {13} 19. O-O-O {B 0} Qc5 {21} 20. Qd2 {
B 0} Qb4 {0} 21. Kb1 {0.08/19 40} Ne5 {59} 22. a3 {0.15/23 145} Qa5 {0} 23. Qd4
{0.16/22 184} Qc5 {0} 24. h4 {0.18/19 0} Qxd4 {36 (f6)} 25. Rxd4 {0.16/17 0} f6
{13} 26. a4 {0.09/21 42} Nc6 {10} 27. Rd2 {0.07/21 0} Kf7 {80} 28. b3 {0.24/21
4} Ne5 {0} 29. Nd5 {0.17/20 63} h5 {46} 30. Rd4 {0.15/21 42} Rc5 {0} 31. Kb2 {
0.15/20 37} Ng6 {13} 32. hxg5 {0.14/20 36} fxg5 {4} 33. Rdd1 {0.12/20 71} h4 {6
} 34. c4 {0.12/19 0} Rcc8 {0} 35. Ne3 {0.09/19 34} Ne5 {76 (Nf4)} 36. Rh3 {0.
00/18 41} Ke6 {0} 37. Rd2 {0.00/19 33} Rh7 {17 (g4)} 38. Nf5 {0.00/19 48} Kd7 {
42 (Rhh8)} 39. Nd4 {0.00/21 29} Rhh8 {65} 40. Nc2 {0.00/23 39} e6 {0} 41. Rh1 {
-0.18/20 78} Ke7 {96} 42. Rhd1 {-0.22/21 16} Rcd8 {51 (h3)} 43. Ne1 {-0.15/20
32} h3 {79 (Nf7)} 44. gxh3 {-0.27/20 47} Rxh3 {6} 45. c5 {-0.31/22 46} Nf7 {20}
46. Rc2 {-0.38/21 47} dxc5 {20} 47. Rxd8 {-0.40/23 0} Kxd8 {3} 48. Rxc5 {-0.40/
22 0} Kd7 {120} 49. Rc2 {-0.41/24 9} Ne5 {0} 50. Rg2 {-0.39/22 12} Nxf3 {34}
51. Nxf3 {-0.39/26 0} Rxf3 {5} 52. Rxg5 {-0.39/26 0} Rf4 {37} 53. Rg7+ {-0.38/
27 21} Kc6 {16} 54. Kc3 {-0.38/26 0} Rxe4 {6} 55. a5 {-0.38/25 0} Re5 {45 (Re1)
} 56. b4 {-0.38/25 7} Rd5 {0} 57. Re7 {-0.37/26 21} Rd6 {23} 58. Kc4 {-0.35/28
0} b6 {26} 59. axb6 {-0.35/29 0} Kxb6 {3} 60. Rh7 {-0.35/28 0} Rc6+ {101} 61.
Kb3 {-0.34/33 0} Rc1 {7} (61... a5 {0} 62. Rh5 {-0.05/29 18} axb4 {38} 63. Kxb4
{-0.05/34 0} Kc7 {0} 64. Rc5 {-0.05/32 7} Kd6 {0} 65. Rxc6+ {-0.05/35 8} Kxc6 {
16} 66. Kc4 {-0.05/47 0} Kd6 {45 (e5)} 67. Kd4 {-0.05/53 11} e5+ {24} 68. Kc4 {
B 0} Ke7 {56} 69. Kd5 {-0.05/52 19} Kf6 {46} 70. Ke4 {-0.05/55 0} Ke6 {23} 71.
Kf3 {B 0} Kf5 {14} 72. Ke3 {-0.05/54 14} e4 {33 (Kg5)} 73. Kd2 {B 0} Kf4 {18}
74. Ke2 {B 0} e3 {16} 75. Ke1 {B 0} Kf3 {12} 76. Kf1 {B 0} e2+ {40} 77. Ke1 {
B 0} Ke3 {25}) 62. Rh6 {-0.34/32 0} 1/2-1/2

this became stalemate for white...

could anyone tuned this moves to defeat black?

User avatar
blackmagic
Advanced Member
Advanced Member
Posts: 51
Joined: 28 Sep 2009 16:54

Re: Tuning and Making Books CTG

Post by blackmagic »

which engine is best for analysis

User avatar
Waldemar
Co-Admin
Co-Admin
Posts: 2482
Joined: 24 Jan 2008 23:50
Location: Brazil
Contact:

Re: Tuning and Making Books CTG

Post by Waldemar »

The one that gives depth=20 or more very fast if you dont have time enough to wait for rybka analysis in depth=20 cuz will take longer hehehe Try latest IvanHoe.
4ut0 ch355 m3mb3r WALDEMAR...g00d g4m3 f0r 4ll...y4h000000! :ok

User avatar
blackmagic
Advanced Member
Advanced Member
Posts: 51
Joined: 28 Sep 2009 16:54

Re: Tuning and Making Books CTG

Post by blackmagic »

XsupremeX wrote:The one that gives depth=20 or more very fast if you dont have time enough to wait for rybka analysis in depth=20 cuz will take longer hehehe Try latest IvanHoe.
:D :D :D :D THANKS

unemployed
Advanced Member
Advanced Member
Posts: 119
Joined: 13 Feb 2010 15:22
Location: Mother Earth

Re: Tuning and Making Books CTG

Post by unemployed »

I may be wrong but none of members has sufficient knowledge about tuning ctg books .
There are certain suggestions.
1 Never be afraid of size of ctg book even if size is 5 gb as we will be blocking most of losing lines by marking them red and it means this book will be far superior than 10 mb book in speed and performance.
2 In chess base (pls do some goggling to find some winning lines and some loosing lines and how to mark them red and green )
3 make books up to 60 moves as size is unimportant.
4 there is auto feature in chessbase (fritz)to auto tune your book to the best of its performance which i would like members to state.
What we think or what we know or what we believe is, in the end, of little consequence. The only consequence is what we do."

John Ruskin

User avatar
eliasgino2007
Co-Admin
Co-Admin
Posts: 1676
Joined: 01 Nov 2007 14:36
Location: Brasil
Contact:

Re: Tuning and Making Books CTG

Post by eliasgino2007 »

Welcome all, 8)

Making Books CTG:

By: CS29797

Back up your database & work on a copy for the following reasons:
If anything goes wrong & you need to start over
You will lose a lot of games during the process.
1- Decide what kind of book you need to make a sharp opening book or a general use book.
Select games played a sharp opening for a sharp opening book.
Advantage: strong as white
Disadvantage: weak as black
Select higher rated games for general use book.
Advantage good for everything including play chess server
Disadvantage: may include some bad line that needs manual tuning.
I usually make a general use book which is good for almost everything including play chess server.
2- Open your cb program double clicks the database you want to use & select filter games.
For sharp opening you need to select games by ECO
For general:
Computer games select games 2600 & up both sides
Human games 2400 & up both sides.
The best way to do so is:

Image

Image

That will select all unwanted games.
Click edit, select all, delete
Go to the main window & click tools, database, remove deleted games
Close clip board after done.

3- Double click your database again & click ECO that will sort your database in ECO order, click tools, fix sort

Image

4- Go back to the main window click tools, database, kill doubles

Image

5- From the main window click tool, database, remove deleted games.

6- Click file, new, database, browse & select your book folder change the extension on the 2nd line to CTG, name the book on the 1st line click open.

Image

7- Drag & drop your database into the book that you just made in step 6 follow instruction:

Image

8- Double click your book right click your moves 1 by 1 select main move to make the move green & select don’t play in tournament to make it red.
9- All done


Enjoy!!!


By eliasgino2007! :ok

User avatar
eddy158k
New Member
New Member
Posts: 3
Joined: 24 Jul 2011 20:18

CTG Openning Book making tutorial with graphics

Post by eddy158k »

One can find a useful CTG opening book making tutorial with graphics on this link:

http://downloadingtime.blogspot.com/201 ... afics.html

Post Reply