How to test the quality of an opening book? Over the years I manually maintained an opening repertoire in a PGN file (with several "games" per ECO index on average), and now realized I can generate different opening "books" from it - for SCID, CA, or Fritz-based products. The repertoire had been created somewhat ad hoc - based on my games, books I read, engine analysis, database searches, etc. Now - what is the best way to automatically "test" that my book:


does not miss any very popular responses for one side?
does not  contain any blunders for the other side?


Or is this type of computer checking best done on a pgn file in the first place?

Thank you
EDIT: Answer to Revised Question Below

Based on the way you described it, it makes sense to simply open up the PGN along with any engine and go through it line by line. I do not believe there's an automated way to iterate through all the moves and ensure their individual accuracy.



I'm curious as to how you generated your book to begin with - did you do it with engine-assisted analysis? If so, that will affect the accuracy of your repertoire from its inception.

What I would do in your situation is manually compare the PGN file to moves that are popularly played. Useful resources are Shredder's free opening database as well as 365 chess opening explorer. Both are intuitively organized so that the most popular response is readily available.

Depending on the depth of your preparation, blunders can be present or not at all. I would double check this with an engine, such as the free Houdini 1.5 just to be sure.

As an aside, it might be a good idea to organize your opening database into separate PGN files dependent on ECO code. This makes it easier to navigate when you want to search through particular openings.

I hope this helps! If you have any follow-ups, feel free to reach out.