"Shogi" (将棋) is a two-player strategy board game similar to chess and is popular in Japan. Computer programs have become very strong as in the chess world, and some software installed on a commonplace PC can beat professional human players. I publish my study of ELO rating of free (open source) shogi engines on this site. The engines shown in the table are available from the links for free. I wrote a short instruction to set up shogi programs on the blog page (updated May 11, 2018). Installation instruction of YaneuraOu with a third-party evaluation file is explained here. (Updated May 2019) After some period of suspension, I resumed to add new data again.
Testing conditions
Time control: 5 seconds for each ply on Intel Core i7-6700 using four threads. We use YaneuraOu as a benchmark to determine equivalent time control for other CPUs. For GPU programs, 10 seconds on NVidia GTX-1050Ti and 3 seconds for GTX-2080. We use PassMark as a GPU benchmark.
Interface programs: ShogiGUI or Shogidokoro
Ponder: off, Hash: 1GB, Initial Book: off
Resign value: 3000 (30 centipawns) if both engines support it.
Draw: 3-fold repetition or 256 plies
Plug-in modules: Some software requires third-party components such as evaluation files, initial book, or sometimes engine itself! We use / (slash) to express the combination which we use. Plug-in modules in the list are (engine)YO: YaneuraOu, SM: Silent Majority (evaluation file) U: Ukamuse, A26: Apery wcsc26, At Apery_twig, Y: Yaneuraou(=Ukamuse), (initial book) M: Mafu book.
To compare with human players, a rough estimate is
beginner ~ R700 ~ normal amateur (kyu)~ R1500 ~ strong amateur (dan) ~ R2000 ~ top amateur ~ R2600~ professional~ R3200~ nonhuman
See also the comparison with the 81 dojo rating.
Estimated ELO rating Set Apery_twig=3250