Hosokawa's Son, Tadatoshi, was moved to Kumamoto in 1632. Ogasawara Tadazane replaced him and 9 generations of his descendents ruled for the next 230 years. The donjon burned down in a fire in 1837 and was not rebuilt. The castle itself was intentionally burned down and abandoned in 1866 when the Ogasawara fled Kokura during the second Battle of Shochuseito.

The reconstructed castle you see today is borogata style with decorative gables called kara hafu and irimoya hafu, but the original donjon was a very simple sotogata and had no such gables.