Rainbow Manor was built in 1882 by Drury P. Oglesby. The Oglesbys' daughters and two of their great-granddaughters were married in this home. Seven grandchildren were also born here.

In 1920, the porch overhang was raised to the roof level, columns added, and the parlor and central hall were combined into a large living room.