The old stone structure had proven to be inadequate both for security reasons and lack of space.  The fact that La Crosse was a rowdy place had already been pointed out.  In 1857 a vigilante committee was formed to combat crime and debauchery.  Their first order of business was to burn two brothels.  Community leaders argued that lawful procedures should be followed to rid the city of undesirable elements.  A City Marshal/Constable system was implemented.  The City Police was formed in 1870.

The new jail was built on a block between Vine and State streets on 4th Street.  In 1867 a new courthouse was added to the same property.  Records show the jail was a massive structure constructed from 200 cords of stone.  There is no history of any escapes.