The town grew at a crossing of the Bóbr under the Piast dukes of Silesia, and its fortunes followed cloth: fairs, weavers, dyers and the border trade with Bohemia. Under Prussian rule after 1742 the linen boom reshaped the town with workshops and merchants' villas.
The 20th century brought industry, war and change of hands; the textile era faded, but the street grid, the market square and the weavers' houses stayed. Today Kamienna Góra is the home base of the 100 Castles quest, with more castles per hour of driving than almost anywhere in Poland.