For many centuries Norwich has been dominated by its great castle, a symbol of military and political control founded by the Normans between 1066 and 1075 to help keep their newly acquired kingdom in subjection.

The conquered Saxons were forced to raise a mound, some twenty-one metres high and surrounded by a dry ditch, at the end of a prominent ridge of land. A wooden palisade protected the timber buildings on top of the mound, while to the south and east of the mound were yards or baileys that protected by banks and ditches. The castle was built at the King's expense and was held for him by Earl Ralf of East Anglia. In 1075 Ralf, with two other earls, plotted against William I. The King was told of this, and Ralf fled to Brittany, leaving his wife Emma to hold Norwich Castle against the King's army. After three months she surrendered, but in recognition of her bravery was allowed to join her husband.

About 1100, when the mound had settled, masons began to build the stone keep - it took about twenty years. Entry to the keep, which is some twenty-seven metres square by twenty-one metres high, was up a flight of stairs to a vestibule at first-floor level and through the grand entrance into the great hall. This large room, where most of the garrison lived and slept, took up much of the northern half of the keep. Beyond it were a pantry, a small private kitchen and latrines. The garrison's food was cooked in a separate kitchen outside the keep. The southern half of the keep was divided into a number of smaller rooms, including a chapel, the great chamber, with a large fireplace, used by the governor and a private room for the King to use when he visited. Most of the ground floor was used for storage, but at one end under the chapel were dungeons reached only by holes in the first floor. Two sets of spiral stairs led from the ground floor to the first floor, then to the wall gallery and finally to the battlements. The outside walls of the keep, which is one of the largest Norman keeps in this country, were decorated with arcading, a most unusual feature and used perhaps because it was built as a king's palace.