The however patchy recorded history of the Padula castle dates back to the Angevin period, but the site was probably fortified already in  Norman times, being, as it is, in a strategically important and geographically dominant position overlooking the Vallo di Diano (Diano Valley).Starting from the XIII - XIV cent. the castle was part of the defensive network of battlements of the Angevin Kings of Naples against the Sicilians led by the  Kings of Aragon.Later, it was a stronghold in the internal wars between  pretendants from the different branches of the Angevin family to the throne of Naples.

A source of  1383 ,  describes al the preparation of the siege of the Padula Castle, made at the behest of Charles III of Durazzo after his prevailing upon Louis I of Anjou. The King requests Henry Sanseverino, whose ancestors founded the Charterhouse, to move against the Padula castle “viriliter intendantur”, and to  put it under siege.

The strong army relied on the leadership and  expertise of the  famous english condottiere(commander of mercenary troops) John Hackwood later to be known as Giovanni Acuto, the italianized version of his name.The outcome of the siege is not recorded, maybe Padula was able to withstand the onslaught of such a powerful army.A detailed description of the castle in contained in a source of  1630, the owners being at the time the De Ponte, before the passing into thedomains of the Charterhouse.The report praises the advantageous position of the castle, its strong walls, iron gate  and ample ditches insuring against any surprise attack. The castle housed the local prison "divided into the section for criminal and the one for civil offenders. Ample storerooms ensured abudant provisions in case of siege. Further the rooms for the womenfolk, the servants and the men. The castle could provide shelter for up to 3 families".

However, because of the place being exposed to cold winds, it served as residence only in summertime, the feudal lords moving during the winter in their palace in the valley close to the Charterhouse.

The decadence of the castle continued during the following years, and the Charterhouse could not effect any improvement. In 1857 a strong earthquake destroyed most of the remaining buildings. Today only a ruined tower and rests of walls bear witness of the once strong fortification.