Some photos will help a lot.
The visual beauty , if it exists of
course will disappear, also when heating the inside the walls will be heated also.
If you insulate the inside, bearing in mind space saving, the wall will not absorb any heat.
Here is a discussion about basements
From
Insulation inside or outside
"Closed-cell spray foam is the best way to insulate
concrete basement walls.
This is because it can achieve a higher R-value, along with excellent moisture resistance, with less thickness required.
It can fill in all the gaps and spaces thoroughly, giving you the best protection against moisture and air infiltration."