He was baptized into the Church of England by the grandfather of Enoch Powell, a politician who much later significantly influenced his life. His father, a captain in the army, was killed at Tobruk.
Budgen was educated at St Edward's School, Oxford, where he gained a reputation as a talented but difficult child, always ready to argue niceties with authority.
He read Law and Corpus Christi Cambridge