McFadden was born in London, Kentucky, in 1932, where he attended both graded and high school. McFadden joined the Kentucky National Guard"s 149th Infantry in 1948. After high school, he married his high school sweetheart, Peggy. McFadden served in both the Korean and Vietnam wars. During his twenty-nine years in the military, he attended numerous schools. He holds a degree in accounting.