Johnson grew up in Washington, D.C. His father worked for the Bureau of Prisons and was the director of classifications and paroles. Up to that time, he was the highest ranking African-American in the bureau.