Despite the family's financial difficulties, Miller was an active and athletic youth. He delivered bread before school to help the family and became a football star at Abraham Lincoln high school. However, he was an indifferent student, more interested in athletics than academics.