Al Hillman was a member of the F&M football, wrestling and lacrosse teams from 1956-1960. Hillman played guard and tackle and was a starter on three winning F&M football teams from 1957-1959, and was named co-captain as a senior. He was named to the ECAC All-East Small College team and earned Honorable Mention Little All-American honors. Hillman was named to the weekly Eastern Collegiate Athletic Conference All-East first team three times and honorable mention four other times, and was named to the All-Pennsylvania second team that year.
He was also named to the Little All-American team in 1958. As a member of the wrestling team, Hillman placed second in the EIWA freshman wrestling tournament at 191 pounds and heavyweight throughout his career. Hillman was also a four-year lacrosse letterwinner and was named co-captain of the first varsity lacrosse team in 1959. He helped the Diplomats defeat the Bainbridge Naval Prep School for the first-ever varsity win as a senior.