A hard-hitting right-handed outfielder, he played on the 1974 Meramec Community College team that won the JUCO World Series in Colorado. He was named to the All-Tournament and All-Regional teams that year. Barylski played for Meramec from 1972 to 1974. He then became an outfielder for the University of South Alabama in Mobile. The head coach of the Alabama team was former St. Louis Cardinals manager Eddie Stanky. In 1976, Barylski ranked sixth in the nation in total home runs. That same year, he was named to the All-Regional team.

From 1972-77, he was an outfielder in the St. Louis County League for Maplewood, Giesler-Jorgen, and the Economy Collegians. Barylski played for Rosary High School in the late 1960s and early 1970s. From 1995-2010, he was the manager of the St. Peters American Legion baseball team.