The opponents of the football game are Brown and The Board of Education. Brown v. Board of Education in 1954 was a landmark United States Supreme Court case in which the Court declared state laws establishing separate public schools for black and white students to be unconstitutional.
Brian's quote towards the college girls - "I get older; they stay the same age", - is directly borrowed from Wooderson's words in Dazed and Confused (1993).