One of the books that Bender throws into a fire is written in alien text. The title of that book reads "Backwards Time Travel Made Easy."
The plot for this story is based on a 1950 short story by Poul Anderson, "Flight to Forever," where time travelers can only move forward, unable to find a time where movement backwards is possible. They eventually witness the rebirth of the universe and Earth before returning to what is their own time.
Before Prof. Farnsworth shoots Hitler, the dictator says in German: "Betrachten Sie meinen Schnurrbart!" In English this means: "Look at my moustache!"
The episode won an Emmy Award for Outstanding Animated Program.
The song playing during the montage is based on "In the Year 2525," recorded by Zager and Evans in 1969. The version in this episode more closely resembles the theme song from the short-lived science fiction action show 'Cleopatra 2525.'