Olsen was traded to the Rams before the 1971 season for a No. 1 draft choice and additional financial compensation.
In 1973 and 1974 Olsen was moved to defensive end where he backed up Fred Dryer and Jack Youngblood.