Do I need an egress window in a basement room not used as a bedroom?
As long as one of the &quot;viable exits&quot; meets the standards for an emergency escape and rescue opening, then you should be all set.

International Residential Code 2012
Chapter 3 - Building Planning
Section R310 - Emergency Escape and Rescue Openings
R310.1 Emergency escape and rescue required.
Basements, habitable attics and every sleeping room shall have at least one operable emergency escape and rescue opening. Where basements contain one or more sleeping rooms, emergency egress and rescue openings shall be required in each sleeping room. Where emergency escape and rescue openings are provided they shall have a sill height of not more than 44 inches (1118 mm) measured from the finished floor to the bottom of the clear opening. Where a door opening having a threshold below the adjacent ground elevation serves as an emergency escape and rescue opening and is provided with a bulkhead enclosure, the bulkhead enclosure shall comply with Section R310.3. The net clear opening dimensions required by this section shall be obtained by the normal operation of the emergency escape and rescue opening from the inside. Emergency escape and rescue openings with a finished sill height below the adjacent ground elevation shall be provided with a window well in accordance with Section R310.2. Emergency escape and rescue openings shall open directly into a public way, or to a yard or court that opens to a public way.
R310.1.1 Minimum opening area.
All emergency escape and rescue openings shall have a minimum net clear opening of 5.7 square feet (0.530 m2).
R310.1.2 Minimum opening height.
The minimum net clear opening height shall be 24 inches (610 mm).
R310.1.3 Minimum opening width.
The minimum net clear opening width shall be 20 inches (508 mm).
R310.1.4 Operational constraints.
Emergency escape and rescue openings shall be operational from the inside of the room without the use of keys, tools or special knowledge.