Register as a listener to access course materials with no intent to attend lectures
First, the usual term in the US is not "listener" but "auditor"; you are said to be "auditing" the course.

People generally don't care too much what you do or don't do when you register as an auditor, so most likely this would be fine.  But I think that, as a matter of courtesy, whenever you are considering signing up to audit a course, it is good to contact the instructor, let them know what level of involvement you have in mind, and check that this is okay with them.  In some cases there may be certain things that they ask you to do or not do.

In this case, when you ask, the instructor might just offer to share the course materials with you directly, without you having to sign up to audit the class at all.