Christmas Lights on Vinyl fences
Zipties (aka cable ties). Be sure to use ones that are UV-resistant. 



Cost pennies each, strong enough for the application you're talking about, non-damaging and non-permanent, and easy to remove when done.