How do I professionally communicate to a colleague that I am not interested in helping with his project anymore?
Your project is nice, but I now decided for myself that I can't invest more time in it. I'm too busy with other projects which have priority for my current research interests (so, talking to my advisor won't fix the issue). 


And just repeat that same basic point when he tries to argue/discuss with you.