Change style for the reply link in comment.tpl.php
Just use the following code:

&lt;?php print url($content['links']['comment']['#links']['comment-reply']['href']); ?&gt;


If you pass node/1 to url(), it will  return /?q=node/1 when clean URLs are not enabled, and /node/1 when clean URL are enabled.