WYSIWYG editor not actually able to make use of all its tools
Filtered HTML format restrict some HTML tags, inspect or check source code of your text and see what is new line converted to.

Few guidelines for WYSIWYG editor:


Try Full HTML format 
Check with permission on HTML profiles, on this path: admin/config/content/formats
Check your jQuery version, use jQuery update module
Check is there any JS error on console