Counting in binary nybbles
MATL, 6 bytes
0:10YB

Try it at MATL Online
Explanation
0:10    % Create the array [0...10]
YB      % Convert this array to a binary string where each number is 
        % placed on a new row
        % Implicitly display the result