An anime where the main character lives with a bunch of "outcasts" and has to take care of a girl without any social skills
This sounds just like Sakurasou no Pet na Kanojo (The Pet Girl of Sakurasou).

Some points that matches your description:


They all attend Suimei University of the Arts, which is divided into 2 divisions: Arts Division and Regular Division.
They all live in Sakurasou, where they do not fit in any other dorms because they are unique.
The main character, Sorata, had to take care of Shiina as the latter is incapable of doing anything by herself. She is a world renowned painter and is working to be a mangaka.
Nanami later moves to Sakurasou because she couldn't afford her rent. Her dream is to be a seiyuu, but her family opposes her decision and doesn't provide any support, so she had to word part-time for expenses.
There is an avatar called Maid-chan, an A.I developed by the hikikomori Ryuunosuke.


There are of course some things that doesn't match your description, but it might have been a mistake.