View of users flagged by a user, users flagging a user, and nodes from users flagged by a user
Better late than never, To get your followers of fans you can:


create a view of type users.
create a relationship Flags: User's flaggings.
now this is were most people go wrong you should remove "Include only users who have flagged content."
chose your flag.
Add Contextual filter "Flags: Content ID".
make sure to use the relationship.
WHEN THE FILTER VALUE IS NOT AVAILABLE provide default value of "user Id from logged in user".