How can I assign one contact to one of the team workers?
ACL or Access Controls should be able to do that. 
https://docs.civicrm.org/user/en/latest/initial-set-up/permissions-and-access-control/

BUT... I've never worked with Joomla so can't offer any further advice