Conflict of interest with Professor's own business entity
You should read your university's conflict of interest policy and outside employment policy.  Follow the policy as long as you work for the university.
We don't know the policies, and cannot give more detailed advice.
If the policy is unclear or does not exist, get university leaders to fix it.
Keep in mind that the majority of startup companies are never profitable.