Fetching records using some unknown join
I got my answer. Actually I was looking for JOIN SAME TABLE MULTIPLE TIMES which I resolved from here : 


  https://stackoverflow.com/a/12562027/9573341


And for my specific question here is the answer:

SELECT
    ratings.*,
    by_user.id,
    by_user.name,
    by_user.id,
    to_user.name,
FROM
    `rating_table` ratings
LEFT JOIN `users` by_user ON
    ratings.rt_rateBy = by_user.id
LEFT JOIN `users` to_user ON
    ratings.rt_rateTo = to_user.id