SQL Server Linked Server - Timeout Error
It could be a firewall issue.
You have to be able to connect to Server B from Server A. You said that you can connect to Server B from your desktop, but this only proves there is no problem between your desktop and Server B.
For a fair test, you have to log in to Server A and attempt to log in to Server B from Server A.