1. An information handling system comprising: a network infrastructure, the network infrastructure comprising a plurality of network switches in communication with a network controller; a first network server; a network orchestrator running on the first network server and generating network infrastructure requirements, the network infrastructure requirements including at least details of networking needs of a plurality of virtual machines; a second network server different from the first network server; and a connection manager running on the second network server, the connection manager configured to: receive, through an orchestration plug-in, the network infrastructure requirements from the network orchestrator; normalize, by the orchestration plug-in, the network infrastructure requirements from one or more proprietary formats supported by a vendor of the network orchestrator to a normalized format; build a connection matrix based on the normalized network infrastructure requirements, the connection matrix determining end-point connectivity in the network infrastructure, wherein the connection matrix includes information about protocols present in the network infrastructure; translate, by an infrastructure plug-in, the normalized network infrastructure requirements to instructions suited to the network controller based on a type of the network controller to implement the connection matrix in the network infrastructure; and transmit, through the infrastructure plug-in, the instructions to the network controller to implement the connection matrix in the network infrastructure.