So your n media servers are running separately each on it’s own server, and the signaling server is running on separate server and then there is another broker server or you call the signaling server the broker server?
When you say broker server knows the state of mediaservers in it’s holding? What do you mean by hloding? Aren’t the media server running separately on their own machines? And when you say it knows the state, do you mean that the broker server can access the workers, transports etc of other media servers or you mean that this server knows to which media server to communicate and then it communicates to that media server and ask to perform some action, get response and send it back to the user?