What methods are used for calculating maximum takeoff windspeed of a helicopter?
The simple (and probably unsatisfying) answer would be:
The maximum headwind into which a helicopter can land will be somewhat less than it’s listed maximum operating speed.
Flying at Vmo into a headwind of equal speed should lead to a stationary velocity relative to the ground. In theory, the aircraft could gently lower itself all the way the ground like this (although, I certainly wouldn’t try it). The problem is, most helicopters will be in a very pitch-forward attitude at this point and the skids or landing gear may not be in the proper orientation to safely put the aircraft on the ground. This will vary from model to model and would need to be tested on a case-by-case basis.
It should be noted that landing and shutting the engine down are 2 separate problems. Many helis have a maximum wind speed for startup/shutdown, like this BK117 which has a listed limit of 50 knots in its POH.