Updated Windows Release Build File
This will severely impact performance on Windows.  MSVC often chooses not to inline functions marked as "inline", leading to much higher function call overhead, particularly for low-level Eigen functions - hence the need for Eigen to explicitly use `__forceinline` on MSVC.

It would be preferable to find other methods for reducing the zip size. Hi Everyone, thank you, we are working on a better solution and targeting to fix this by the next RC. The file size for simple_console_for_windows.zip reaching 4GB seems odd as the same for the nightly run is 1.95 GB, If changing input to the MSVC compiler is affecting the file size, we may consider adding some flags which guide the compiler to control the file size without affecting the performance.

I came across one argument to bazel build: --define=no_tensorflow_py_deps=true which helped to reduce the size in the past. https://github.com/tensorflow/tensorflow/pull/22483/commits/2a01b6ad169dc433d002bb61a3a7581cb0662556

It would be helpful to get your opinions as well on if there were any other compiler flags or arguments that were used to resolve such issues or what other techniques were used.

There could be two possible solutions:
1. Change the zipper.exe (https://github.com/bazelbuild/bazel/blob/master/third_party/ijar/zip.cc) which bazel is automatically picking (external\bazel_tools\tools\zip\zipper\zipper.exe) to some other zip tool which can handle above 4GB.

2. Remove files that are not necessary for Windows and are input to simple_console_for_windows.zip (https://github.com/tensorflow/tensorflow/blob/master/tensorflow/tools/pip_package/BUILD#L98)
 The size increase is because release uses more optimizations which results in expanding more C++ templates, so the object files are bloated.

The ` --define=no_tensorflow_py_deps=true` flag could be used, but I think #61619 is a better solution here. Let's try that one first Hi @angerson and @mihaimaruseac  thank you for the PR. It is working well, wheels are generated successfully and sanity tests are passing.  Thank you for confirming! Let's close this once the other one lands. Closing since the other one landed. Thank you for the PR!
The TensorFlow CPU release build was failing on the Windows platform. The reason for the failure was the creation of a large zip file named simple_console_for_windows.zip, whose size was 4GB exceeding the limit zipper.exe could handle.

Solution:
Overriding the EIGEN_STRONG_INLINE macro resolved the issue by keeping the size of simple_console_for_windows.zip under the limit of zipper.exe.
Changed the flag "TF_OVERRIDE_EIGEN_STRONG_INLINE" to 1 in
/tensorflow/tools/ci_build/windows/cpu/pip/build_tf_windows.sh file while running the release build