Memory problems with MySQLWorkbench
If you really need to look at all the records, you should take the strain off of MySQLWorkbench. It already has enough on its plate micromanaging MySQL.
SUGGESTION #1 : Use MySQLWorkbench from Another Workstation
Install MySQLWorkbench on another server that is not running MySQL. Remotely connect to MySQL from the other Workstation. By divorcing MySQLWorkbench from MySQL, MySQLWorkbench can focus on what does best, micromanage the data and display at the user's whim. MySQL can focus on doing key caching, query caching, InnoDB, DB Connections, read/writing threading, and all other memory-consuming tasks. This will end the tug-of-war for RAM by both products. Even the OS will reap more of the spoils of war for RAM.
SUGGESTION #2 : Create a Text File and View it in some Editor
Install mysql on Another Workstation. Do not run the server on it, but use the mysql client program. To get data from the table mydb.mytable, from the second server, run this:
C:\&gt; set DESTFILE=C:\subfolderofyourchoice\Display.txt
C:\&gt; mysql -hIPOfMySQLServer -uroot -p --table -Ae&quot;SELECT * FROM mydb.mytable&quot; &gt; %DESTFILE%

Once the file is created , use a text editor to display the file. I suggest the following:

Notepad
vi (yes I said, vi for Windows, I use it today)
Microsoft Word

Give it a Try !!!