Justice Secretary Ken Clarke said the government would also consult on axing 54 County Courts.
Some 300 magistrates' courts deal with minor crimes, crown court committal hearings and licensing applications.
The Magistrates' Association says it is unsurprised by plans to close underused courts but warned ministers against eroding local justice.
Mr Clarke also announced there will be a review in the autumn of the Â£2bn legal aid bill, saying that more had to be done to cut costs.
Closing the courts will save the government at least Â£15m a year in running costs, plus an extra Â£22m in maintaining the buildings. The courts earmarked for closure make up 30% of the 540 in England and Wales.
In a written ministerial statement to MPs, Mr Clarke said: "I will ensure that we keep courts in the most strategically important locations, communities continue to have access to courts within a reasonable travelling distance, that cases are heard in courts with suitable facilities and that there is an overall reduction in cost."
Mr Clarke said that the number and location of all courts no longer reflected how populations had changed and how easy or difficult it was for people to reach them.
Although the consultation is coming the day after the Budget, the government has been seeking to cut the costs of magistrates' courts for some time.
Over the past decade an increasing proportion of minor offences have been dealt with out of court, such as through fixed penalty notice fines. Some courts only sit for half a day at a time, but require staff for longer hours.
The courts also have indirect costs related to transporting lawyers, police officers and defendants to and from the buildings.
"When public finances are under pressure, it is vital to eliminate waste and reduce costs," said Mr Clarke.
"At the same time we should also take the opportunity to think afresh about how we can provide more modern court services.
"We increasingly use the internet and e-mail to communicate and access services and we travel further to work, for leisure and to do our weekly shop. Providing access to justice does not necessarily mean providing a courthouse in every town or city."
John Thornhill, chairman of the Magistrates' Association, said the service had experienced three years of cuts, meaning victims were waiting longer to see justice done.
He said: "The magistracy still has a very significant contribution to make. The Association has already proposed innovative and cost effective procedures for delivering community justice.
"We look forward to discussing such proposals with the government to develop a cohesive justice system in which crucial decisions on dealing with those who offend against fellow citizens."
There are almost 29,000 magistrates in England and Wales, volunteers drawn from the local community and they deal with nine out of 10 cases that come before the courts.
Most cases are heard by three magistrates who only receive expenses and allowances to cover loss of earnings. District judges also appear at magistrates' courts to deal with more complex cases that do not need to be sent to full trial at Crown Court.
County Courts deal with most cases brought under civil law. These include divorces and family disputes, business cases, housing issues, accident claims and small claims.
The Ministry of Justice is planning to close 103 magistrates' courts in England and Wales.