In a letter to the Daily Telegraph, they said early schooling was causing "profound damage" to children.
They are calling for more emphasis in the curriculum on learning through play.
England's Education Minister Elizabeth Truss said starting school later would damage attempts to close the achievement gap between rich and poor.
The signatories to the letter, including academics, teachers and some writers and charities, said the current system focused too much on formal education, such as the "three Rs", at too early an age.
They said national policies should be reassessed to make them more similar to education systems in Scandinavia.
In Northern Ireland, the statutory age of entry to school is four.
In England, Scotland, Wales, Cyprus and Malta, the age is five.
The statutory age is six in Austria, Belgium, Croatia, Czech Republic, Denmark, France, Germany, Greece, Hungary, Iceland, Norway, Portugal, Romania, Republic of Ireland, Italy, Liechtenstein, Luxembourg, Netherlands, Norway, Portugal, Romania,  Slovakia, Slovenia, Spain, Switzerland and Turkey.
The age is seven in Bulgaria, Estonia, Finland, Latvia, Lithuania, Poland, Serbia and Sweden
(Figures from the National Foundation for Educational Research (NFER))
Your comments
The letter said children who entered school at six or seven "consistently achieve better educational results as well as higher levels of well-being".
It was signed by 127 experts including Lord Layard, director of the Well-Being Programme at the London School of Economics; senior lecturer in psychology of education at Cambridge University Dr David Whitebread, and director of Play England Catherine Prisk.
Another of the signatories, former Children's Commissioner for England Sir Al Aynsley-Green, said: "If you look at a country like Finland children don't start formal, full-scale education until they are seven.
"These extra few years, in my view, provide a crucial opportunity, when supported by well-trained, well-paid and highly educated staff, for children to be children."
The letter was sent by the campaign group, Save Childhood Movement, which has launched a campaign called Too Much, Too Soon.
Group founding director Wendy Ellyatt said: "Despite the fact that 90% of countries in the world prioritise social and emotional learning and start formal schooling at six or seven, in England we seem grimly determined to cling on to the erroneous belief that starting sooner means better results later.
"There is nothing wrong with seeking high educational standards and accountability, but there is surely something very wrong indeed if this comes at the cost of natural development."
Currently most children in England go to nursery at the age of three or four before starting school in the September following their fourth birthday and spend a year in reception class.
Legally all children in England have to be in full-time education by the term after their fifth birthday.
Education Minister Elizabeth Truss rejected calls for formal schooling to start later in England, saying this would damage the life chances of children from poorer homes.
"I think the campaign is wrong-headed," she told The World at One on BBC Radio Four.
"At the moment we've got one of the biggest gaps between the performance of low-income and high-income students. And if schooling were to be delayed, that would mean that it was even later that we started working on closing that gap. And I think that's a massive problem."
Earlier, a source close to Education Secretary Michael Gove had told the Telegraph the authors of the letter were "misguided".
"These people represent the powerful and badly misguided lobby who are responsible for the devaluation of exams and the culture of low expectations in state schools," he said.
By Angela Harrison Education correspondent, BBC News
The age at which children should start formal schooling has been hotly debated for many years.
This campaign and letter to the Telegraph has added potency because it comes as the government in England consults on whether to bring in a new assessment of children as soon as they start in reception classes.
At the moment, teachers check children's abilities across a range of areas in their reception year, but under the proposed changes this check would be carried out earlier and used as a benchmark.
It was floated as an idea by the head of Ofsted, Sir Michael Wilshaw, who said there was a need for a more reliable assessment of children when they started school so that their progress could be better measured as they moved up and left schools.
At the same time, there are calls for more flexibility over the school starting age in Northern Ireland, where pupils start at four.
Supporters of a move towards a later start, point to the differences around the world and in particular to Sweden and Finland, where the legal age for starting school is seven.
Children in those countries typically enter formal schooling later than those in the UK, but they have usually been in a nursery or kindergarten where they have been learning through play and games.
Earlier this week, Northern Ireland Education Minister John O'Dowd indicated he was willing to introduce new rules to allow flexibility on the school starting age.
Researchers said Northern Ireland had the lowest statutory school entry age in Europe, at four.
In England, the government is consulting on whether to bring in what it calls a "simple baseline check" at the start of reception, from which children's progress could be measured for league table and Ofsted inspection purposes.
It would also show parents what progress their children made in the early years of primary school, it says.
At the moment, children are assessed by their reception class teachers at some point in the year but the results are not used formally in accountability measures such as league tables.
The progress children make at primary school is currently measured formally from the results of national (Sats) tests in English and maths taken by children at the age of six or seven and their teachers' assessment of their abilities.
Government officials say a move to an earlier "baseline check" is just one option they are consulting on.
Five- and six-year-olds also have a phonics check on their reading abilities at the end of Year 1.
Children should not start formal school lessons until the age of six or seven, a group of educationalists has said.