What problems are there in not using a primary key column at all?
there are no queries where I will ever want to select a row by
  post_versions.id


If you have a column that you know you'll never have any use for whatsoever, be it a synthetic key or any other kind of column, then sure, remove it.

The problem with a table without a primary key, is that it can potentially  have duplicate rows, and, in the relational model, duplicate tuples do not exist.
So if your table happens to have duplicate tuples, it would violate a fundamental rule of the relational model.

But that's not necessarily a reason to create a synthetic key that you have no use for, for the sole purpose of having a primary key. Firstly, the way your table is structured with its updated column, it's very unlikely that it will ever have duplicates. Secondly, even if it happened, the consequences of having duplicates must be evaluated relatively to what is done with the data. When for instance a table is used to store log entries to be only displayed, there is no problem having duplicates. On the other hand, if an application had to update some specific row for some reason , then the absence of any primary key would be a problem and probably reveal a design error.