Backing entire Postgres database server up with pg_basebackup
Question: do I really have to copy the WAL to have complete backup from the time of starting pg_basebackup command?


Yes, you do.

The DB needs current WAL to start up from the base backup.

You can use pg_basebackup -X stream on 9.3 and above to copy all the required WAL along with the initial basebackup.