Can I drill vertically through this from the main floor to the upstairs?
Yes, you can. It will not affect it structurally, given you are only drilling relatively small (3/4” or so) holes. You won’t want to drill a large plumbing line through it.