AG replicas across two FCIs
Is this a valid setup ?


Yes.  This configuration is detailed here:

AlwaysOn Architecture Guide: Building a High Availability and Disaster Recovery Solution by Using Failover Cluster Instances and Availability Groups 

If you want automated failover between data centers, look at using a Cloud Witness for cluster quorum.