The problem behind extracting data from users is that you need the users to be rational. Since humans are irrational, you need community notes as moderators. Then, you will have highly robust and truthful data.

How do you make users rational? 
You "train" them. Hints the shift in social media acceptability.  

With federated models, you need something more globally sophisticated than retrieval mechanisms. You would need sophisticated "retrievers."

But here is the kicker.... Is the data that is extracted from users proportional to the amount of perceived or actual "value" they uniquely possess? Thinking about the knowledge they have gained through experience. If so, shouldn't they be the beneficiaries to that "value?" 

The crushing realization is that through abstraction, even the engineer receiving the valuable data might not understand how that "value" is derived. Do we realize we could be robbing ourselves? 

Ultimately, without the proper beneficiary of the "value" of personal data, the overall system is doomed to failure. It is a financial countdown to the end of the finish line for complete data extraction, (Rarely anything new or unique) and then complete automated systems built from the data extracted. Financial erosion at its simplest. 

@elonmusk
@finkd