Is is possible to restrict visibility of custom data sets?
There is such a concept as Private Notes which are Notes that are only visible to the author and to anyone with the permission to see 'all notes'. Try that. It may be less effort but still acceptable