“When you use Signal, your data is stored in encrypted form on your devices. The only information that is stored on the Signal servers for each account is the phone number you registered with, the date and time you joined the service, and the date you last logged on.”
The RCS issue hits the nail on the head I think. It’s really the biggest stumbling block for everyone at this point.