How do I even bring up the idea without making it weird?

Start with curiosity, not a proposal. Talk about fantasies in general first, then gauge openness before ever mentioning anything specific.