Mainland Chinese investors posted a net sell-off of $455 million in Hong Kong stocks in May, breaking a nearly three-year buying streak.