It was stopped back in '78 because of pollution and quality of water back then. According to the organisers amongst concerns of the current water quality conditions by environmentalists that it's safe. The event went ahead with an 18-year old winning first swim across the harbour in 33 years. You can read more from the BBS News article,
Hong Kong revives harbour swim race after pollution ban.