Someone doesn’t like the rainbow flags gracing San Francisco’s Market Street in honor of LGBT Pride month.

Bay Area Reporter reader Jim Phillips said in an email that “Take your flags off our street” was written in blue chalk in the northeast corner of Market and Montgomery streets. Phillips said he saw the writing (seen at right) at 6:30 p.m., Monday, June 4. By late Tuesday afternoon, June 5, the writing was gone, he said.

Silvia Woo, a police service aide with the San Francisco Police Department, said that the graffiti hadn’t been reported to police, but since the rainbow banners are the only flags at that location, “the phrase is targeted toward gay people, so it would be considered a hate crime.”

Brendan Behan, executive director of the San Francisco LGBT Pride Celebration Committee, the group that pays for the flags, didn’t respond to a request for comment.