A man who claims he was racially assaulted when visiting Leeds said he “only felt somewhat safe” when he returned to London.