The victim, in his 70s, was taken to hospital. His injuries are non-life threatening, police said.
Videos at the scene show a man in red being arrested, who witnesses say was seen stabbing the man in the neck.
The BCC reports that a crime scene has been put in place and police are investigating.
PM Boris Johnson was one of the first to respond to the attack on Twitter.
