Johnson refuses to rule out further restrictions