The man was armed with a knife and when he moved towards police, they shot him, BBC reported.
Rouen Mayor Nicolas Mayer-Rossignaol said the attack on the synagogue did not just affect the Jewish community, but the entire city was in shock.
Further details have not yet been released.
SD/PR