As I understand your marriage cannot be registered in this country if it has been registered abroad, but it is still valid if carried out legally in France.
I understadn that it is possible to deposit a copy of your forein certificate here so that you can obtain copies here if you need to rather than havign to go to the authorities in France.