Paris has 20 administrative districts, or arrondissements in French.
The last two digits of the zip code represent the arrondissements. You may need this information if, for example, you are booking a tour with hotel pick-up, and the description says "pick-up is only available in arrondissements 1-15".
For example, the Louvre Museum is in arrondissements 1, Opéra Garnier and Galeries Lafayette is 9th, Bastille is 11th.