If you are responsible for the fence, then you can choose which way round the fence is installed. There is no law that states that the ‘good side’ must face your neighbour.

If your fence faces onto the street or a public footpath, you may choose to have the rails (or the back) of the fencing facing into your property as a security measure to prevent anyone climbing over the fence, but it is entirely your choice.