Tricky one, usually you would own one fence, but check your deeds, if the fence is on your side of the boundary it's yours. If on other side NOT yours even if you contribute towards it. but seems unreasonable of neighbors saying no paint after you paid, suppose you could ask for your property back and remove any fence panels they say not to paint. You still have recipt right?