Tough one. It is a little hard to answer without knowing all of the details, but I am inclined to say no. Setbacks apply to all lots, regardless of dimensions. At the same time, I am aware of neighborhoods in Madison, built under older regulations which allowed smaller setbacks. Residents frequently encountered problems when trying to put additions on their homes. This led the city to revise its zoning codes with regard to certain types of neighborhoods. The point was to make it possible to continue the existing pattern of development (additions or infill). Might this be a consideration?