Place potatoes in a large pot and add enough cold water to cover by 1 inch. Bring to a boil over high heat, reduce to medium-low and simmer until potatoes are easily pierced with a fork, 30 minutes. Drain; slightly cool.
Cut potatoes in half and place in a large bowl. Add onion and celery. IN a separate bowl, mix mustard with vinegar, mayonnaise, relish, salt and pepper. Pour over potatoes and gently stir to mix. Chill if desired or serve at room temperature.