In a medium bowl, cream butter with sugar until smooth.
Add eggs, and beat well. Add soda to sour milk, add to creamed mixture and beat well.
Blend in all spice and cherries. Add flour, and blend well.
Pour into 13 x 9 inch pan. Bake for 35 - 40 minutes at 350 °F.
Let cool. Serve with whipped cream or vanilla ice cream, if desired.
Yields 12 - 15 servings.