Prepare the Bread Pudding:
Preheat your oven to 350°F (175°C) and lightly grease a 9x9-inch baking dish.
Spread the cubed bread in the dish evenly.
In a large mixing bowl, whisk together milk, heavy cream, pumpkin puree, granulated sugar, brown sugar, eggs, vanilla, cinnamon, nutmeg, ginger, and cloves until smooth.
Pour the pumpkin mixture evenly over the bread cubes, pressing lightly to ensure the bread absorbs the custard.
Sprinkle the chopped pecans evenly over the top.
Bake:
Let the mixture sit for 10-15 minutes to soak.
Bake in the preheated oven for 40-45 minutes, or until the top is golden and the custard is set but slightly soft in the center.
Make the Caramel Sauce (Optional):
In a small saucepan over medium heat, melt the sugar, stirring constantly until it turns a deep amber color.
Carefully whisk in the butter until combined. Slowly add the cream while stirring. Cook for another 1-2 minutes, then remove from heat.