Preheat your oven to 350°F (175°C).
In a large mixing bowl, whisk together the pumpkin puree, eggs, milk, brown sugar, vanilla extract, cinnamon, nutmeg, ginger, and salt until well combined.
Place the cubed bread in the 9x13 inch baking dish. Pour the pumpkin mixture evenly over the bread, making sure all pieces are soaked.
If desired, sprinkle chopped pecans or walnuts on top of the bread mixture.
Cover the dish with aluminum foil and let it sit for about 20 minutes to allow the bread to soak up the liquid.
Bake the casserole, covered with foil, for 30 minutes.
Remove the foil and bake for an additional 15 minutes, or until the top is golden brown and the casserole is set.
Remove from the oven and let it cool for 5 minutes before serving.
Serve warm with a drizzle of maple syrup.