Preheat your oven to 350°F (175°C). Grease and flour your loaf pan.
In a mixing bowl, combine the chopped figs, dates, and nuts. Set aside.
In another bowl, mix the flour, baking soda, baking powder, salt, cinnamon, and nutmeg together.
In a larger mixing bowl, cream the softened butter and both sugars together until light and fluffy with a mixer.
Beat in the eggs one at a time, making sure each is well incorporated.
Add in the buttermilk and vanilla extract, mixing until combined.
Gradually add the dry ingredients to the wet mixture, stirring gently until just combined.
Fold in the fig, date, and nut mixture until evenly distributed.
Pour the batter into the prepared loaf pan and smooth the top.
Bake for 45 to 50 minutes, or until a toothpick inserted into the center comes out clean.
Remove from the oven and allow to cool in the pan for 10 minutes before transferring it to a wire rack to cool completely.