Heat a frying pan over medium heat. Add the oats, sliced almonds, and the allspice or ginger. Toast gently for 3 to 4 minutes until the oats turn golden and the nuts smell toasty. Sprinkle in the brown sugar, let it melt slightly, then tip the crumble mix into a bowl and set aside.