Hey,
Since your a "keen amateur who rides for fun ", I think you should go with the Carbon. Carbon bikes have a little more flex than aluminum, but their a world of comfort apart. I use an all alu bike for my racing because it is stiffer. I certainly suffer on long training rides though. Right now I'm trying to put together 2 identical bikes, one carbon and one alu. That way I can train comfortably, and race stiffer. But for you, go carbon. Dont listen to the Fuji guy. Working at a bike shop, we had teh Fugi Rep come in the other week and gave us the whole Fuji lineup, if a Fuji is what your looking into, look into the Team carbon bikes. Their light, and going to be a lot more comfortable than the SL. I do have a problem with Fuji though. For the money you pay, your geting some crapola. Ritchey stem, seatpoast and handlebars, for 5 grand? hmm. Look elsewhere, OR, buy a comfortable frame and build a bike for the same price. If you go that route, you can get much better equipment for the same price. Look into a LOOK frame, the 481SL is awsome, and in the US, if you look you can get if for roughly 2300, combine that with a C Record group, OR Dura-Ace if thats your thing, for about 1500, Some Euros wheels for about 900, Newton Stem/Handlebar, and your looking at a kick ass bike for about the same price, and at a lighter weight. Just a thought, and just an example.
Dave