There is a big difference with some. Mesquite, very strong. Hickory is distinctive and still pretty forward. Realistically I think most fruit woods are pretty similar. Subbing Cherry for Apple, will not have a huge impact, short of you having a super sensitive palate. Alder is mild and can be mixed with anything...JJ
I have found the amount of moisture(seasoning) in the wood makes a difference in the flavors. The differences become more distinct and pronounced to my palate when I use wood around a 20% moisture content, rather than the store bought bags.
I'm lucky enough to be able to source several fruit and nut woods locally. Every time I visit a local farm, I ask for wood chunks/pieces.