Scale are little brown hard shelled creatures that eat your leaves and stem sap.

no, that's not a scale. although it can be some other insect damage (e.g. snails, etc).
it looks more like a physical damage to me, e.g. branch rubbing?
imo, nothing to really worry about at this stage. for more info on that issue google for "citrus fruit scarring guide".

igor

No it is not.

Thanks guys. I've been paranoid ever since reading Big Als post mentioning scale and looking over every inch of this thing.

The only bugs I can find on it are some little fruit fly looking guys in the soil. They fly up when I poke around in it or water it.