I experience this also. I quit probably about three months ago. I'm in law school and it is hard to go to class most days. My boyfriend is also in law school and has helped make sure I show up (like we walk to school together). It is getting better for me, I guess, but this phenomenon has by no means disappeared. The thought of going to my evening class tonight makes me so anxious, and I skipped last week for the same reason. It's not the hardest thing I've dealt with as a result of getting off adderall, but it has sucked.
One thing I can recommend is an herbal supplement called 5-HTP. You should google this and read about it if you're interested.
I also have found that smoking marijuana helps with my social anxiety, but obviously in many states that's not really an option.
I wish you luck!
