SSL Madi and Pro Tools 10 freezing.

I recently upgraded from the 192 I/O and HD Native card to the SSL Madixtreme 64 and the Madi AX and from Pro Tools 9 HD to Pro Tools 10 Native. I had these problems when I was running the Madi and 9 HD, as well. Basically, when tracking I have just a ton of freeze ups. I can't run any plug ins anymore while tracking, and I used to run tons. I upped my RAM to 20GB, and it's still freezing up often and giving me a hardware buffer error with no plug ins. I've tried changing everything around multiple times in the playback engine and all the latency controls etc. It's gotten better, but still erroring out quite a bit. What might I be missing? SSL tells me it's an AVID issue.