Installing this time was a breeze. Two things I did differently. First, I am at work, so I have ethernet. I upgraded to the latest kernel available. Second I downloaded the prism54 modules from cvs. They worked like a charm without any problems.

So I finally have a well configured system to work with.