The biggest problem with the PSP isn't the handheld's lack of quality games. It's the handheld's current reliance on making you buy, and use, those awful UMDs. But later this year, that will change.
Sony's John Koller says that, by the end of the year, Sony will be making a lot more PSP games available over the PlayStation Network. So you won't need to go to a store and buy one of those clunky, noisy discs; instead, you can just download a game and store it on a memory card.
And we're not talking retro games, either. We're talking the simultaneous release of a game in a store (on UMD) and on the PSN (as a digital download). Sony have been pushing this with first-party games for a few months now - LocoRoco 2 and Patapon 2 (in Europe) were both available day 1 as downloads over the PSN - but we should be seeing it a lot more often in the months to come, from both Sony and third-party publishers.
Q&A: Sony's John Koller Talks PSP's Downloadable Future [Wired]