In fact, they would be foolish not to.
Here's our old friend, the draft pick value chart, used by every team in the NFL.
http://www.profootballdraft.com/draftchart.php?PHPSESSID=5daf14e0e8cda50f843c64096625ed69
As shown, we would be giving up 2600 points of value and receiving about 1834 (I valued Philly's 2006 #2 as 150 points, that is, the approximate value of a late 2005 3rd round pick).
Even if we account for the fact that this is a soft draft at the top by knocking 10% off the value of the #2 pick (260 points, making it worth 2340), we're still getting hosed.
Quantity does not always equal quality. If Philly throws in their 2006 #1, or if they turn it into a swap of Corey Simon and their #1 for the #2 overall pick, then maybe there's something to discuss.
But more likely, all this adds up to Philly not being that "other" team.