This was so easy, I had to bookmark it here…

Get-SpSolution | forEach-Object {
$_.SolutionFile.SaveAs("C:\exportedWSP\$($_.Name)")
}

 
Note that this only exports farm solutions, not sandboxed ones that sit in the content database