Yes you can. If you buy your Go Phone at a retail store, politely decline any offering to activate service for you. Bring your non-activated Go Phone home and activate it using a link found on www.att.com/gophone. You'll be given the option to port your number from there.
If ordering from the AT&T website you can port your number during the order process.