On a budget there are some options. You've already spec'd out what you want in a phone so that narrows the field.
Under $25, you will likely have a more limited selection of new phones to choose from so suggest also look at refurbished phones and gently used phones from friends and acquaintances who have upgraded to another phone and/or carrier.
If there's a local PagePlus dealer, it may be worth a visit to see what they have available in your price category. Older model LG, Motorola, Kyocera, Pantech and Samsung refurbished phones might be in your price range. Plus you can try before you buy, and you can walk out the door with a working phone.
Over the internet, try ebay or other websites for a PagePlus phone. The HoFo PagePlus wiki FAQ section has a list of phones that are allowed and work OK on PagePlus(note that Verizon Prepaid phones are not allowed). See this cautionary note on a pageplus dealer website on how to buy on ebay or craigs list: http://www.howardforums.com/pageplus/ebaytips.html You can find reviews of phones on the web including some good video reviews of some models at CNET.
Another suggestion is ask around for someone who has an older deactivated Verizon phone they will give to you for free. If the phone is PagePlus compatible, works OK and is in good shape, has a good ESN serial number (not blacklisted) you may be able to activate it. Even if you need to buy a new battery (may be missing or dead) or a AC or DC charger off ebay or at a dollar store it can be worth it. A missing phone manual can also be downloaded from the manufacturers website or in some cases the Verizon or PagePlus websites.