It's okay that your first cosplay(s) were thrown together. Mine was, too! The female character is harder to coslay than the male. His outfit can be thrifted, but make sure to buy men's clothing.
Her outfit might be available on the mass market (cosplay sites, eBay, etc.) Otherwise you would have to make/thrift it, or get it commissioned.
His weapon will be tricky though. You'll have better luck posting in the appropriate forum (props), where more knowledgable people can help you out with materials and techniques.
If you want to "improve" your cosplays, pay attention to details. Things like wigs, shoes, accessories, and makeup can vastly improve an average cosplay to look polished and complete.
That's all I've got for now. Best of luck!