Leaving a relationship, am I being unfair?

Although you did spend your money on his kids clothes, it was your decision to do so. It wouldn't be right to leave his kids with almost nothing, but you shouldn't feel bad about salvaging the clothes that remain unworn and unused. If he is reasonable ask him to give you the clothes when the kids are done with them.