When duplicating a budget in addition to the start and end dates you should be able to assign a new description for the budget so that you don't end up with two budgets with the same name.
*** This bug has been marked as a duplicate of bug 7498 ***