The only way to do it is to login into group’s creator Facebook profile. Then go to your Group and click on Edit Members and remove all members including yourself (the group creator account) and the Group will be automatically deleted.
I hope Facebook can add in one Delete Group button to save you time deleting members. Just imagine you have 20,000 members, how long it will take to delete all of them…!!