We pretty much feed all of our veggie based kitchen scraps to our worms which are in worm bins separate from the AP system...and then harvest the castings and 'brew' them directly in the system. I'm not saying putting scraps directly in the GB is necessarily a bad idea...but I prefer to keep things separated. There are other folks who add scraps directly to their GB's. You might check with them for some advice/experiences...
A lot of times people will write about something new that they've recently done, but not follow up on how it all worked out...good or bad. Seems like it would be just fine, as long as you were reasonable about it...