Hey. Maybe this has already been discussed.
I think it would be very convenient if there was an option:
"Select objects in the scene" To select already assigned objects.
Here is the file I made a month ago. I do not remember what kind of group it is.
Now I'm using the outliner, but if there was a button,I think it would be mor user-friendly.