Google Calendar - Only include attendees that accepted meeting

It would be nice if the attendees that were capture for the activity were only the ones that accepted the meeting invite.  We noticed that it will include all attendees regardless if they plan to attend or not.  For example, we had one meeting with 20 external attendees that were invited, but maybe only 10 accepted. The CSM had to manually identify and remove the attendees that didn't accept the meeting.