The Archive Email rule attaches incoming emails to existing Contact/Lead/Organization/Opportunity/Case records. This is done by matching the From email address to the primary email address stored in a Contact/Lead/Organization/Opportunity/Case record.
In the case where the From address does not match the primary email in any CRM record, then the match happens based on the To email address.