Email DeDuplication
Email DeDuplication
In some instances, e-mail can be deduplicated using the MD5 hash value of four common metadata fields opposed to the entire message. Those fields typically used for deduplication include: Sender's name (the "from" field), "Sent On" date and time, "Subject" line, and Attachment Count (just the count, since some e-mail servers will strip attachments completely and automatically). More fields such as the "CC" and "BCC" may also be used.
In some instances, e-mail can be deduplicated using the MD5 hash value of four common metadata fields opposed to the entire message. Those fields typically used for deduplication include: Sender's name (the "from" field), "Sent On" date and time, "Subject" line, and Attachment Count (just the count, since some e-mail servers will strip attachments completely and automatically). More fields such as the "CC" and "BCC" may also be used.