Aid4Mail Investigator now includes the Google Vault source format, previously only available in Aid4Mail Enterprise.
Full support for Google Vault cloud attachments. They are now searchable alongside regular attachments. Metadata for these files is searchable if the appropriate search option or operator is used. The collected metadata is formatted as in the following example:
Author: eric@aid4mail.net
Collaborators: katie@aid4mail.net, julian@aid4mail.net
DateCreated: 2024-04-03 20:01:38
DateModified: 2024-04-04 17:46:42
DocId: 1aBFPUapK1RANfceFV2adIYmpUjgj7Y88faRdkwZbzo4
FileName: Why Hyperlinked Files Should Be _1aBFPUapK1RANfceFV2adIYmpUjgj7Y88faRdkwZbzo4.docx
Title: Why Hyperlinked Files Should Be Treated as Email Attachments
Viewers: john.doe@domain.com
Use the “FileMetadata[googledrive]” operator to limit your search to Google Vault file metadata. Example:
FileMetadata[googledrive]:”Collaborators:**julian@aid4mail.net”
New SenderMessage filter operator to search within the sender’s message, excluding the quoted email thread that follows it. Example:
SenderMessage:”call me”
Note: Identifying where the sender’s message ends and the quoted email thread starts isn’t always accurate due to lack of a standard. In plain-text emails, the marker is language-dependent. To preserve performance, we included the most popular languages among our users: English, French, German, Italian, Portuguese, and Spanish. You can customize languages and criteria in the BeginQuotedPart.dat configuration file. Follow these steps:
1. Copy BeginQuotedPart.dat from the “Data” subfolder in the Aid4Mail program folder to “C:\Users<UserName>\AppData\Roaming\Aid4Mail5\Data\”.
2. Edit the copied file to add or remove languages and criteria. This ensures your changes are preserved during updates.
Detailed editing instructions are included in the BeginQuotedPart.dat file.
New token to extract the sender’s message, excluding the quoted email thread that follows it:
Body.SenderText
Support for a new Journaled email format found in some Mimecast exports.
Improved GUI. Session processing information is preserved when you close and reopen the GUI.
Enhanced detection of linked Google Drive files as modern attachments. This improvement concerns the “has” search operator:
has:drive|googledrive
Fixed an issue with “Add extra metadata to email headers” when “Remove journaling envelope” is used and the source format is an mbox file (e.g., Thunderbird, Google Vault, Takeout). The journal report metadata was missing.
Fixed an issue when creating CSV files with UTF-8 encoding.
Updated PCRE2 to version 10.44. PCRE2 is the engine for regular expressions and wildcard matching in Aid4Mail.
Updated Column Configuration Editor: The Column Configuration Editor has been updated to include the new data extraction token: X-MS-Exchange-Parent-Message-ID (or Header.X-MS-Exchange-Parent-Message-ID). Use this token to extract X-MS-Exchange-Parent-Message-ID values from email headers.
Updated the GUI with several improvements and bug fixes.
Fixed an issue when extracting Gmail Labels from Google Vault exports to formats like CSV, PDF, and HTML.
User Guide Refresh: The Aid4Mail User Guide has been updated, providing users with the latest instructions, tips, and best practices to maximize the utility of Aid4Mail in their email processing tasks.
These updates reflect our ongoing commitment to improving Aid4Mail’s functionality and user experience, incorporating valuable feedback from our users and advancements in email processing technology.
Version 5.1.6 (released: February 22nd, 2024)
EDRM MIH Hash Value Support: Aid4Mail now supports EDRM MIH hash values, aligning with our existing MD5 hash functionality that utilizes the Message-ID field. Should a Message-ID be absent, as in drafts and outgoing emails, the MIH value will be accordingly set to null.
Sender IP Address Extraction: A new capability has been introduced to extract the sender’s IP address, whether IPv4 or IPv6, directly from SMTP headers. It’s important to note that this feature operates independently of the integrity of the header, without assessing potential tampering.
Expanded Search Capabilities with New Operators: Introducing three new search operators to enhance your querying power: EntryId, FromIP, and MIH, designed to streamline and refine your search processes. EntryId applies to PST and OST files and contains the email PR_ENTRYID value in Base64 format. FromIP searches the sender’s IP address. MIH searches EDRM MIH hash values.
New Template Token for Enhanced Data Access: The {EntryId} template token has been added, offering direct access to the PR_ENTRYID value in Base64 format, facilitating easier data manipulation and retrieval.
Updated Column Configuration Editor: The Column Configuration Editor has been updated to include new data extraction tokens, such as Header.X-PR-ENTRYID, Address.IP, EDRM.MIH, and various Header tokens (X-PR-ENTRYID, X-From-IP, X-EDRM-MIH), enhancing the flexibility and depth of data extraction.
Accessibility Improvements: We’ve made significant enhancements to our software’s accessibility, featuring improved keyboard navigation and enhanced support for screen readers, ensuring a more inclusive user experience.
Resolution of Primary Folder Structure Identification Issue: An issue that affected the identification of the primary folder structure in non-English OST and PST files, notably identified in a Polish OST file, has been successfully resolved.
Multi-user Apple Mail Folder Processing Fix: A fix has been implemented to address a processing issue within multi-user Apple Mail folders, ensuring more reliable operation.
General Enhancements and Bug Fixes: A series of other minor fixes and improvements have been made, focusing on enhancing the overall performance and stability of Aid4Mail.
Updated Third-party Components: Several third-party DLLs and utilities have been updated to their latest versions, ensuring improved security, reliability, and compatibility.
User Guide Refresh: The Aid4Mail User Guide has been updated, providing users with the latest instructions, tips, and best practices to maximize the utility of Aid4Mail in their email processing tasks.
Incremental Processing: Due to improvements made to OST and PST (processed without Outlook) source formats, incremental processing with this update will not work if it resumes a session from a previous version of Aid4Mail.
Version 5.1.5 (released: November 20th, 2023)
Adds support for searching the contents of unknown attachment types based on the PKZIP format.
Improves creation of PST and MSG files when the “Process using Outlook” option is unchecked. Message status information (read, unread, replied, etc.) is now displayed in the target Outlook files when available in the source format.
Improves error recovery when converting to or from MSG files using Outlook.
Improves some error messages.
Fixes issues with some alias search operators not being recognized.
Fixes an issue when a ZIP, 7z, or other compressed archive contains a long folder name that exceeds the default Windows-supported path length once extracted.
Other minor fixes and improvements.
Version 5.1.4 (released: October 20th, 2023)
Adds a new search operator for comparing the day of the week when an email was sent. Specify the day names in English, their 3-letter abbreviation, or their numerical value (Monday = 1, Sunday = 7). You can optionally include minutes by preceding them with a colon. Use comparison operators (>, <, =, <>, >=, <=) to test values. Here are several variations of a search that only lets through emails sent on the weekend:
SentDay:(Saturday OR Sunday)
SentDay:(Sat OR Sun)
SentDay:(6 OR 7)
SentDay>Friday
SentDay>5
You can combine SentDay with SentTime to refine your search even further. For example, the following search criteria will find all emails sent over lunchtime during workdays (Monday to Friday):SentDay<6 AND SentTime>=12 AND SentTime<=14
Fixes an issue related to the latest updates of Outlook. Sometimes, folders created in a target PST file or Outlook profile are invisible.
Fixes an issue when converting from Google Vault to Outlook. Some emails incorrectly showed the Drafts icon.
Updates third-party utilities.
Updates the User Guide.
Version 5.1.3 (released: October 2nd, 2023)
Adds three new values to the “has” filter operator. Use them to detect remotely stored attachments on Microsoft OneDrive (onedrive) or Google Drive (drive or googledrive).
has:drive|googledrive|onedrive
Adds a new search operator for comparing the local time when an email was sent. Specify hours using the 24-hour format. You can optionally include minutes by preceding them with a colon. Use comparison operators (>, <, =, <>, >=, <=) to test values. The following example will find all emails sent between 12h00 and 14h00:
SentTime>=12 AND SentTime<=14
This one will find emails sent after 9 AM and before 13h30:
SentTime>9 AND SentTime<13:30
Improves the “is:encrypted” filter operator. It now detects all emails using S\MIME or PGP encryption.
Fixes an indexing issue causing emails sometimes to get saved in the wrong Google Vault target folder.
Fixes a Unicode encoding issue causing incorrect rendering of Google Vault folder names with diacritics and non-Latin characters.
Fixes a regression when converting mail to a target PST file without using Outlook.
Other minor fixes and improvements.
Updates the User Guide.
Version 5.1.2 (released: August 22, 2023)
Adds IsSent:true|false filter operator to distinguish outbound emails. Example:
IsSent:true
Adds -Monitor.LogsFolder command-line switch to specify an alternative location for progress and error log files. Example:
-Monitor.LogsFolder:”D:\Email\Target\Logs”
Reduces format rejection when encountering corruption in EML files with the .eml extension.
Improves handling of “NO [LIMIT] UID SEARCH has partial results” IMAP errors. Now, it continues processing the account instead of aborting it.
Improves handling of MAPI_E_OBJECT_DELETED errors when processing Outlook data using MAPI.
Fixes compatibility issue caused by recent changes in Google Vault’s mbox exports.
Fixes incorrect date time-zone when converting emails from OLM files.
Fixes incremental processing option for Google Vault, Mimecast, and Proofpoint formats.
Other minor fixes and improvements.
Version 5.1.1 (released: June 1, 2023)
Fixes a regression affecting access to Gmail accounts.
Version 5.1.0 (released: May 16, 2023)
Adds workaround for IConverterSession errors when processing email through Outlook (PST, MSG, and Outlook profiles).
Fixes issues in OST files that include a “Shared Data” folder. The alias folder name “Personal data” introduced in the previous update is no longer used; you will now see IPM_SUBTREE instead.
Fixes parsing issues in certain types of complex search scripts.
Many minor fixes and improvements.
Version 5.0.22 (released: April 19, 2023)
Adds support for duplicate folders in PST files created by Microsoft’s Purview eDiscovery Export Tool.
Adds access to the “Shared Data” folder in OST files without requiring to show hidden folders – a setting that is not available in Aid4Mail Converter. Note that the “Personal data” folder is an alias for the primary account root folder. It only improves clarity in the GUI folder selection screen; you won’t see the name used on export.
Adds three new metadata fields to the email header. These are based on MAPI properties from Exchange and Outlook files (Outlook profile, PST, OST files):
– “X-PR-MESSAGE-FLAGS”, with values from the PR_MESSAGE_FLAGS property.
– “X-PR-FLAG-STATUS”, with values from the PR_FLAG_STATUS property.
– “X-PR-MSG-STATUS”, with values from the PR_MSG_STATUS property.
To extract these values, ensure the “Add extra metadata to email headers” setting is checked.
Improves extracting message status information from Outlook mail (Outlook profile, PST, OST files).
Updates the way Aid4Mail starts. Now offers an option to open the GUI on the Home screen or reopen the last Project.
Minor fixes and improvements.
Updates the User Guide.
Updates installer software for creating the Setup app.
Version 5.0.21 (released: March 3, 2023)
Adds News screen to notify you of updates, issues, and other news.
Significantly improves processing speed when converting OLM, OST, and PST files without Outlook.
Fixes issues relating to Proxy settings.
Minor fixes and improvements.
Updates third-party utilities.
Updates the User Guide.
Version 5.0.20 (released: February 14, 2023)
Adds a new setting under App Settings > Advanced > Logging level. When you check the box for “Record minor errors, ” Aid4Mail will log warnings and recoverable errors affecting minor email processing elements. These do not cause a conversion to fail.
Improves responsiveness of Pause, Stop, and Force stop commands.
Fixes a new MAPI system error (0x800CCE1F) caused by recent Outlook updates under Windows 11.
Other minor fixes and improvements.
Version 5.0.19 (released: December 14, 2022)
New behavior when “Remove journaling envelope” option is set:
Sender and Recipient emails, which may be missing from the original SMTP header, are stored in the body of the journaling envelope. Aid4Mail now extracts them so that they are included when the search scope is set to All, Recipients and Participants. Those email addresses are also included when using the {EmailAccount} template token. Furthermore, when using the “Add extra metadata to email headers” option, recipient and sender email addresses from the journaling envelope are preserved in the target header through the new X-Journal-Recipients and X-Journal-Sender header fields respectively.
Adds “Open store on remote server” option for Outlook profile source format. When checked, Aid4Mail bypasses locally downloaded mail (stored in OST files) and collects mail directly from the remote account (i.e. Exchange or IMAP server). This option affects which hidden folders are shown by the “Include hidden system folders”. Note that collecting mail from a remote server is a lot slower than from a local OST file. However, an OST file may not reflect the contents of the account on the server, either because it hasn’t been synchronized or because it’s configured to purge older mail.
Adds “MapiCategories” search operator to email section. Use it to search category keywords assigned to emails in Outlook. This feature works with the following source formats: Outlook profiles, PST and MSG files with the “Process using Outlook” option checked. Example:
MapiCategories:”Red category”
Adds workaround to a Microsoft MAPI bug when collecting mail from an Exchange server and converting it to a non-MAPI format.
Improves organization of user interface menus and main screens.
Improves incremental processing for OST and PST files processed without Outlook.
Fixes a regression that caused incremental processing to fail with mbox, Google TakeOut and Vault source files.
Fixes a regression that saved files as regular PDFs when they were configured as PDF/A .
Many minor fixes and other improvements.
Updates third-party utilities.
Updates the User Guide.
Version 5.0.18 (released: October 11, 2022)
Adds OAuth2 authentication for Microsoft 365 accounts accessed through the IMAP protocol. Note that this will only work if Multi-Factor Authentication is turned on for your Microsoft account.
Adds workaround for downloading mail from EarthLink accounts.
Adds “Export to a single file” option for the CSV and TSV formats.
Several minor fixes and other improvements.
Version 5.0.17 (released: August 8, 2022)
Improves loading speed of projects that have many sessions.
Improves item transfers between source and target MAPI formats (PST, MSG and profiles using Outlook). You should no longer get IConverterSession errors if all the following conditions are met: Aid4Mail license is activated, “Add extra metadata to email headers” is unchecked, “Item filtering” is NOT set to “Search query”, and “Python filtering script” is set to (None).
Updates .NET framework used by GUI and bridge consoles to version 4.8.
Removes the Gmail delegate access option due to lack of support by the Google API.
Several minor fixes and other improvements.
Version 5.0.16 (released: July 1, 2022)
Adds support for the new Google Vault mbox-based export format.
Adds a workaround when using native date filtering on a MAPI profile connected to an Exchange server. Prior to this fix, only the first 4096 items matching a criteria in a folder were processed.
Adds a workaround when using native date filtering through the Graph API (Microsoft 365). Prior to this fix, only the first 275 items matching a criteria in a folder were processed. This is due to an undocumented limitation in Microsoft’s KQL search feature. We recommend you use the OData filtering feature instead.
Adds a workaround when using Windows PowerShell to execute Aid4Mail Console. PowerShell doesn’t support command-line switches that contain a dot (.), like -Source.Format=EML. You can now replace the dot with a plus sign (+) and Aid4Mail Console will run as designed. Example:
Fixes an issue when decoding quoted-printable content in EML or mbox files originating from an Apple computer. When converted to PDF, HTML, or plain text, message text would show “=” signs interspersed in the message text.
Fixes an issue displaying folders in certain PST files when accessing the contents without Microsoft Outlook.
Fixes a target PST file issue when appending emails without Microsoft Outlook.
Fixes an issue when redirecting the output from Aid4Mail Console to a file.
Updates IMAP server names for Yahoo! Mail and AOL when using autocomplete feature in the IMAP configuration editor. Since May 2022, Yahoo! Mail and AOL limit the collection of emails to 10,000 items per folder and 1000 items when using native searching. To overcome these limitations, you must use their new IMAP server name.
For Yahoo! Mail, replace
imap.mail.yahoo.com
with
export.imap.mail.yahoo.comFor AOL, replace
imap.aol.com
with
export.imap.aol.com
Updates regular expressions PCRE2 engine to version 10.40.
Updates third-party utilities.
Updates the User Guide.
Several other minor fixes and improvements.
Version 5.0.15 (released: April 8, 2022)
Adds Source > Format > Email file carving.
Aid4Mail’s new carving feature can extract MIME emails from all kinds of files, including:
Uncompressed disk images (DD, E01, AFF, …)
Forensically extracted unallocated disk space
Natively unsupported mailbox formats like FoxMail, Incredimail and Juno
Corrupted mail files
The carving algorithm works without relying on a file’s internal format, such as a disk image Master File Table (MFT) or data placement markers. The only requirements for successful retrieval are:
– The email is in MIME format (even if incomplete)
– Its MIME parts are stored contiguously and sequentially
– It is not stored in a compressed or encrypted container
As a result, carving won’t work with Eudora, Outlook Express 5, PST, OST and OLM files because emails are not stored according to the above requirements.
File carving is a slow and processor intensive task. If you need to carve emails from a large forensic disk image, consider using this feature only on the unallocated space. Most disk imaging tools let you extract and save the unallocated space to a file. Use that file as your carving source in Aid4Mail.
Whenever available, always prefer the native source format to process your files. Aid4Mail is not only faster, but also better able to determine folder names and status information when it handles a known format.
Note that this feature is only available with the Investigator and Enterprise licenses.
Several minor fixes and improvements.
Version 5.0.14 RC5 (released: February 22, 2022)
Adds drag-and-drop reordering to session panels.
Adds a progress indicator in the Aid4Mail Windows taskbar button.
Adds support for alternative words/terms within a search-list line. The vertical tab “|” symbol is used as a separator. Individual terms can include wildcards. Example:
money|hard cash|dough|moola*|loot
You can also group alternatives when combining with NEAR operators. Examples:
Improves the mbox parser’s accuracy, especially when dealing with corrupted data. The parser is used to extract emails from Thunderbird, Google Takeout, and generic mbox files. It is now able to handle a large variety of mbox and MIME format errors within a mailbox file. As a result, Aid4Mail can find emails that other products either miss or incorrectly merge with the preceding message.
Improves the handling of partly corrupted OLM files.
Changes native date filtering workaround when processing Yahoo! Mail and AOL accounts. Due to a bug in the IMAP server software used by those services, the following operators produce unpredictable results:
SENTBEFORE
SENTSINCE
And are substituted with the following when using the “Date selection” filter in Aid4Mail:
BEFORE
SINCE
Example:
This fails with Yahoo! Mail and AOL accounts:
SENTSINCE 01-Jan-2022 SENTBEFORE 26-Jan-2022
This succeeds with the workaround:
SINCE 01-Jan-2022 BEFORE 26-Jan-2022
This workaround uses the IMAP internal date instead of the email’s Sent date. Usually these two dates are similar, but sometimes can differ significantly. As a result, you may miss emails that were sent within the specified date range. This issue, which has existed for a long time, can only be resolved if Yahoo and AOL decide to fix it one day.
Fixes an IMAP login issue with Rackspace when passwords contain certain special characters.
Fixes a filtering issue that occurred when the tokenization/stemming options were combined with the “known variation” and “proximity” wildcards.
Fixes a regression in the mbox parser that, on rare occasions, made it fail to identify emails in some files.
Many other improvements in both the GUI and engine, as well as some bug fixes.
Updates regular expressions PCRE2 engine to version 10.00.
Updates the User Guide.
Version 5.0.12 RC4 (released: December 22, 2021)
Please note that most of the features mentioned below are only available in Aid4Mail Investigator and Enterprise. However, we have improved PDF creation and Proxy options as well as many tweaks and fixes that also benefit Aid4Mail Converter.
Adds major improvements to native filtering capabilities. The settings are now grouped under their own “Native filtering” section and can be combined with folder filtering. You can filter by date range without having to write a native search query – simply enter the year (yyyy), or year-month (yyyy-mm), or full date (yyyy-mm-dd) in the corresponding fields.
Note that if you configure a date selection and then click on the “Search query” button, the corresponding date range query will be inserted into the script editor if it is initially empty.
Adds native filtering to source IMAP formats. See Help for the IMAP query syntax. Note that when you connect to a source Gmail account, you must use Google’s search syntax for Gmail instead of the IMAP syntax.
Adds native date-range filtering to source MAPI formats: Outlook profiles and PST files.
Adds settings to the “Basic search” capabilities for item filtering. These now make it possible to configure very effective filters without having to write a search query. Use a search list to filter emails based on the presence or absence of keywords. Furthermore. local mail formats can be filtered by date range – simply enter the year (yyyy), or year-month (yyyy-mm), or full date (yyyy-mm-dd) in the corresponding fields.
Adds an option to tokenize words in search queries and search lists (Project > Filters). Use this feature to define misspellings, spelling alternatives and synonyms for important words in your filter criteria. See Help for details.
A well-defined word alternatives list offers many benefits, like:
Saving time writing search queries and search lists.
Significantly shorten and simplify your filter search lists and queries.
Reducing the risk of missing responsive documents.
Aid4Mail includes several useful tokenization files. You can use these to add relevant word variations to your own tokenization file. You will find them under the Aid4Mail5\Dictionaries subfolder:
-English misspellings.tkn
-English spelling variations.tkn
-Numbers.tkn
-Roman Numerals.tkn
-US-UK spelling differences.tkn
Adds an editor for creating and editing search lists, tokenization files and Python scripts.
Adds a project option to set the default stemming dictionary for item search queries and search lists. Aid4Mail includes an English stemming dictionary, but you can download additional dictionaries for free from our website.
Adds an option to control the behavior of the {EmailAccount} template token:
-Options > Filters > “Only include emails belonging to corresponding accounts”. When checked, Aid4Mail reduces email duplicates by only including messages that match the target account (assuming the SMTP header provides sufficient information to determine the sender and actual message recipient).
Adds the ReceivedBy search operator. Use it to find messages delivered to a given email address. Aid4Mail gets this address by searching for SMTP header fields typically used to identify the actual message recipient. In some cases this address cannot be determined. Query example:
ReceivedBy:joe@aid4mail.com
Adds the {ReceivedBy} token, which corresponds to the email address of the actual recipient of the message being processed. If the address is not found, the token returns a blank value.
Adds an option to embed attachments in target PDFs.
Provides a workaround with PDF links to external attachments. Prior to this fix, links to attachments were broken when a PDF was moved along with its attachments to a different location.
Adds an option to choose whether to prioritize Sent or Received dates when setting the email’s display date. See Options > Advanced > Email display date
Adds SOCKS4, SOCKS5 and Tunnel protocols to IMAP Proxy settings.
Improves the behavior of the * and ? wildcard characters so that they also match themselves. This ensures that if you meant to use those characters as literals and didn’t realize the query is treated as a wildcard pattern, your search will nevertheless match the corresponding phrase.
Many other improvements in both the GUI and engine, as well as some bug fixes.
Updates the User Guide.
Version 5.0.11 RC3 (released: September 22, 2021)
Adds fields for Custodian information in Case screen. In Aid4Mail Investigator and Enterprise, {CustodianName} and {CustodianInitials} template tokens are available for configuring Bates stamps and target folder/file names.
Adds “Date” search operator. This is based on the email’s display date. Aid4Mail will determine its value by searching the metadata in the following order: Received date, Sent date, Saved date, Modified date, and finally Created date. This makes Date the most trustworthy date operator to use. Example: Date>=2021-09-01
Adds support for PDF creation using full available RAM on a 64-bit Windows system. To benefit from this feature, please download the following package and unzip in your Aid4Mail5 program folder:
Adds new character wildcards to match letters with or without diacritics as well as ligatures and the typographic apostrophe. For example: na<i>ve will match both naive and naïve; L<ae>titia will match both Laetitia and Lætitia; can<‘>t will match both can’t and can’t. See the “Known variation wildcards” topic in Help for syntax details.
Adds new word wildcard: <?>. Use it to match any group of characters that don’t contain any white space. For example:
gained <?> today
will match:
gained +$100,000.00 today
Changes detection of wildcard pattern in filter scripts. When creating a query without specifying a modifier (like L or W), Aid4Mail treated a search term as a wildcard only if it contained at least one “*” character. Now, the presence of any of the following characters will signify a wildcard pattern: * ? # ~
Changes proximity searching wildcards <n>, <.> and <*> to match words in forward and reverse order. Add “+” to enforce one-way forward matching:
cat<+12>dog
cat<+*>dog
cat<+.>dog
Removes the “HTML entity” wildcards. The “&” symbol is now treated as a regular character. The “#” symbol has been reassigned to match zero or one non-word character. Examples:
U#S#A# matches “U.S.A.” and “USA”
can#t matches “can’t”, “can’t” and “cant”
#123 matches “#123”, “123”, “-123” and “+123”
e#discovery matches “ediscovery” and “e-discovery”
#541##754#3010 matches “(541) 754-3010”, “541-754-3010”, “541-754 3010” and “5417543010”
4012#8888#8888#1881 matches “4012 8888 8888 1881”, “4012-8888-8888-1881” and “4012888888881881”
Renames WordList modifier to SearchList. Example: {SearchList=FileName}
Changes SearchList modifier:
When you save your search list file with the .txt extension in the “SearchLists” subfolder of your current project, you can leave out the path name and file extension from the SearchList modifier. For example, if your project is located in “C:\Users\User\Documents\Aid4Mail\Projects\Project-001\” and your search list file is saved in that location as “…\Project-001\SearchLists\Keywords.txt”, you can invoke Keywords.txt in your query like this:
{SearchList=Keywords}
If your search list file is saved in a different location, you will need to specify the full file name:
{SearchList=D:\Case-123\Keywords.txt}
Adds new search term prefixes:
“C=” to create a case sensitive search and “I=” to ignore character case. The following example will match “U.S.A.” but not “u.s.a.”:
C=U.S.A.
“T=” is similar to “W=”, but produces tokenized searches that are insensitive to diacritics, ligatures, typographic apostrophes, dots and hyphens. Example matching “U.S.A.”, “u.s.a.”, “USA” and “usa”:
T=U.S.A.
The default SearchList type is now “mixed”. You also have a choice of options you can set on the first line of your file to define the properties of your SearchList. This line must begin with an “!” character. The following options and values are available:
CASE=IGNORE or SENSITIVE
LITERAL=FALSE or TRUE
OPERATOR=AND or MIXED or OR
STEMMING={FileName}
These options will set or override corresponding settings in Aid4Mail. Example:
In all list types, regular search terms (without the modifier prefix) are automatically tokenized. You can tell Aid4Mail not to tokenize search terms by inserting the following line at the start of your list:
!LITERAL=True
Tokenization applies to punctuated terms, diacritical marks, ligatures and typographic apostrophes, quotes and double quotes. When using tokenization, you must spell words with the correct diacritical marks and full punctuation.
See the “Search lists” topic in Help for full details.
Fixes a regression causing Python initialization failure.
Fixes a regression causing the {SearchList[Mixed]=Filename} modifier to fail.
Fixes several stability and performance issues in the GUI.
Updates the User Guide.
Version 5.0.10 RC2 (released: July 13, 2021)
Adds option to process hidden Outlook folders (PST, OST and Outlook profiles). This feature is only available in Aid4Mail Investigator and Enterprise.
Improves loading of folder tree from Outlook profiles.
Updates the User Guide.
Version 5.0.9 RC1 (released: June 29, 2021)
Adds support for Outlook OST and OLM files as source formats.
Adds support for Apple Mail EMLX files as a source format.
Adds option to process PST and MSG files (source and target) without needing Outlook.
Adds option to export all emails to a single PDF.
Adds many PDF configuration options, including PDF/A file standard.
Adds fully configurable PDF header and footer using template tokens (e.g. Bates stamp).
Improves handling of certain types of Thunderbird folders as well as reported progress statistics.
Improves progress log conversion status information.
Fixes Received date issue when uploading emails to Office 365 via the IMAP protocol.
Fixes several issues related to Project management in the GUI.
Many minor fixes and improvements.
Updates the User Guide.
Version 5.0.8 Early Access (released: April 27, 2021)
Adds “Remove journaling envelope” option under Source section in the session settings. Use this feature to process the original message contained in a journaled email.
Improves reliability of email conversion to PDF files.
Improves Progress screen by adding the count for unprocessed items and folders.
Improves the substitution of illegal characters with better alternatives when creating folder and file names.
Improves log file information. On opening a folder, it includes the total items count. On closing a folder, it shows the count for skipped and unprocessed items.
Fixes access issues to folders and files located on a network drive.
Fixes issues occurring sometimes when accessing IMAP folder names that contain one of more of the following characters: * % { }
Fixes encoding issue when converting emails with UNIX line breaks to Outlook.
Fixes “Use email UID value” feature (available through the Target “File name” setting). In some cases, it created negative values when all values should be positive.
Many minor fixes and improvements.
Updates the User Guide.
Version 5.0.7 Early Access (released: March 19, 2021)
Adds option in the GUI to export a folder structure to a text file.
Adds a new configuration field for archival and database formats. Use it to extract just the file name (without the path) of your source:
Source.FileName
or
X-Source-FileName
Fixes an issue reading source Outlook profiles and PST files. If a system folder like Inbox or Deleted Items contained subfolders, earlier versions of Aid4Mail 5 failed to process them.
Fixes an issue with incremental processing of Exchange accounts through MAPI and the Microsoft Graph API.
Many minor improvements and bug fixes in the GUI.
Version 5.0.6 Early Access (released: February 22, 2021)
Adds Maildir format as a source option.
Improves rendering the folder structure of Thunderbird mailboxes.
Reduces loss of emails when processing corrupted source Thunderbird and mbox files.
Fixes issue accessing Thunderbird mailboxes while Thunderbird is running.
Fixes issue processing IMAP accounts in Thunderbird when “Message Store Type for new accounts” is set to maildir. If you have an IMAP account stored in the maildir format, you should choose the EML source format in Aid4Mail to process those emails.
Fixes issue with some MIME encodings of extended characters when using 64-bit Console.
Fixes issue in filter script syntax when using the “wordlist” option.
Several fixes and improvements to the GUI.
Version 5.0.5 Early Access (released: January 26, 2021)
Adds Google Vault (zipped MBOX files) and Proofpoint (ZIP archives) as source formats. Aid4Mail processes these file formats without the need to unzip contents. These new formats are only available in Aid4Mail Enterprise.
Adds Bates configuration options: number of digits, prefix and suffix, and counter scope (Session, Project, Global). These options are only available in Aid4Mail Investigator and Enterprise.
Adds option to run license in a VM or virtual environment like Citrix XenApp. Please contact us for details and pricing.
Adds “Recent projects” menu and improves “Open project” command.
Adds “Content configuration” and “Email header configuration” editor (available through Edit button above corresponding field).
Adds “Case” fields to Aid4Mail Converter edition.
Improves Project Case fields. Values from most of these fields are now available for use in custom header configurations and free-form templates.
Adds -cli switch to the Aid4Mail Enterprise Console command-line. Use it when you want to run the console without any session configuration file (.ini). Example (long line might wrap):
Improves source and target format names shown in drop-down lists.
Fixes the IMAP error “[NONEXISTENT] Invalid folder” when accessing a Gmail Inbox folder that has its name localized in a different language.
Fixes issue with “Limit PST file size” option. The size value was incorrectly interpreted.
Fixes issue with the conversion of some dates from local to UTC.
Fixes issue with some O365 native searches failing. Please note that earlier versions of our Help file incorrectly listed AQS as one of the query languages. The correct language is KQL. Use the following link to review the syntax: https://www.aid4mail.com/redir/kql
Many minor improvements.
Updates the User Guide.
Visit our knowledge-base for “how-to” articles on the newly supported archival formats:
Version 5.0.4 Early Access (released: December 17, 2020)
Adds Mimecast zipped EML SJF files (source format). Archives are processed without the need to unzip contents. This feature is only available in Aid4Mail Enterprise.
Adds Google Takeout (source format). Original Gmail folder structure can be fully restored. This feature is NOT available in the Light editions of Aid4Mail.
Adds SeaMonkey (source and target).
Adds separate fields to specify alternative folders for Cache and Temp files.
Renames following Template token for better clarity:
Adds an option to easily create a batch of sessions based on wildcard criteria in the source Location field for file formats. This feature is particularly useful if you have a source folder full of PST or Mimecast files. See Help file for details.
Adds a Zoom option to increase the size of text and components in the user interface. Please note that this setting is currently not retained when you close Aid4Mail. This will be improved in an upcoming update.
Adds a command-line to the consoles (a4m-32.exe and a4m-64.exe) for Aid4Mail Enterprise. See Help file for details.
Improves the Project and Options screens.
Updates the User Guide.
Fixes a CSS display issue in HTML and PDF files created from Outlook emails.
Many minor improvements and bug fixes.
Version 5.0.3 Early Access (released: November 30, 2020)
Adds the following target formats: Plain text (UTF-8), CSV (Comma-Separated Values), TSV (Tab-Separated Values), XML, HTML, and PDF. Note that, unlike the HTML/MHT format offered in Aid4Mail 4, the new HTML format is compatible with all popular browsers.
The HTML format provides an option to create an index file. This index shows a table that lists all the target emails and an email viewer. You can sort table columns by clicking on their header, limit viewing to a specific folder, and filter table rows based on your search criteria. Note that this index file won’t render correctly in Firefox. Other popular browsers like Google Chrome, Microsoft Edge and Opera work fine. Internet Explorer and Safari, however, only work reliably if the emails are stored in the same folder as the index.html file; this is easily done by exporting emails with the Flat folder structure.
Adds new Template token {EmailAccount} that can be used to rebuild email accounts based on email addresses extracted from the From, To, Cc, Bcc header fields. Available in Aid4Mail Investigator and Enterprise. See the Help for more details on this powerful new feature.
Adds automatic removal of binary duplicates sharing the same name in the target folder. This feature applies to target EML, Plain text, HTML, PDF and extracted attachments. Prior to this new behavior, each new conflicting target file name was saved with an incremental number (e.g. Duplicate[1].eml) whether is was an exact copy or not. Now, only conflicting files that have different content are renamed and saved with an incremental number.
Multi-session projects are now compatible with all editions. The key difference is that Aid4Mail Converter and “Light” editions can only run one session at a time (instead of concurrently).
Significantly improves the resilience of IMAP account processing.
Renames following Template tokens for better clarity:
Fixes incorrect conversion of IMAP flags to regular email status flags.
Fixes incorrect rendering of Thunderbird mailbox folder tree.
Fixes conversion to Thunderbird mbox by using the mboxrd format.
Fixes a Unicode display issue in the top part of the progress log where filtered folder names are listed.
Many minor improvements and bug fixes.
Version 5.0.2 Early Access (released: August 27, 2020)
A new option, Limit PST file size, has been added to the target settings when PST is the target format. This enables you to export mail to multiple PST files, each with a fixed file size, instead of one larger PST file. For example, if you have 17 GB of mail and Limit PST file size is set to 5 GB, you will end up with four target PST files: The first three will each contain 5 GB of mail with the fourth containing the remaining 2 GB.
Aid4Mail Remote Authenticator can now authenticate any IMAP account, encrypting the account password and providing an optional expiry date for the authentication file. This is in addition to the existing capability of authenticating Google and Microsoft accounts through OAuth2. This means you can now request secure, temporary access to any cloud-based email account from a customer or suspect. It will use the most secure option available without the customer having to share full login credentials or have a copy of Aid4Mail.
The inequality operator <> can now be used in search operators instead of having to negate the whole search term with the Boolean NOT operator. For example, to exclude the inbox from your search, you can now write Type<>Inbox instead of NOT Type:Inbox. This means that the following search terms are identical:
Type<>Inbox
NOT Type:Inbox
NOT Type=Inbox
-Type:Inbox
-Type=Inbox
Turn on/off multiple sessions has been renamed Show/Hide session list and its keyboard shortcut changed from Ctrl+M to Ctrl+L.
Significant additions to the User Guide.
Version 5.0.1 Early Access (released: July 2, 2020)
For over 25 years we have been developing award-winning tools and productivity software. We also have more than 20 years of expertise in the field of email processing and analysis.
Our clients include Fortune 500 companies, government agencies, law firms, universities, and professionals specializing in e-discovery and forensics from around the world.