Dell EMC SourceOne

NOTE: Transvault Migrator v10.3 – Hardware, Software, and Access Requirements

This guide explains how to configure and perform data migrations from EMC SourceOne using Transvault Migrator. It includes requirements, setup instructions, and troubleshooting tips for Direct and API-based migrations.


Overview of EMC SourceOne (ES1)

EMC SourceOne is an archiving platform for email, file, and SharePoint data. It supports:

  • Exchange, Domino, SMTP email archiving
  • SharePoint and File System archiving (optional modules)
  • Legacy support for EmailXtender 4.8 SP1 archives

Archived content is stored in the Native Archive, with metadata stored in SQL or Oracle databases.


Archiving Workflow Summary

  1. Collection – Identify data types (emails, PSTs, NSF files).
  2. Classification – Sort by departments using AD/LDAP.
  3. Processing – Extract metadata, de-duplicate content.
  4. Archiving – Store data in containers and archive folders, using Centera, SAN, or NAS.

EMC SourceOne Components

  • Console: MMC-based tool for managing jobs and activities.
  • Web Services: Enable OWA, DWA, and web-based search.
  • Client Apps: Microsoft Outlook and IBM Lotus Notes.
  • Client Services: OWA and Domino Web Access.

Migration Setup Options

Transvault supports two migration types:

Direct Connector

  • Recommended for performance.
  • Requires:
    • 64-bit Outlook & Migrator (Exchange)
    • db_datareader access to SourceOne DB
    • Read access to Archive Folders (.emx files)
    • Microsoft Visual C++ 2010 Redistributable

⚠️ Not supported if using Oracle DB or ECS storage.


API Connector

  • Required for Notes migrations and when Direct is not viable.
  • Requires:
    • 32-bit Outlook & Migrator
    • SourceOne Worker Services (same version as on SourceOne server)
    • db_datareader access to SourceOne DB
    • Access to Archive Folders for orphaned gathering
    • Microsoft Visual C++ 2010 Redistributable

Connecting Transvault to SourceOne

In Transvault:

  1. Open Connection Properties
  2. Select source type (Direct/API for Exchange/Notes)
  3. Configure disk or Centera storage:
    1. For Centera: enter IP/port and validate .PEA file
  4. Validate paths and test connections

Gathering Data

Supported Types

  • Mailbox (Users): Gathers per user mailbox data
  • Journal: Gathers per container, useful for compliance

Optional filters:

  • Date ranges
  • SMTP address lists (CSV)
  • Orphaned messages (assigned to a special "Orphaned" mailbox)

📌 Tip: Use separate connections for Mailbox vs. Journal gathering.


Gathering Methods

Mailbox (Users)

  • Duplicates messages per recipient
  • Option to include all recipients as owners

Journal (Single Instance)

  • Messages gathered once per container
  • Can group by archive folder or month
  • Option to rehydrate with Compliance Time Machine (CTM)

Common Issues & Fixes

Gathering Hangs or Is Slow?

  • Use Mailbox-only gathering first, then message sub-task
  • Enable OneTouch gathering for parallel migration

Missing Folder Names After Migration?

  • Run ‘Owner, Folder & Shortcut Synchronisation’ before migration
  • Sync retrieves correct folder mapping based on user mailbox shortcuts

API Gatherer Hangs?

  • Set EsoOutOfProcessRetrieving = False in configuration

Compliance Time Machine (CTM)

Rehydrates journaled messages for individual recipients to:

  • Comply with Office 365 licensing (no shared mailboxes)
  • Perform targeted data extraction (e.g., demergers)

Supports multi-step migrations: Source → PST/EML → Target


SQL Queries for Stats & Indexes

Improve Performance

Add indexes to SourceOne DB for faster gathering:

CREATE NONCLUSTERED INDEX IX_TV_PERF_ON_ROUTE ON dbo.Route (EmailId, MessageID, FolderId, RouteType) INCLUDE (RouteMask, PartitionId);

Estimate Volume per Use

SELECT ea.EmailAddress, COUNT(r.MessageId) AS MsgCount, 
CAST(SUM(CAST(fm.CompressedMsgSize AS BIGINT))/1024/1024/1024 AS DECIMAL(10,2)) AS 'SizeGB'
FROM Route r
JOIN FolderMessage fm ON fm.MessageID = r.MessageID
JOIN EmailAddress ea ON r.EmailId = ea.EmailId
GROUP BY ea.EmailAddress;

📨 Retrieving Message Samples

To locate a message by subject and date in SourceOne:

SELECT * FROM Message WHERE MsgSubject LIKE '%Subject%' AND MsgDate BETWEEN 'YYYY-MM-DD' AND 'YYYY-MM-DD';

To find it in Transvault:

SELECT TOP 1 * FROM ESSMIG_ESO_MESSAGE WHERE ESO_MESSAGE_ID = <MessageID>;

 


Common Configuration Keys

Key Stage Description
EsoOutOfProcessRetrieving Gathering Disable to avoid gatherer hang
EsoUseNonPagedGathering Gathering Speeds up large container environments
EsoOutOfProcessIngestion Migration Use internal ingestion to avoid external tool crashes
EsoGatherSmtpMailboxes Gathering Include SMTP users alongside EX-prefixed
EnableEsoIngestionToolTracing Migration Enables verbose logging
EsoAddAttachmentsExtension Migration Enables custom file extension support
EsoCheckDateTime Migration Sets default datetime for bad source data

Comments

Powered by Zendesk