Skip to main content

88TB, Zero Downtime: Enterprise File Platform Migration in Two Months

Whil Cayangyang
Author
Whil Cayangyang
Turning bare-metal servers and Kubernetes clusters into resilient, automated, zero-trust infrastructure — where every layer is intentional, observable, and owned.

Citrix ShareFile StorageZone Migration to Dropbox Business (2025)
#

An end-to-end server-side migration of 88TB from a legacy Citrix ShareFile StorageZone on AWS to Dropbox Business — executed under a strict two-month timeline with zero service interruption and zero data loss.
AWS EC2 + S3 Source
PowerShell Automation
Dropbox API Integration
88TB Migrated
Governance-First Cutover
Objective: Lead the full server and infrastructure migration of 88TB from AWS-hosted Citrix ShareFile StorageZone to Dropbox Business — with minimal disruption, strong integrity validation, and production-safe execution throughout.

Source Environment and Constraints
#

The legacy environment being migrated was not a simple file share. It was an active enterprise storage platform under continuous production load.

Legacy architecture:

  • Windows Server on AWS EC2
  • Backend storage in Amazon S3
  • Citrix ShareFile StorageZone controller managing user access
  • Active production traffic throughout the migration window

Critical constraints that shaped every design decision:

  • 88TB of data across mixed file sizes and complex directory structures
  • Continuous user access — no maintenance windows or service blackouts permitted
  • Strict data integrity requirements with zero tolerance for loss or corruption
  • Two-month delivery deadline with no timeline flexibility

This required an engineered migration pipeline — not a basic file copy approach.


Migration Architecture and Strategy
#

Server-Side Controlled Execution

The migration ran from a dedicated AWS Windows EC2 host co-located with the source data. This was a deliberate architectural choice, not a default.

Benefits of running server-side:

  • Proximity to S3 source data eliminated egress latency and variability
  • Centralized control over bandwidth utilization and transfer pacing
  • Consolidated logging and operational monitoring in one place
  • Avoided client-side transfer variability that would have introduced unpredictability at scale

This approach gave the migration infrastructure-level predictability and control that no client-side tool could match.

PowerShell Migration Engine

A structured, purpose-built PowerShell framework was engineered from the ground up to handle the scale, duration, and complexity of this migration.

Design requirements:

  • Modular — components independently testable and replaceable
  • Retry-capable — transient failures handled automatically without data loss
  • Log-driven — structured output for real-time monitoring and post-run analysis
  • API-integrated — direct Dropbox API interaction for deterministic transfer behavior
  • Batch-optimized — parallel processing tuned for throughput within API and resource limits

Core capabilities:

  • Recursive directory parsing and structure replication
  • Parallel transfer batching with configurable concurrency
  • Metadata validation before and after transfer
  • Checkpoint tracking for progress persistence
  • Resume capability — interrupted runs restart exactly where they stopped
  • Structured logging for every operation, success, and failure

This framework ran continuously for two months with minimal manual intervention, handling tens of millions of file operations across 88TB of data.

Dropbox API Pipeline

Rather than relying on sync clients or desktop tools, the migration was implemented as a direct Dropbox API integration — treating the destination as a data pipeline endpoint.

API pipeline capabilities:

  • Secure authentication through token management and refresh handling
  • Programmatic folder hierarchy creation matching the source structure
  • File upload via controlled API workflows with response validation
  • Return code capture for integrity confirmation on every transfer
  • Structured error handling with automatic retry on transient failures

Why API-driven matters at this scale:

  • Deterministic transfer behavior — no sync client guessing or conflict resolution
  • Stronger error visibility — every failure captured, categorized, and logged
  • Controlled retry logic — failed transfers retried intelligently without duplicating successful ones
  • Scalable batch processing — throughput tuned to stay within API rate limits while maximizing speed

The migration functioned as a managed data pipeline, not a manual transfer task.

Data Validation and Throughput Control

At 88TB, integrity validation was not optional. Every safeguard was designed to catch failures before they became permanent data loss.

Integrity safeguards:

  • Post-transfer file size validation against source records
  • API-confirmed transfer success checks on every upload
  • Structured failure logging with categorized error types
  • Automated retries for all transient and recoverable failures
  • Transfer state tracking enabling full resumability from any point

Throughput was continuously tuned to balance competing constraints:

  • Maximizing transfer speed within API rate limits
  • Maintaining EC2 CPU, memory, and disk I/O within stable operating ranges
  • Sustaining network throughput without destabilizing co-located workloads
  • Preventing S3 read throttling under sustained high-volume access

Result: 88TB transferred with zero critical data loss and no integrity failures reported.


AWS Infrastructure Management
#

Running a sustained 88TB migration on AWS required careful infrastructure oversight throughout the two-month window:

  • Monitoring EC2 CPU, memory, and disk I/O to detect degradation early
  • Sustaining adequate network throughput without impacting other workloads
  • Managing S3 read performance under continuous high-volume access
  • Enforcing IAM least-privilege access scoped to migration operations only
  • Tracking and managing cost impact of sustained data transfer at this scale

The migration was completed without destabilizing any other AWS workloads running concurrently.


Security and Compliance Hardening
#

Security controls in the Dropbox Business environment were configured and validated before user cutover — not after.

Controls established prior to onboarding:

  • Role-based access control with appropriate permission mapping
  • Folder-level permission alignment with the source access model
  • Administrative governance policies and sharing restrictions
  • Audit log configuration for ongoing access visibility
  • Data access restrictions aligned with organizational policy

This ensured that users were onboarded to a platform that was already secure and governed — not one being hardened in parallel with active user adoption.


Operational Transition and Knowledge Transfer
#

Project delivery included long-term operational enablement, not just migration completion:

  • Detailed migration documentation covering architecture, execution, and decisions
  • Execution workflow diagrams for process understanding and future reference
  • Failure handling procedures for common error scenarios
  • Structured operational handover to internal IT and support teams
  • User onboarding sessions to ensure smooth adoption of the new platform

The goal was durable platform stability — not a migration that ended at cutover and left a knowledge vacuum.


Strategic Impact
#

Capability AreaDelivery Value
Large-Scale Data MovementEngineered 88TB migration under production load within a two-month deadline
Automation ArchitecturePurpose-built PowerShell framework with checkpointing, retry logic, and resumability
API EngineeringDeterministic Dropbox API pipeline with end-to-end validation and structured error handling
Risk ManagementContinuous user access maintained throughout with zero data integrity failures
Governance-First AdoptionAccess controls, audit logging, and policies configured before any user cutover

Running from the infrastructure layer provided control, predictability, auditability, and measurable validation outcomes that no off-the-shelf migration tool could deliver at this scale.


Closing Summary
#

This was not a lift-and-shift migration. It was a structured transformation of an enterprise storage platform under active production load — delivered through purpose-built automation, direct API integration, and disciplined governance at every stage.

The result: 88TB migrated, users unaffected, data intact, and a new platform that was secure and operational from day one.