What Does It Take to Implement a Data Migration? Here’s How System1 Did It

When David Ersek reflects on the two-year migration he and his fellow software engineers at System1 recently completed, he brings himself back to a moment in early 2019 when many of the engineers on his team were gathered around a computer, waiting for someone to click a button.

At the time, the engineers at the Los Angeles adtech company had embarked on a big project — consolidating terabytes of data across several legacy data warehouses into Snowflake. Ersek and his team had just completed the first and most challenging warehouse of all, a database migration deemed so important that one of Ersek’s coworkers likened it to “replacing the parts of the airplane while it was still in the air.”

Continue reading