Home > ETL Best Practices > To Stage or Not to Stage

To Stage or Not to Stage

Staging means writing to disk and, staging data at the four major checkpoints of the ETL data flow is recommend.

ETL architect needs to make the decision to store data in a physical staging area versus processing it in memory.

Ultimately, we need to achieve both of these conflicting objectives:

  • Getting the data from the originating source to the ultimate target as fast as possible
  • Having the ability to recover from failure without restarting from the beginning of the process

Every data warehouse, regardless of its architecture or environment, includes a staging area in some form or another. Consider the following reasons for staging data:

image

image

image

image

Categories: ETL Best Practices
  1. No comments yet.
  1. No trackbacks yet.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

w

Connecting to %s

%d bloggers like this: