Introduction to Data Pipelines: Solutions For Complex Data Infrastructure Challenges

Popular posts from this blog

How To Create Data Lake In Azure

Image
How to create Azure Data Lake Storage Gen2 destinations Three simple steps show you how to create Azure Data Lake Storage Gen2 data destinations for insights and analytics Configuring an Azure Data Lake destination is quick and easy. In this post, we walk you through the steps to get a data lake configured in your Azure account. This guide assumes you have an Azure account and understand why a data lake is a good fit for your use case. If you ask yourself, “ what is a data lake ?” or struggling with a “ data lake vs. data warehouse ” question, check out those links. Ready to get started? Let’s go… Three Steps To Setting Up Azure Three primary steps align to specific resources within Azure; A Gen 2 storage account, a data lake container, and access credentials within Azure. These three elements are needed by other systems to establish a connection to your Azure Data Lake destination securely: Storage Account Name Container Name Connection strin...
Read more

Exploring Amazon Vendor Central Direct Fulfillment

Image
Amazon Vendor Central Direct Fulfillment is an effective drop ship program that allows vendors to ship products directly to customers on Amazon's behalf. This guide will provide an in-depth overview of managing orders in Amazon Vendor Central , covering everything from onboarding to effectively handling bulk shipments. Whether you’re just getting started or looking to refine your processes, this comprehensive post will guide you through the core features of Direct Fulfillment. Key Differences in Managing Direct Fulfillment Orders One significant difference between direct fulfillment and traditional fulfillment by Amazon (FBA) is the prep work for each ASIN. Unlike FBA, where products are sent to Amazon’s fulfillment centers in bulk, Direct Fulfillment requires individual packing, and vendors need to apply specific labels to each package. Additionally, Direct Fulfillment requires confirming the order right after the carrier picks it up, ensuring Amazon and the customer ...
Read more

Snowflake CREATE Warehouse

Image
How to script a consistent and automated “create warehouse snowflake” environment Prior to undertaking data loading, Snowflake should be configured with some baselines. In this post, we undertake some “lite” Snowflake data warehouse training using the WORKSHEET feature. This is an easy-to-understand starting point in anyone’s journey to better learn Snowflake data warehouse setup and operations. If you are wondering why use Snowflake data warehouse , check out that link for the benefits of the platform. For now, we are assuming you are sold and are ready to give it a try. Let's get started! Step 1: Create a Snowflake account If you do not already have an account, Snowflake offers a free trial . Sign up for an account. If you have an account already, log into it. Step 2: Locate the WORKSHEET Feature In Your Snowflake Account If you log in via a web browser, click the WORKSHEET icon at the top of the page. Important: Ensure that the role for the session...
Read more