How To Do CSV File Validation and Schema Generation

Popular posts from this blog

How To Create Data Lake In Azure

Image
How to create Azure Data Lake Storage Gen2 destinations Three simple steps show you how to create Azure Data Lake Storage Gen2 data destinations for insights and analytics Configuring an Azure Data Lake destination is quick and easy. In this post, we walk you through the steps to get a data lake configured in your Azure account. This guide assumes you have an Azure account and understand why a data lake is a good fit for your use case. If you ask yourself, “ what is a data lake ?” or struggling with a “ data lake vs. data warehouse ” question, check out those links. Ready to get started? Let’s go… Three Steps To Setting Up Azure Three primary steps align to specific resources within Azure; A Gen 2 storage account, a data lake container, and access credentials within Azure. These three elements are needed by other systems to establish a connection to your Azure Data Lake destination securely: Storage Account Name Container Name Connection strin...
Read more

Snowflake CREATE Warehouse

Image
How to script a consistent and automated “create warehouse snowflake” environment Prior to undertaking data loading, Snowflake should be configured with some baselines. In this post, we undertake some “lite” Snowflake data warehouse training using the WORKSHEET feature. This is an easy-to-understand starting point in anyone’s journey to better learn Snowflake data warehouse setup and operations. If you are wondering why use Snowflake data warehouse , check out that link for the benefits of the platform. For now, we are assuming you are sold and are ready to give it a try. Let's get started! Step 1: Create a Snowflake account If you do not already have an account, Snowflake offers a free trial . Sign up for an account. If you have an account already, log into it. Step 2: Locate the WORKSHEET Feature In Your Snowflake Account If you log in via a web browser, click the WORKSHEET icon at the top of the page. Important: Ensure that the role for the session...
Read more

Why Timeszones Cause Amazon Seller Central Confusion

Image
Timezones are a confusing topic when it comes to a global marketplace like Amazon. For example, a customer in New York places an order on March 11, 2021, at 1 AM (EST), but it is March 10, 2021, at 10 PM (PST) in Seattle. What when did the order occur? March 11th or March 10th? Another wrinkle is that Amazon defaults to using a Coordinated Universal Time (UTC) standard in its systems. In our example above, the timestamp of the order would be March 11th, 2021, at 8 AM! Seller Central User Interface So, where does a chunk of the confusion arise? Amazon Seller Central. The Seller Central interface displays information in the Pacific timezone (PST). However, Amazon stores information in its systems using UTC. Per Amazon: “Amazon Marketplace Web Service (Amazon MWS) formats date- and time-related data similar to the RFC 3339 standard, which defines a subset profile of ISO 8601 for use in Internet protocols and standards. This section will clarify just how you should fo...
Read more