Data Lakes Daily

Different partitioning strategies within BigQuery have various pros and cons. A typical strategy for partitioning is by DAY and partitioned on the field _PARTITIONTIME. For context, _PARTITIONTIME is a pseudo column that contains the UTC day that the partitioned data was loaded. In many cases, this is a good default. However, there may be cases where you want to optimize a table beyond Google defaults. For example, if you have a high volume of loads for a common data source, using a different strategy can lower query costs. Be aware that some partitioning strategies, while improving costs, may increase the complexity of your queries. There is no universal approach for all use cases. In this post, we detail how to migrate from one type of partitioned table to another. Before proceeding, please review the documentation from Google on the topic: https://cloud.google.com/bigquery/docs/partitioned-tables Convert Partitioning On An Existing BigQuery Table In our example, ...

Timezones are a confusing topic when it comes to a global marketplace like Amazon. For example, a customer in New York places an order on March 11, 2021, at 1 AM (EST), but it is March 10, 2021, at 10 PM (PST) in Seattle. What when did the order occur? March 11th or March 10th? Another wrinkle is that Amazon defaults to using a Coordinated Universal Time (UTC) standard in its systems. In our example above, the timestamp of the order would be March 11th, 2021, at 8 AM! Seller Central User Interface So, where does a chunk of the confusion arise? Amazon Seller Central. The Seller Central interface displays information in the Pacific timezone (PST). However, Amazon stores information in its systems using UTC. Per Amazon: “Amazon Marketplace Web Service (Amazon MWS) formats date- and time-related data similar to the RFC 3339 standard, which defines a subset profile of ISO 8601 for use in Internet protocols and standards. This section will clarify just how you should fo...

How to script a consistent and automated “create warehouse snowflake” environment Prior to undertaking data loading, Snowflake should be configured with some baselines. In this post, we undertake some “lite” Snowflake data warehouse training using the WORKSHEET feature. This is an easy-to-understand starting point in anyone’s journey to better learn Snowflake data warehouse setup and operations. If you are wondering why use Snowflake data warehouse , check out that link for the benefits of the platform. For now, we are assuming you are sold and are ready to give it a try. Let's get started! Step 1: Create a Snowflake account If you do not already have an account, Snowflake offers a free trial . Sign up for an account. If you have an account already, log into it. Step 2: Locate the WORKSHEET Feature In Your Snowflake Account If you log in via a web browser, click the WORKSHEET icon at the top of the page. Important: Ensure that the role for the session...

Move e-commerce operations and paid media investments into overdrive with insights-driven strategies fueled by data A holistic advertising strategy should align with a given platform, competitive landscape, market, search and display ad type. The Amazon Advertising platform offers Sponsored Products, Sponsored Brands, and Sponsored Display for both Seller Central and Vendor Central. These three complementary products allow you to get video ads, search ads, in front of potential customers in a very competitive market. According to eMarketer, almost 50% of product searches start on Amazon: Looking outside of Amazon, social media platforms like Facebook, Instagram, and others offer ads that communicate deals, offer enticing high-quality images, the ability for a sponsored blog post, and many others options. All of these tools, types of ads, and platforms comprise a holistic strategy meant to drive efficient and effective sales growth within Amazon. Digging Into T...

Building your eCommerce empire by unlocking Amazon Sponsored Ads performance data How does a seller or vendor connect with shoppers on Amazon searching for products and brands they offer? Advertising on Amazon Marketplace. Amazon Sponsored Advertising is the fast, cost-effective way to reach shoppers online. Amazon offers a wide selection of products in many categories and departments and now gives you an even easier way to reach shoppers based on their expressed interests. Through advertising, you’ll show your message directly to potential customers in their search results. The Amazon Sponsored Ads audience targeting tools to help you reach the right customers at the right time. Sponsored Ads offers customized search, display, and video advertising, options so you can tailor your campaigns to target the consumers most likely to buy your products. What Is Sponsored Advertising? Amazon Sponsored Ads allows you to execute a media strategy that lets you reach millions of Amazon...

Unlocking Amazon Seller & Vendor Central advertising automation for efficiency, scale, and growth Are you stuck with a web-based Ads UI, tired of manually downloading and managing 100s of spreadsheets across your clients? Is this making campaign reporting time-consuming, expensive, and error-prone? If you answered “yes!”, then tapping into the Amazon Advertising API is a must. The drive for Amazon Advertising optimization Manual advertising data wrangling of report downloads has a consequence of increasing costs and risky errors. As the number of Advertiser accounts expand, those manual processes become expensive and fragile. A day missed downloading, a file improperly handled, or a folder of spreadsheet exports deleted can toss even the most detail oriented team into chaos. Enter automation with the Amazon Advertising API. The API provides programmatic access to the Ads platform. The API offers new efficiency levels by automating operations for both sellers and ...

Why FBM and FBA seller understanding of financial performance is critical to driving Amazon seller growth and profitability The Finances API enables Amazon third-party sellers to obtain financial information for their seller central accounts. Sellers can get financial events for a given order or financial data without waiting until a statement period closes. Third party sellers typically use the data to; gain insights into inventory forecasting create context on how your sales history aligns with profit goals optimization inventory management improving customer service shortening lead times This is an improvement over waiting for bi-weekly Amazon generated Settlement Reports . As a result, the Finance API gives sellers increased access, velocity, and transparency for mission-critical financial data. What finance data is available to Amazon Third-Party Sellers, Agencies, or FBA acquirers? So you want data from the Finances API? It is important to not...

Sailthru delivers personalized customers’ experiences across email, web, and mobile. Data resident in your Sailthru account contains rich insights into interactions users are having with these customized experiences. Your Sailthru data is part of a puzzle that allows you the ability to understand the customer journey. The better you can understand this journey, the greater your opportunities to unlock insights to deepen customer engagement. What is Sailthru Connect? The Sailthru Connect service provides the data needed to fuel the insights backbone to the customer journey. If you are a Sailthru customer looking for data insights automation, Sailthru Connect is key to accomplishing that goal. The Sailthru Connect product has two components: Data Exporter  — JSON-based daily export that provides aggregated data about email events and profile information. Event Stream  — A CSV-formatted export, sent hourly, provides granular event data across critical message categories ...

Amazon Vendor Central — Selling Partner API Amazon released a new Vendor Central API within the Selling Partner API (SP-API). Sellers have had API access under the MWS umbrella for years. Amazon released a new version of the Amazon Marketplace Web Service (MWS) called the Selling Partner API (SP-API). However, vendors have had a more complex journey for programmatic access to Amazon. Unlike the old MWS system, the new API now supports Amazon Vendors, the same as Sellers!😊 API: Vendor Central vs. Seller Central Vendors and Sellers are two distinct models within the Amazon ecosystem. Seller Central accounts are generally open to all merchants to use the platform to sell directly to customers. Those participating in this market are referred to as 3rd party sellers or “3P”. Unlike Amazon sellers (3P), access to Amazon Vendor Central is an invite only program. Without an invitation from Amazon, you can not participate in Vendor Central. Amazon Vendors have ...

Code-free Amazon Seller Central API for products, competitors, and fees data Amazon Sellers are looking for advanced reporting and analysis for Amazon product research, Amazon sales rank, or competitive advantage. It is not uncommon for sellers wanting to see how sales rankings change over time based on Amazon PPC spend or competitive pressure their listings. Unfortunately, the data and reporting interfaces provided by many 3rd-party tools are not enough. While these tools provide basic, top-level performance metrics, the built-in reporting can be complicated, underwhelming, or missing data. Go faster than basic Amazon Seller Central monthly reports Amazon Sellers attempt to graduate from these 3rd-party tools by downloading daily spreadsheets for use within Excel or Google Sheets. Unfortunately, the daily downloads are a manual task and do not provide comprehensive coverage of critical seller data. Also, data quality suffers due to any manual manipulation and proce...

Remote Fulfillment with FBA creates new sales opportunities to Canada and Mexico for US sellers Are you currently a seller in the US, but have hesitated to expand to Canada and Mexico, given the complexity involved? Amazon has simplified cross-border selling with a new Remote Fulfillment by Amazon (FBA) program. The new Remote Fulfillment with FBA program removes barriers and complexity, allowing you to fulfill orders in Canada and Mexico with your US FBA inventory. The new remote fulfillment solution saves you the extra work and hassle of managing multi-country inventory, cross-border logistics, and import duties. After you create offers in Canada and Mexico, Amazon will also make them Prime-eligible and fulfill orders to customers in those countries. How does the FBA program work? Amazon has made the process straightforward for US sellers; Any offer you create on Amazon.ca, or Amazon.com.mx automatically pulls from your US inventory, unless the item is...

Amazon recently released a collection of updates for its Sponsored Brands Video and Amazon Attribution. The updates will continue to create new opportunities to streamline operations and deliver automation for insights efforts. Sponsored Brands video available in the US, United Kingdom, and Germany Amazon has released Sponsored Brands video to vendors and sellers registered in the Amazon Brand Registry in the United States, United Kingdom, and Germany. Sponsored Brands video allows you to upload video creative, create and manage video campaigns, access reporting, stand out on desktop and mobile shopping pages, and help customers discover your brand and products as they shop on Amazon. Ads are keyword targeted, cost-per-click, and link customers directly to the product detail page where they can learn more and purchase. Spend less time on manual operations, and more time focusing on what matters — reviewing insights, identifying trends, and creating optimization strat...

How to create Azure Data Lake Storage Gen2 destinations Three simple steps show you how to create Azure Data Lake Storage Gen2 data destinations for insights and analytics Configuring an Azure Data Lake destination is quick and easy. In this post, we walk you through the steps to get a data lake configured in your Azure account. This guide assumes you have an Azure account and understand why a data lake is a good fit for your use case. If you ask yourself, “ what is a data lake ?” or struggling with a “ data lake vs. data warehouse ” question, check out those links. Ready to get started? Let’s go… Three Steps To Setting Up Azure Three primary steps align to specific resources within Azure; A Gen 2 storage account, a data lake container, and access credentials within Azure. These three elements are needed by other systems to establish a connection to your Azure Data Lake destination securely: Storage Account Name Container Name Connection strin...