Maja Ferle

Snowpark for Python First Impressions

28 June, 202222 April, 2023 by Maja FerleNo Comments

Just back from Snowflake Summit 2022 held in Las Vegas. There were so many new announcements about upcoming features in Snowflake, it's hard to keep track. One topic that I'm most excited about is Snowpark for Python. As soon as I got back from Las Vegas, I started digging into the details because I had a use case waiting to be tested. I described my approach and summarized my first impressions in a blog post on Medium....

What the Snowflake Community Means to Me—and My Career

10 May, 2022 by Maja FerleNo Comments

I was recently interviewed for the Snowflake blog where I discussed the benefits of being an active member of the Snowflake Community, how the community has helped me grow into my role as a Snowflake DataSuperhero and how it can be of use to anyone looking for hands-on Snowflake resources. With respect to the usefulness of the Snowflake community I was quoted as saying “Snowflake offers a lot of great technical documentation, but it’s useful that there’s so much material out there from the Snowflake community around personal case studies and how other people are implementing specific features.” Read the full article here....

Snowflake and Data Mesh

24 April, 202210 May, 2022 by Maja FerleNo Comments

More than ever, the ability to use data for decision-making is critical to company success. Despite this knowledge, companies are still not fully empowering their employees with easy access to the data they need. According to Zhamak Dehghani, the founder of Data Mesh, we must start thinking outside of the box because the traditional approach to managing and collecting data is not sufficient any longer. For decades, there has been a divide between operational and analytical data with ETL as the intermediary process to get data from operational systems into the analytical data warehouse. ETL, which has always been primarily in the hands of IT developers, is perceived as a bottleneck to delivering timely analytical data. Furthermore, dimensional data models are not well suited for machine learning models that have become essential. To overcome this, the data lake emerged around 2010. The idea of the data lake is to store vast amounts of semi-structured data in object stores to allow various consumers...

Snowflake account administration best practices

24 February, 202226 February, 2022 by Maja FerleNo Comments

Although it is well documented, it shouldn’t hurt to review a few of the basic Snowflake account administration best practices, as I often see in practice that they are not followed consistently. In my experience, there are so many IT administrators that are pressed for time that they don’t bother to create security roles and policies to be followed. To make it quick, they just use the ACCOUNTADMIN role on Snowflake (or an equivalent all powerful admin role on other systems) because it allows them to do anything and everything without having to think about security best practices. Using an admin role for day-to-day tasks is a bad idea Consider this true story. The administrator tries some functionality, and it works. The user (who doesn’t have admin privileges) tries, and it’s not working. The administrator doesn’t believe the user when they report that the functionality is not working, dismissing them as incompetent. This goes back and forth a few times, until someone gives...

I’m a Snowflake Data Superhero!

5 February, 20228 February, 2022 by Maja FerleNo Comments

I’m so excited about becoming a Snowflake Data Superhero! I first learned about the Superhero program from Kent Graziano’s blog more than a year ago and I immediately thought it would be cool to be a member of this group. At the time, I was still very much a beginner with Snowflake and I knew I had to become more involved if I wanted to join the Superhero program. Compared with other popular on-prem data platforms that have been on the market for decades, Snowflake as a cloud data platform is relatively younger which means that there still aren’t vast knowledge bases of information available to users and developers of the platform. There aren’t many experts out there answering questions, writing blogs, creating tutorials or YouTube videos. This is where Snowflake Data Superheroes come in. We (yes, I can use the pronoun “we” now since I have been officially welcomed to the club) are here to fill the gap. I have been...

Snowflake Role Based Access Control (RBAC)

13 November, 202120 February, 2022 by Maja FerleNo Comments

Snowflake recommends that roles are used for authorizing access to database objects instead of allowing direct access to objects by individual users. Roles may be granted to other roles, and this enables the Snowflake administrator to create access control hierarchies that act as building blocks for creating an overall access control strategy. There is some excellent information out there about Snowflake Role Based Access Control or RBAC for short that can be used as a starting point to learn the basics, such as this document on Snowflake Community and a series of posts written by John Ryan here, here and here. In this post I want to summarize the concepts of role based access control and then point out some additional considerations when implementing it. Here is a summary of best practices when setting up role based access control (RBAC): Define a set of functional roles that will be granted to users according to how they will be using the database, for example...

What is so great about cloning in Snowflake?

9 October, 202120 February, 2022 by Maja FerleNo Comments

When companies move their infrastructure to the cloud, like for example Snowflake cloud where resources are billed according to their actual use, they become more conscious about the costs of storage and compute consumption. Those who are new to the cloud are often concerned about how much it will cost when they run a query or when they create a table instead of a view. It takes time to get used to this type of billing and also to understand the average consumption and the expected cost over time, so that it doesn’t become a day-to-day worry. Features that save costs are welcome in the cloud. One of such features in Snowflake that is not available in other databases is zero-copy cloning. This feature creates a copy of a database, a schema, or a table. The cloned object incurs no additional data storage costs because it shares all the existing micro-partitions of the original object at the time it was cloned....

How to query Slowly Changing Dimensions Type 2

20 June, 20216 December, 2021 by Maja FerleNo Comments

Data warehouses use timestamps to keep track of data that is changing over time. A common term that is used to describe implementations of historically changing data is slowly changing dimensions. There are several types of slowly changing dimensions, explained in various sources (examples here and here). In this post I will focus on how to query slowly changing dimensions type 2 or SCD2 for short. The reason I decided to write this post is that there is very little information out there on how to query SCD2. When I Google it, I get tons of links explaining how to insert data into SCD2 tables. But there is hardly any information on how to query it. In my experience, developers who are working on ETL are usually well versed in using the ETL tools and the built-in functionalities for inserting SCD2 type data. But querying data from SCD2 tables is often misunderstood or not understood at all. To many developers and business...

A few cool SQL features in Snowflake (that are better than in Oracle)

12 May, 202113 December, 2021 by Maja FerleNo Comments

For an Oracle consultant like myself with many years of experience building data warehouses and analytics solutions using the Oracle technology stack, I was naturally skeptical when I was asked to migrate an existing Oracle solution to Snowflake. Just like with any new technology, switching to Snowflake was a learning experience at first. But not to worry, I became a fan of Snowflake soon enough. There are so many cool features in Snowflake, some of them better than in Oracle, that it wasn’t difficult to make the switch to Snowflake. I’m thrilled with the ease of use of everything in Snowflake. All you have to do is to create an account and you are ready to go. There is no installation, no configuration, no figuring out how to get started as there is a web user interface ready and waiting for you when you sign up for your account. The SQL syntax in Snowflake is similar enough to Oracle that I...

SnowPro Core Certification

16 January, 20216 December, 2021 by Maja FerleNo Comments

I'm thrilled that I passed the SnowPro Core Certification exam! It was challenging because to be successful, exam takers must get at least 80% correct answers, which is quite high as compared to other industry exams (edit October 2021: the passing score has since been lowered). Before taking the exam, I wanted to be sure that I was well prepared so that there would be no surprises. In this post I will share how I prepared for the exam and some thoughts about the experience in general. Preparing for the exam The first step when taking any certification exam is to review the exam contents and have an understanding of what is covered on the exam, what types of questions there will be, how many questions and how long it would take. Then study time begins. At the time of taking the exam I had just under a year of experience on Snowflake. Some of this experience was doing exercises on my own and...