10 workflow hacks for developers working with data
Building with multiple datasets can get complicated. We make our data as simple to use and integrate with your existing code base as possible, to make everyone’s lives easier.
Beyond that, there are also plenty of things you can do to speed up your workflow and remove unnecessary fluff. Below, we’ll describe 10 such tips, as well as where you can find more.
(Note: our #1 tip is to get familiar with the Snowflake UI (and set up any BI tools you’re used to). It offers a lot of convenience that you won’t get with programmatic queries in your code editor.)
1. Fork queries
There are hundreds of thousands of queries generated by community analysts at flipsidecrypto.com. Browse them for interesting topics and query inspiration.
When you find one you like, you can click any chart in a dashboard to be shown the query in detail. Chances are, what you’re looking for has been done. And if it hasn’t, you’ll come away with a new perspective, ready to solve problems.
2. Combine databases
You don’t have to get data from one blockchain at a time. First, our crosschain tables include interchain activity, giving you access to several blockchains at once. But more importantly, Snowflake lets you access multiple databases in the same query. Unleash your queries and grab all that data at once!
3. Speed up debugging
However, when you do decide to write a complex query that hits multiple databases, it might take a bit longer to run. To save time, set a time period of one day when you first run your queries, no matter how much information you need.
This way, if the query fails, you won’t have to wait for such a large query to compute before finding out!
4. Pin tables
Your work space affects your work pace. Love or hate your code editor, when it comes to tracking data over time, you’ll want to make use of the Snowflake UI features to keep your most commonly-used tables close. Simply pin any tables you come back to frequently in the left hand column for easy access.
5.Save custom views
Your Snowflake account comes with a private sandboxed database that’s designed to be customized. For complex queries you’ll want to keep refreshed, you can build custom views into your database on top of Flipside’s Data Shares.
To create a custom view, start by creating a schema with the CREATE SCHEMA function. Below your new schema, simply wrap any query in a CREATE VIEW statement, and you’re all set!
6. Don’t forget the ‘group by’
Some tables require a grouping, and will throw an error if you forget. If you see “table is not a valid group by expression”, it means you need to add the variable to a ‘group by’ function (even though that error message sounds contradictory).
7. Use Streamlit
Visualizing data programmatically can be a pain — especially when you want to share those visuals. Use Streamlit directly with Snowflake to quickly and easily create shareable dashboards without hosting and deploying.
8. Ask us about LiveQuery
We recently launched a tool that lets you query any API alongside Flipside data. It has pre-packaged support for dozens of APIs for crypto and other financial datasets, but can be used to programmatically query any API, as long as you’ve got credentials for it. AI, web2 data, whatever you need. Ask us about setting up LiveQuery in your environment, and we’ll help you get started.
9. Search-tab to filter
When searching for a table in Snowflake, you can filter by database and schema simply by pressing Tab instead of Enter in the search bar. This locks what you’ve typed as a filter, allowing you to then search specifically within a specific database or schema.
10. Update several lines of code at once
In many queries you’ll find syntax repeated on several successive lines (such as with LIMIT statements). Save time by alt-right click-and-dragging the lines you want to edit. A large cursor will span the lines you’ve selected, and when you type, the same text will appear on each line.
Further reading
Blockchain data is complex, and doesn’t follow any set standards industry-wide. That’s why Flipside data is designed to be easy to learn - schemas are organized by sector and the pattern is consistent across chains, so once you’ve written a few queries, you’re up to speed!
For a more comprehensive look at our data, read up on the Flipside docs. They contain detailed descriptions of each chain we cover, Snowflake SQL resources, our modeling, labeling, and tagging methodologies, and even tips for more efficient queries.
And as always, don’t hesitate to reach out with any questions.
Happy queries!
