Home Blog

Streamlining Behavioural Data Integration: Lassoo Meets Snowflake via Airbyte

Dive into the world of advanced analytics with our latest ETL installment on connecting Lassoo's headless analytics with Snowflake via Airbyte. Discover how this powerful combination unlocks real-time insights, scales with your data needs, and drives informed business.

Streamlining Behavioural Data Integration: Lassoo Meets Snowflake via Airbyte

Harness the Full Potential of Your Behavioral Data

In today’s data-driven landscape, the ability to seamlessly integrate and analyze vast amounts of data is paramount. Lassoo.io, with its innovative approach to behavioral analytics, pairs exceptionally well with Airbyte, an open-source data integration platform. This guide will walk you through integrating Lassoo’s PostgreSQL-based headless analytics data with Snowflake using Airbyte, showcasing the simplicity and power of this integration.

What is headless analytics?

Headless Analytics is an architectural approach that decouples data collection from reporting. It focuses on the efficient ingestion, curation, reconciliation, and enrichment of data. Data teams can then use their preferred tools for reporting, BI and activation, directly on the collected data, or after loading/streaming it to their data warehouse.

Why Lassoo and Airbyte?

Lassoo.io offers a groundbreaking approach to behavioral analytics. Our headless analytics solution auto-tracks all customer behavior, providing granular first-party data directly via SQL. This data is not just comprehensive; it’s ready for immediate use, thanks to built-in features, classification, and rollups. Lassoo can power a wide variety of advanced use cases, allowing organizations to drive significant business value with behavioral data.

Airbyte stands out in the data integration space for its open-source nature, flexibility, and rapidly growing community. It supports a wide range of connectors, including PostgreSQL and Snowflake, making it a versatile choice for various data integration needs.

Integrating Lassoo with Snowflake Using Airbyte

Step 1: Preparing Your Lassoo Data

Ensure your Lassoo account is active, and you have access to the Lassoo db credentials for your behavioral data insance. Lassoo’s platform offers an intuitive interface for managing and understanding your data, connecting via SQL and generating SQL queries you can use downstream in BI tools, ML tools, reverse ETL etc…

Step 2: Setting Up Airbyte

If you’re new to Airbyte, setting up an instance is straightforward. Once you have Airbyte running:

  1. Select PostgreSQL as the Source: In Airbyte, configure PostgreSQL as your source connector and input your Lassoo database credentials (host, port, database name, user, and password).

You will also need to select the update method. CDC is idea, it is most lightweight therefore will incur the lowest processing charges. This type of CDC is built into PostgreSQL via the WAL (write ahead log AKA transaction log) which PostgreSQL publishes to via its native wire protocol which it uses for replication so you know its going to be fast and efficient.

alt_text

The one beef I have with Airbyte is in the sheer number of IP addresses they make you put in your white list for accessing Lassoo/PostgreSQL. 5 or 6 is understandable, 8 and up and its too much. Figure out your networking Airbyte! However I do give them props for supporting SSH, this is a nice-to-have feature that not ETL tools support. Currently Lassoo does not support SSH for ETL but it is in the works.

  1. Configure Your Source Settings: Choose the tables or schemas you want to replicate from Lassoo to Snowflake.

Step 3: Configuring Snowflake as the Destination

Next, set up Snowflake within Airbyte:

  1. Choose Snowflake as the Destination: In Airbyte, select Snowflake from the destination options.

  2. Enter Your Snowflake Credentials: Provide details like account identifier, warehouse, database, schema, username, and password.

  3. Customize Your Data Sync: Airbyte allows you to customize replication frequency and other settings to align with your data strategy.

Step 4: Initiating the Data Sync

With both source and destination configured, start the replication process. Airbyte will begin transferring data from Lassoo to Snowflake, making it ready for advanced analytics.

alt_text

I can now see my core tables person_ and session_ and all my event tables, event_page, event_track, event_ecommerce etc..

Benefits of This Integration

  • Real-Time Insights: Analyze customer behavior in real-time with Lassoo’s data now in Snowflake.

  • Flexibility and Customization: Airbyte’s open-source nature allows for extensive customization and flexibility in your data integration processes.

  • Scalability: As your data grows, this integration scales with you, accommodating increasing data volumes effortlessly.

  • Enhanced Data Analysis: Combine Lassoo’s detailed behavioral data with Snowflake’s powerful analytics capabilities for deeper insights. \
  • Power your Composable CDP: Leverage your data for marketing automation.

  • **Power ML models **: Lassoo’s simple schema with built in features and classification makes training machine learning models that much easier.

Conclusion

Integrating Lassoo with Snowflake via Airbyte represents a significant advancement in data integration and analytics. This combination empowers businesses to leverage their behavioral data fully and in real-time enabling more informed decisions and strategies. This data also powers downstream systems which consume data from Snowflake.

Stay tuned as we continue to explore more integrations with leading data tools.


Stay in the loop.

Get the latest Lassoo news directly in your email box.

Nice. You're now registered for the Lassoo Newsletter.


Max Kremer
Max Kremer  Co-founder & CTO @ Lassoo. Startup guy with multiple exits. Lover of technology and data.