In recent years, Generative Artificial intelligence (GenAI) has revolutionized the technology sector, totally disrupting how we interact with our devices and programs, and how we perform tasks in our digital world. The impact spans various domains, like content creation as well as complex decision-making. GenAI’s capabilities are rapidly advancing, with foundation models improving in both learning and generation. The true power of GenAI, however, lies in how innovators build upon these models. Let’s explore the impact of AI on Soda’s user journey.
AI enables us to have a deep, contextual understanding of data ecosystems. It allows users to interact with systems that comprehensively grasp their data sources, usage, and interconnections. Since GenAI models can adeptly use domain-specific languages like SodaCL and SQL, users expect conversational interfaces that assist them with setting up checks for data quality coverage. For example, users should be able to request a check that ensures order IDs are never duplicated, and have an AI assistant, or series of agents, swiftly deploy that check on their data.
A GenAI-first data quality platform goes beyond assisting with data coverage. Once data issues are detected, users expect intelligent search capabilities and answers that summarize scattered information and results, helping them understand the root cause of their issues, what they were testing in the first place, how to prevent those issues in the future, and possibly even how to fix the issues right now. Ideally, GenAI systems would facilitate automatic deployment of these solutions with minimal human oversight.
At Soda, we are pioneering the adoption of GenAI in the data quality space, and we are very excited to announce a new set of features under the Soda AI umbrella.
Introducing Soda AI
Soda AI brings together all of our existing AI capabilities, SodaGPT, and time series anomaly detection dashboards.
Soda AI Regex Assistant
While we know that the release of no-code checks in December made it extremely easy for anyone in your organization to quickly translate their data quality requirements into checks that can be deployed and evaluated within minutes, the moment you want to detect a specific pattern in your data or check particularly bespoke business logic, things can get a little hairy. This AI assistant is here to help you when things get hard.
Want to make sure that all your strings follow a certain pattern, like “has to start with ‘event_’ and contain two letters and a digit? Ask the Regex Assistant and you’ll get the regex pattern that best fits your database dialect, plus an explanation in plain English so you can double-check what the AI produces.
Soda AI SQL Assistant
Sometimes, a built-in SodaCL check just doesn’t cut it. When it comes to business logic, there are many things you may need to customize in order to properly validate. For these situations, Soda gives you full flexibility to define your own metric using SQL, or even to define your entire SQL check logic and evaluation condition using a failed rows check. But taking that path shouldn’t mean you’re on your own, lonely and alone against the adversity of a blank SQL query editor. We’ve got you covered with the SQL Assistant!
Ask AI Assistant
We’ve noticed that many of our users were expecting SodaGPT, our first GenAI tool designed to generate SodaCL checks from natural language prompts, to answer general, how-to questions about Soda. Therefore, we decided to take the hint and are offering private preview access to the AskAI Assistant in Soda Cloud.
Use Ask AI to answer general questions about how to use Soda, from platform specifics, to writing SodaCL, addressing error messages, and beyond. Ask AI has all the answers!
Checks Assistant
Soda AI Checks Assistant is your companion to create executable checks expressed in plain English. These checks can be seamlessly scheduled and executed from directly within Soda Cloud, thanks to a deep integration that ushers in a new level of automation. SodaGPT, our original incarnation of the Checks Assistant, was the figurative “canary in the coal mine”. The new Checks Assistant is smarter – like way smarter! – than SodaGPT, and directly integrated into the rest of the Soda Cloud platform so you can go from idea to product-ready check almost instantly.
Stay tuned!
These features are just the beginning! Soda is committed to exceeding the evolving expectations of our users and we’re already looking into many other places where we believe GenAI can help you and your team achieve your data objectives. So, as we integrate more GenAI solutions into our product, you can look forward to a suite of tools that make data quality management more intuitive, insightful, and, most importantly, better aligned with your needs.
If you're eager to test the leading edge of GenAI-driven data quality platforms, stay tuned for news on private preview access. The future is bright, and it's filled with transformative possibilities that we can't wait for you to experience.
Do you have some wild ideas? Do you want specific parts of our product to be enhanced with GenAI? Do you want to make sure we take your ideas into account, or that we let you know when new stuff becomes available? Feel free to reach out to us in Slack; we’ll be thrilled to put you in touch with our Soda Product Managers.