Changelog
Join DiscordTrust Center
Back to All
added

New KB Search Step and Major Token Cost Reductions

September 18th, 2024 by Zoran Slamkov

We’re excited to announce the release of the KB Search Step, a new feature designed to simplify querying data from your Knowledge Base directly within Voiceflow. This step streamlines the process of fetching data chunks, providing you with greater control and efficiency in your conversational workflows.


What’s New:

  • Native KB Querying: Easily query your Knowledge Base without the need for manual API configurations. Simply input a question or variable and retrieve relevant data chunks directly in your workflow.

  • Customizable Chunk Retrieval: Use the chunk limit slider to specify the number of data chunks to be returned, ranging from 1 to 10. Fine-tune responses by adjusting this setting to suit your agent’s needs.

  • No Match Handling: Set a minimum chunk score for chunk matching. If no data meets this threshold, the workflow can automatically follow a customizable Not Found path, ensuring a seamless user experience even when no exact match is found.

  • Enhanced Control Over Prompts: Fetched data chunks are automatically converted into a string format, making them easy to incorporate into text-based prompts and other steps. You have the flexibility to control how this data is used, enhancing the quality and relevance of your agent's responses.

  • Testing Experience: Test your queries directly within the editor. View the returned chunks and their scores for insight into optimizing your knowledge base.

How It Benefits You:

  • Improved Efficiency: Eliminate the complexity of setting up manual API calls. The KB Search Step simplifies querying your Knowledge Base, saving you time and effort.

  • Greater Flexibility: Control how many data chunks are returned and set minimum chunk scores to ensure the most relevant information is fetched for your agents.

  • Enhanced Workflow Integration: Automatically convert and save data into variables, ready for use in subsequent steps within your workflow. This streamlines the process of integrating Knowledge Base data into your conversational designs.

How to Get Started:

To start using the KB Search Step, simply drag the step onto your canvas from the Developer section in the step toolbar. Configure your query question, set your chunk limit, and map the data to a variable—all in less than a minute!

Learn More:

For detailed instructions on how to use the KB Search Step, check out our updated User Guide.

And more exciting updates

  • Token Multiplier Reduction:

    • Tokens are now more affordable, with a reduction of ~50% or more on many of the supported models! Here are the new multipliers:
      • GPT-3.5-Turbo: Reduced from 0.6x to 0.25x
      • GPT-4 Turbo: Reduced from 12x to 5x
      • GPT-4: Reduced from 25x to 14x
      • GPT-4o: Reduced from 6x to 2.5x
      • GPT-4o mini: Reduced from 0.2x to 0.08x
      • Claude Instant 1.2: Reduced from 1x to 0.4x
      • Claude 1: Reduced from 10x to 4x
      • Claude 2: Reduced from 10x to 4x
      • Claude Haiku: Reduced from 0.5x to 0.15x
      • Claude Sonnet 3: Reduced from 5x to 1.75x
      • Claude Sonnet 3.5: Reduced from 5x to 1.75x
      • Claude Opus: Reduced from 20x to 8.5x
      • Gemini: Reduced from 8x to 3.5x

  • Billing Email Setting:

    • You can now set a Billing Email on your account from the Billing page on the dashboard. This allows all billing-related emails, such as invoices and payment-related notifications, to be routed to the appropriate contact.