We send the URLs included in your training data to OpenAI. If OpenAI includes any URL in its responses, we convert them to working links before showing the response in the ChatBot.
However, this does not work when Streaming is enabled. It is because of how streaming works. While streaming, OpenAI streams its responses by tokens. Tokens are not complete words. So, even for URLs or Lists, it does not send complete tags. Any markup gets broken into multiple tokens. If we try to convert that to HTML it also gets broken.
If streaming is disabled, we can take the entire response and convert the markdown code inside the response to HTML and show it properly. However, the downside is that without streaming, there is an additional delay on the OpenAI’s end to generate the entire response and then send it back to your site.
However, to mitigate this, we included a Page Suggestion feature. Our plugin does its own search and displays the relevant pages from your WordPress website after the AI responses.
