The GenAI group has turned to artificial knowledge to fulfill its starvation for knowledge. Nevertheless, it’s carried out so with vital reluctance, even typically assuming that artificial knowledge is equal to “pretend knowledge”. This text revealed by Bloomberg is excellent expression of this pattern:
This can be a nice article, and positively price studying, however with one caveat in our opinion: it appears to imagine that GenAI is the one method out there to generate artificial textual content. Nevertheless, there are different approaches, based mostly on guidelines (symbolic method) slightly than on pre-existing knowledge, that present various options.
What are the benefits of the symbolic method?
- Information generated is 100% dependable, which signifies that all generated variations preserve 100% semantic integrity with the seed sentence (the seed sentence being the preliminary textual content for which we request variants)
- This suggests that the information is 100% freed from hallucination, bias and PII points
The explanation why this method reaches 100% accuracy is that the era of variants is managed by guidelines with predictable conduct. Earlier than really producing any textual content, the Pure Language Technology (NLG) platform requires a seed sentence and a set of linguistic parameters.
In consequence, this method is a mix of the most effective of two worlds:
- Full Automation based mostly on Symbolic NLG Know-how
- Professional parametrization by linguists to verticalize the generated knowledge
As an example the variations between statistical and symbolic approaches, we’ve run a benchmark to match knowledge generated by ChatGPT 3.5, by ChatGPT 4 and by Bitext NLG expertise.
The Benchmark description is as follows:
- The seed sentence is: “cancel order”
- The minimal requested variety of generated variants is: 20
The outcomes are a bit stunning:
- With ChatGPT 3.5, 60% of utterances generated modified the which means; 12 out of 20 variants are unsuitable; this can be a very excessive quantity
- The minimal requested variety of generated variants is: 20
- With Bitext, 100% of utterances are semantically equal to the seed sentence
We embrace a number of examples under (and the total listing on the finish of the article):
What are the explanations for errors in ChatGPT? Not surprisingly they’re associated to what’s known as “hallucinations”, surfaced within the type of addition of content material that didn’t exist within the seed sentence. For instance, a number of the variants generated embrace details about a refund, which isn’t included within the seed sentence:
- Can I cancel my order and refund the cost, please?
Another variants simply don’t make sense, like this one asking for the rationale for the cancellation, the rationale must be recognized by the client, not by the chatbot; a transparent case of hallucination:
- Are you able to please cancel my order and supply a cause for the cancellation?
We embrace under the total set of the 20 sentences generated by every of the three techniques.
In abstract, artificial textual content stays one of many prime options to unravel the urgent knowledge difficulty that GenAI faces for deployment, notably on the enterprise degree. GenAI-based approaches usually are not offering the answer that the market wants. Nevertheless, there are different approaches that generate helpful knowledge, just like the symbolic method, though they’re bit blurred by the present hype.
Pattern outcomes obtained with ChatGPT 3.5, 4 and Bitext NLG:
| ID | Generated Variant for Seed “cancel order” | OK | KO |
|---|---|---|---|
| 1 | Are you able to cancel my order and refund the cost, please? | X | |
| 2 | I must cancel my order for private causes. | X | |
| 3 | Are you able to please cancel my order and supply a refund? | X | |
| 4 | I must cancel my order and wish to know the refund course of. | X | |
| 5 | May you please cancel my order and supply a cancellation affirmation? | X | |
| 6 | I must cancel my order and wish to know when I’ll obtain a refund. | X | |
| 7 | Are you able to please cancel my order and let me know if there are any charges? | X | |
| 8 | I’ve determined to cancel my order, are you able to please assist me with that? | X | |
| 9 | I must cancel my order as a consequence of a mistake within the order particulars. | X | |
| 10 | Are you able to cancel my order and make sure the refund quantity? | X | |
| 11 | I remorse to say that I must cancel my order. | X | |
| 12 | Are you able to please cancel my order and supply a cause for the cancellation? | X | |
| 13 | I must cancel my order and would recognize your immediate help. | X | |
| 14 | Are you able to cancel my order and let me know if I must take any extra steps? | X | |
| 15 | I must cancel my order and wish to know the standing of the refund. | X | |
| 16 | Are you able to please cancel my order and let me know concerning the refund? | X | |
| 17 | I must cancel my order as a consequence of a change in circumstances. | X | |
| 18 | Are you able to cancel my order and supply a affirmation electronic mail? | X | |
| 19 | I wish to cancel my order and obtain a full refund. | X | |
| 20 | I must cancel my order, please | X | |
| Whole: | 8 | 12 | |
| ID | Generated Variant for Seed “cancel order” | OK | KO |
|---|---|---|---|
| 1 | I might prefer to cancel my order, please. | X | |
| 2 | Are you able to assist me cancel the order I simply positioned? | X | |
| 3 | I made a mistake and must cancel my order. | X | |
| 4 | I’ve modified my thoughts and wish to cancel my latest order. | X | |
| 5 | I must cease my order earlier than it is shipped, are you able to assist me with that? | X | |
| 6 | Please cancel my order, I not want the gadgets. | X | |
| 7 | May you please help me in canceling my buy? | X | |
| 8 | Are you able to abort the cargo of my order? | X | |
| 9 | I need to halt my order, how do I try this? | X | |
| 10 | Please undo the order I simply made. | X | |
| 11 | I do not need to proceed with my order anymore, are you able to cancel it? | X | |
| 12 | Is it potential to terminate my order? | X | |
| 13 | I by accident positioned an order. Can or not it’s cancelled? | X | |
| 14 | Assist me in cancelling the order I positioned a couple of minutes in the past. | X | |
| 15 | I wish to retract my latest order. | X | |
| 16 | I’ve determined in opposition to my order, can we cancel it? | X | |
| 17 | I must nullify my order, might you please help? | X | |
| 18 | How do I’m going about revoking my order? | X | |
| 19 | I must cancel my buy, are you able to information me? | X | |
| 20 | Please, discontinue my order processing. | X | |
| Whole: | 12 | 8 | |
| ID | Generated Variant for Seed “cancel order” | OK | KO |
|---|---|---|---|
| 1 | are you able to give me details about canceling an order? | X | |
| 2 | issues with canceling orders | X | |
| 3 | I have no idea how I can cancel the final order I made | X | |
| 4 | I wish to cancel the order I made | X | |
| 5 | I need assistance canceling an order | X | |
| 6 | how might I get details about cancelling an order? | X | |
| 7 | I need assistance cancelling an order I made | X | |
| 8 | I’ve issues with cancelling orders | X | |
| 9 | I’ve a query about canceling an order | X | |
| 10 | drawback with cancelling orders | X | |
| 11 | issues with cancelling an order | X | |
| 12 | how might I cancel an order? | X | |
| 13 | the place might I get details about order cancellations? | X | |
| 14 | do not know how you can cancel order | X | |
| 15 | I want help cancelling an order I made | X | |
| 16 | I’m looking for details about order cancelations | X | |
| 17 | I would like assist cancelling an order I’ve made | X | |
| 18 | I need assistance with cancelling an order I’ve made | X | |
| 19 | the place to cancel an order I made? | X | |
| 20 | how do I cancel my order | X | |
| Whole: | 20 | 0 | |
