Sunday , January 29 2023

Four loud assistants have raised 800 questions, and Apple Siri is not as stupid as you think.


The rapid development of smart speaker products is inseparable from the impact of voice assistants. From time-to-space to space, voice assistants called Google Assistant, Siri, Alec and Cortana are trying to penetrate our lives, and companies that create voice assisters obviously want to have all devices that can connect to the network. Go to your ecosystem.

Ultimately, smart speakers are not mobile phones and gaming consoles, and speakers with different voice assistants in every corner of the house should have only a few options. If you can only buy, of course, you can not avoid the question "who is better".

The smartest thing is Google, Apple Siri is not as stupid as I thought.

Now, the test report should respond to people's doubts. Gene Munster, founder of Loup Ventures Venture Capital, has prepared 800 questions and has actually tested the main intelligent voice assistants.

1. Can the voice assistant recognize your question?

2. Can a voice assistant understand the problem and give the correct answer?

To cover as many areas and scenarios as possible, Munster shares 800 questions in five parts:

1. Location class, such as "Where is my nearest cafe?"

2. Consumers, such as "Can you order several sheets of paper for me?"

3. Navigation class, such as "How to get to a nearby bus station?"

4. Categories of information such as "What is the weather today?"

5. The instruction class, such as "Please, help me call the KSKSKS"

The results of the test showed that the performance of the Google assistant is still the best in understanding and answering the accuracy of the issue, he correctly understood all the questions, and the accuracy of the answer reached 87.9%.

On the contrary, Apple Siri was in second place, misunderstood three, the accuracy of the response reached 74.6%, then Amazon Alek and Microsoft Cortan, the accuracy rate was 72.5% and 63.4% respectively. However, more than 99% of the questions are still being guaranteed.

Munster also compared this data with results a year ago and found that most smart speakers equipped with voice assistants "became smarter".

Especially in answering the accuracy of the question, Google Home has increased by 7%, Amazon Echo has increased by 9%, Microsoft Cortana has increased by 7%, and Apple HomePod has grown by 22%, it seems that Apple has really few "Save" previously controversial Siri.

These improvements are specific to answering specific questions, such as Google Assistant and Alec now support online access to flight status status or read a good night's story and, if necessary, reproduce a specific radio service (the last one) Apple HomePod can not be implemented).

In fact, smart speakers still have many scenes to use high frequencies to use, but now most people are used to asking them to answer the simple question "What is the weather today?" Or "Give me a song".

The reason why the problem is misunderstood is that some of the issues include some specific nouns, such as the name of a local restaurant or a small geographic location, which relates to question and excuses and speed of speech. Relationship.

All in all, these main voice assistants realize that basically there are no obstacles to understanding the problem, that is, the answer is not necessarily what you want.

Answering a question is more often than ignorance.

In contrast to each subcategory, Google Assistant holds first place in four of the top five categories, but the "instruction class" is not as good as Apple Siri.

The reason for this may be related to Apple's choice to open the SiriKit interface for third-party applications. After iOS 12's "shortcut", users can manually "clean screen shots" and "play specific music lists". Packing a multi-operation task into one voice instruction also means that Siri is more efficient in resolving requests from commands from a local application.

Apple Siri and Google Assistant, which integrate their own mapping services, also have significant advantages in location and navigation categories.

Surprisingly, in the consumer category, most people think that Amazon Alec, with eCommerce support, is the leader in this field. In fact, Google also has its own Google Express (Google and more retail). Cooperative Express Delivery Service) so that Google Assistant can also solve most of the requirements for purchasing a product.

Here is another example that illustrates the difference between Alec and Google assistant:

Question: How much does manicure cost?

Aleka A: "We asked for the Beurer Electric Manicure & Pedicure Kit (Manicure Set). The price at Amazon is $ 59. Do you need it?"

Google Assistant A: "Relatively, basic manicure service is $ 20, but some special services, such as phototherapy, gel, etc., ranges from $ 20 to $ 50, depending on the condition of the nail salon."

In this respect, Munster believes that when it comes to consumer issues, voice assistants should not be related only to products, but must be able to connect with the local business environment in the context of the examiner.

Moreover, there are not many people who actually use a voice assistant to buy things. Information published by Amazon Echo smart speakers shows that this percentage is only 2%, and nearly 90% of users will not use the other after using the "buy voice" service. Times, most people are even more willing to check orders and follow the Express.

Perhaps Amazon itself is aware that Alec has a congenital shortage beyond ecommerce space. They launched a service called "Alec Ansvers" earlier this month, mainly to invite users to help Alec write the answers to specific questions. This is quite similar to the writing of a group of people in Wikipedia.

Of course, what users want to achieve is that a voice assistant can really understand the multiple meanings hidden behind the problem.

For example, when you are absent from home, the question "What is my next task list?", In addition to simply presenting an incident, the answer will rather hear the answer. "Your next event is after the KSKS minute. KSKSKS, it takes a KSKS minute driving, KSKS minutes by bus , we will give you the direction of navigation.

However, this is still a bit difficult for the current voice assistant, which means that it not only needs to understand the problem itself, but also know how to actively invite other sensors, applications, and even past usage habits. This will really make it smarter, but it will surely experience a new round of privacy issues.

Source of the map: Stuff

Source link