Source: New Smart Element

Image Source: Generated by Wujie AI

Recently, Samsung unveiled its latest Galaxy S24 series smartphones in San Jose, California, with AI elements fully integrated. Netizens were enthusiastic and conducted various real-world tests.

Samsung's new flagship, packed with AI elements, surprisingly received complaints about half of its functions being not very user-friendly!

Recently, at the Galaxy Unpacked event held in San Jose, California, Samsung introduced the latest Galaxy S24 series smartphones.

In the era of generative AI, Samsung has also fully embraced the concept of AI this time.

From the official website, we can see the new features being promoted this time, including search, translation, note assistant, message composition, as well as photo editing and processing, all of which rely on the latest AI technology.

What particularly caught the attention of the editor is the Circle to Search feature, which is supported by Google.

What does this feature do? Watch the video below to understand:

We can "summon" this feature on the interface of any application, then "draw a circle" around something we are interested in, and AI will immediately integrate all relevant information,

search, understand, or… directly purchase.

In addition, the chat assistant feature allows you to change the tone, translate, or spell-check messages before sending them.

The real-time translation feature can translate the conversation content in 13 languages during calls.

The note assistant tool is used to summarize, translate, and format files in the Samsung Notes app, and to generate digital covers for notes.

Generative Edit, similar to Google's Magic Editor, allows you to manipulate and move objects in photos.

The "Transcription Assistant" feature in the Samsung Voice Recorder app provides transcription and summarization of conversation content.

In this new product release, Samsung has also collaborated closely with Google, introducing Google's AI features on the basis of the most important link, Android.

"Our top-notch base model, Gemini, has created more possibilities for Galaxy S24 users, including a new way to search using Circle to Search."

Other related Google accounts have also been actively promoting:

The Circle to Search feature was first launched on Samsung, but Google's own Pixel cannot be neglected, and the new feature will appear on the Pixel 8 Pro on January 31.

The collaboration between the two companies also includes integrating Gemini Pro and Imagen 2 on Vertex AI into smartphones through Google Cloud.

So, under the strong alliance of the two major companies, are the new smartphone's AI features really user-friendly?

Half of the New AI Features Not User-Friendly?

With the blessing of the new Snapdragon 8 Gen 3 processor, the S24 series smartphones can perform AI-driven tasks that we have experienced on other platforms.

For example, functions you have experienced on Microsoft's CoPilot, Google's Bard AI, or ChatGPT are now available on the phone.

Generative AI plays a significant role in the Galaxy S24 lineup, mainly in five areas—search, translation, note creation, message composition, and photo editing and processing.

Circle to Search

The new Circle to Search feature, provided by Google, made its first appearance on the S24 series.

When using Circle to Search, you first need to press the middle of the bottom edge of the screen (virtual home key position), and the Google logo and search bar will pop up, allowing you to draw a circle around anything on the display.

—Except for DRMed content or content protected by screen capture (such as banking applications).

After drawing the circle, the system will display what you circled, as well as results from the Google Search Generation Experience (SGE).

You can scroll down the list of image-matched items, including shopping, text, websites, and other types of lists that SGE deems relevant.

Users have tested circling the Samsung clock widget, steak, and lemon images, and have consistently received quite accurate results, even when circling items at a skewed angle.

This is similar to using Google or Lens for image search, but without having to open another app (or take a deliberate screenshot), such as in a YouTube video or on Instagram (or an ad).

This seems to be a convenient feature, although it's uncertain how frequently users will use it.

Another confusing experience is the "call-out" operation, which requires long-pressing the virtual home key position to activate Circle to Search, whether using full-screen gestures or a virtual three-button layout.

According to user testing, when using virtual keys, users need to adapt to this long-press operation, or they might accidentally exit (short press on home).

Chat Assistant

Reportedly, the rest of Samsung's AI features are actually driven by their own language model (Gauss generative AI model), not Google's language model.

When translating a message from Portuguese to Mandarin using the S24, Samsung's database is used, not Google's.

—So, regardless of the translation experience, users' emotions should be directed towards the correct target.

Samsung's new chat assistant feature uses generative AI to help users rewrite messages to change the tone.

Suppose you're in a hurry and send a quick reply to a friend, who might feel anxious and misunderstand the message. In this case, the S24 can help you rewrite it, for example, changing it to "I'm on my way back now, what do you need?" to make it less abrupt.

You can choose your own theme tags, such as "casual," "emojis," "polite," "professional," and "social."

Some users have tested this feature, such as inputting "Hey, where can I get some delicious barbecue? Also, how are you?"

Hey there. Where can I get some delicious barbecue? Also, how are you?

Then click on the AI icon above the keyboard and select "writing style." After about a second or two, the system returns the modified text:

Hello, I would like to inquire about the availability of delectable barbecue options in the vicinity. Additionally, I hope this message finds you well. Thank you for your attention to this matter.

The Samsung AI seems to simply replace each word with a slightly larger one and add some formal greetings.

The user said, "I don't think 'inquire about the availability of delectable barbecue options' is something a human would write."

"Real-time" Translation

Samsung's AI can translate messages into one of 13 languages in real time, and the translation engine also provides real-time voice translation.

This feature can act as a user's interpreter when making phone calls. How effective is it? Users tested it on site.

After dialing the number and activating the real-time translation option, Samsung's AI read out a brief disclaimer and informed the other party (the manager of a Spanish restaurant) that we were using AI for translation.

The user said "hello," and a few seconds later, heard an invisible voice say "Hola."

In actual experience, the AI's translation is generally accurate, but the delay is very bad, disrupting the flow of the conversation—especially in this test, where the person on the other end of the call can understand English, so they answered in Spanish before the translation was sent, causing confusion when the voice translation was sent later.

For example, the normal flow of the conversation should be:

Me: Can I make a reservation please? S24: … ¿Puedo hacer una reserva por favor? Restaurant: Si, cuantas personas y a que hora? S24 (to me): … Yes, for how many people and at what time?

But the actual situation is:

Me: Can I make a reservation please? pause Restaurant: Si, cuantas personas y a que hora? S24: ¿Puedo hacer una reserva por favor? pause S24 (to me): Yes, for how many people and at what time?

However, it seems that there is an option to turn off the original voices of both parties and only use the translated voice.

Note Organization

Impressively, Samsung's AI in the Notes app allows users to quickly reformat large blocks of text into easily readable headings, paragraphs, and bullet points; and also allows for sideways scrolling to view different themes with different colors and font styles.

Samsung has also borrowed another feature from the Pixel ecosystem, using its speech-to-text to transcribe, summarize, and translate recordings.

This is accurate enough for short monologues, but the labels given to the speaker are not accurate enough, and the transcribed summary is similar to the summary in Notes, but often not what the user wants to emphasize.

Gemini on the Phone

The Galaxy S24 series is the first smartphone equipped with Gemini Pro and Imagen 2.

With Gemini Pro, users can seamlessly operate various types of information, including text, code, images, and videos.

Users can use the summary function across Samsung's native applications (Notes, Voice Recorder, and Keyboard) to enhance the overall user experience, while also enjoying the security, privacy, and data compliance brought by Google Cloud.

Additionally, benefiting from Google's Text-to-Image Diffusion technology Imagen 2, users can achieve secure and intuitive photo editing using features like Generative Edit 2 in the Gallery app.

Another interesting piece of news is that as part of this collaboration, Samsung has become one of the first companies to test Gemini Ultra.

—As the oversized cup of the Gemini series, the performance of Ultra is worth looking forward to.

Furthermore, the S24 series can run Gemini Nano locally (supporting some Android 14 devices), improving the efficiency of on-device tasks.

Samsung stated that artificial intelligence has optimized almost all experiences of the Galaxy S24 series, from intelligent text and call translation (enabling barrier-free communication), to maximizing creative freedom using Galaxy's ProVisual engine, and setting new search standards, which will change the way Galaxy users discover the world around them.

Reference: https://techcrunch.com/2024/01/17/google-introduces-circle-to-search-a-new-way-to-search-from-anywhere-on-android-using-gestures/

免责声明：本文章仅代表作者个人观点，不代表本平台的立场和观点。本文章仅供信息分享，不构成对任何人的任何投资建议。用户与作者之间的任何争议，与本平台无关。如网页中刊载的文章或图片涉及侵权，请提供相关的权利证明和身份证明发送邮件到support@aicoin.com，本平台相关工作人员将会进行核查。