Although a significant range of new technologies were showcased at these events, the main focus of all of them was the application of artificial intelligence in mobile phones, laptops, and computers. First of all, mobile phones were introduced and offered features and capabilities of artificial intelligence, but the idea of ​​CPUs equipped with artificial intelligence in laptops and personal computers drives our minds to the endless possibilities of this amazing technology.

This expectation is probably somewhat misleading, or at least premature. As we have seen in recent technology exhibitions, many companies put forward ideas that are not clear on what benefits and advantages it has for the end user. Currently, companies such as Intel, AMD, and Nvidia have shown that they are focused on developing AI-centric hardware by adding a Neural Network Processing Unit (NPU) to their latest processors.

However, the experts’ questions about what special features these processors have and what they do are met with vague answers. Companies often point to things that may be possible in the future but do not have immediate, tangible user-centric benefits. Follow us in this article to get a better view of artificial intelligence PCs and their role in the future of technology.

An artificial intelligence PC (AI PC) can be considered a supercharged personal computer that has the right hardware and software to perform professional tasks based on artificial intelligence and machine learning. In fact, the main story revolves around the mathematical calculations of engineering sciences, data cleaning and sifting, and the power required to perform machine learning and artificial intelligence tasks.

These tasks cover a wide range of generative AI application workloads such as stable diffusion, intelligent chatbots with local language models, comprehensive data analysis, training AI models, running complex simulations, and AI-based applications.

In addition to powerful CPUs and GPUs, as well as ample RAM and fast storage options, AI computers are equipped with a new piece of hardware: the NPU, or Neural Processing Unit, which is specifically designed to perform AI turbocharging tasks.

Therefore, the main goal is to build and develop systems that are faster and more efficient in performing artificial intelligence tasks and are optimized in terms of energy consumption; In other words, systems that no longer need to send data, especially sensitive data, to AI cloud servers for processing. Thus, by having an artificial intelligence PC, the user can be sure that his system is able to work independently of the Internet and increase his security by storing and processing data locally.

Read more: iPhone, left behind the field of AI

The Neural Processing Unit (NPU) is a specialized processor developed to handle the heavy tasks of artificial intelligence that were previously assigned to the graphics card.

Current GPUs can handle AI workloads, but they require a lot of energy and effort. For us users, laptop battery life is often very important, and high pressure on the graphics card is not a desirable element. Even on the desktop, running programs becomes slow and causes a lot of trouble.

Of course, NPUs still cannot take full control of such tasks from the GPU. The current performance of the neural processing unit and graphics card is more like mutual cooperation: they work in tandem to reduce processing time while limiting power consumption.

Thus, NPU offers users a smoother workflow along with CPU and GPU. Also keep in mind that an NPU works similarly to platforms like ChatGPT and DALL-E, with the important difference that it has its datasets, algorithms, and language models locally on-chip, while ChatGPT and DALL-E have to process Data requires cloud servers.

PCs aren’t the only devices getting AI hardware and software updates. Almost all flagship laptops that will enter the market this year are equipped with one type of NPU. Smartphones are no exception to this rule, and as we have seen, Samsung presented the Galaxy S24 series with a variety of features such as artificial intelligence-based transcription and translation tools, as well as AI content generation tools for editing images and videos.

As expected, the tech giants have a strong presence in the artificial intelligence PC market. Intel and AMD have released chips with AI cores in the Core Ultra and Ryzen 8000G series, respectively. Nvidia has also developed suitable artificial intelligence features in the Geforce and RTX graphics card lines.

The NPUs in these chips take over part of the workload of artificial intelligence; Including AI effects in video calls and video production, improved multitasking capabilities with AI accelerator software, as well as AI assistants.

However, Intel and AMD have not been pioneers in the field of NPUs. In 2020, when Apple ditched Intel and unveiled its own line of M-series processors, these chips used “neural engine” NPUs.

But the beginning of the story goes back a few years before this. In September 2017, Apple unveiled the A11 Bionic chip for the iPhone, which was considered the first chip with a neural engine. Some Qualcomm Snapdragon mobile processors were also equipped with neural engines in 2018.

Intel and AMD are not considered to be the first NPU manufacturers, but they will undoubtedly be more influential in changing the scene of this game than any other company.

NPU performance is measured in TOPS, which means trillions of operations per second, and this metric is likely to become the true measure of a neural processing unit.

Intel’s Vice President of Client Computing Group, Todd Lehlen, said that running Microsoft’s CoPilot artificial intelligence service locally and not in the cloud requires an NPU with a minimum performance of 40 tops.

Qualcomm is likely to launch its Snapdragon X Elite chips this year, which will use the company’s 12-core NPUs with 45 tops of performance.

The question that is most in the minds of users is what artificial intelligence PCs are supposed to do for us.

In the early days of the release of these systems, it was not easy to distinguish them from ordinary PCs; Because all computers have access to artificial intelligence programs on the Internet. The main turning point of AI PCs is that they process information locally and do not need an internet connection to benefit from AI software.

Tech companies usually focus on the following features and capabilities to promote AI PCs:

• Text-to-image conversion programs
• AI-based security features for the device
• Intelligent battery management
• Improve photo and video editing capabilities
• Artificial intelligence assistant for writing, coding, autocorrection, and prediction of texts

Most of these features initially require constant internet access, but some apps, such as the AI ​​assistant, can also be used offline.

The current idea of ​​AI PCs is to use artificial intelligence to accelerate and optimize programs on the computer and a set of features to improve everyday use. This idea will be useful for some specific applications, but it cannot be called revolutionary by any means. It seems that we will see the true potential of this new technology in the future.

Nothing motivates businesses and consumers to upgrade their hardware like a new version of Windows. For this reason, PC manufacturers hope that Windows 12 will be the lever that will lead to a big explosion in sales of artificial intelligence PCs.

If some of the rumors come true, artificial intelligence will be the cornerstone of the new version of Windows. Microsoft is likely to offer Windows Copilot with more features than BingChat, the company’s former AI-focused assistant, and the gap between Windows and Mac OS in terms of AI processing is gradually narrowing.

The difference between artificial intelligence software and classic software is in how they process the work you ask them to do. A typical application only provides users with predefined tools, something like specialized tools in a mechanic’s toolbox.

You have to learn the best way to use them, and in order to achieve the highest productivity, you need your own personal experience in using them. In fact, every step of the way, it’s all up to you.

In contrast, AI software can learn by itself, make decisions, and perform complex creative tasks like humans. The ability to learn changes the software model, because the AI ​​program does the work at your request, the way you asked.

This fundamental difference allows AI software to automate complex tasks, or provide personalized experiences. In addition, vast amounts of data will be processed more efficiently and the way we interact with our computers will change.

But the artificial intelligence software is trained with millions of images of similar landscapes and can “imagine” what the beach looks like without crowds. So instead of using different image editing software, you just click a button and suddenly all the parts that took hours to edit will be deleted.

This example is probably familiar to you and you have seen examples of such functionality in new smartphones. Now imagine when you work with your personal computer, almost all the software works with the same routine according to your wishes. This picture is the long-term horizon of artificial intelligence PCs.

According to Robert Halog, Intel’s director of artificial intelligence, AI software follows different algorithms and runs differently on CPUs. He says:

I recently witnessed an AI create an entire PowerPoint out of nothing. There was no need to tell the program how many slides we needed and in what order, or to specify how to lay them out and break them up into smaller sections. AI takes a blank page from you and delivers what you need for the project.

Lenovo is one of the companies that play a significant role in the market of artificial intelligence systems. Almost all of the company’s AI systems are developed in collaboration with AMD. Robert Herman, Lenovo’s vice president of business, says:

First of all, Workstation is an artificial intelligence PC that uses a powerful GPU. In addition, the in-system processor and processor-enhanced memory are all building blocks for developing artificial intelligence and directing its operations.

According to Herman, since 2017, Lenovo has expanded the workstation team to work with the AI ​​client side, and since then, it has gradually expanded its way into more customer-friendly products. He emphasizes that we will soon see NPUs and AI engines in personal computers that are perfectly suitable for everyday use.

Jason Banta, head of AMD’s PC OEM division, also acknowledged in an interview that Lenovo was the leader in introducing hardware products that have neural processors and artificial intelligence systems at this year’s CES. He also said:

We’re bringing millions of AI PCs to market, and luckily you’re now seeing developers trying to better understand these products. They want to understand how this technology works on a personal level with their applications and improves their programs.

Banta had said some time ago that artificial intelligence PCs are the revolution of the technology world after the introduction of the graphical interface. According to him, Lenovo’s cooperation with big partners like Microsoft will be a big step in the development of artificial intelligence hardware and software. At the same time, the interest and acceptance of other software developers to learn new AI systems will accelerate the growth of this market.

Qualcomm’s VP of Engineering, Ain Shivnan, at the Snapdragon Summit in October, called the next step in personal computing changes in how hardware is used to provide completely new and more personalized AI experiences to consumers. Satya Nadella, the CEO of Microsoft, also pointed out that high-scale artificial intelligence applications rely on both cloud processing and personal computers:

We will have literally tons of applications and programs, some of which will use local processing models and some will use hybrid models. I think this is the future of artificial intelligence.

Business trends research company Gartner has announced that artificial intelligence personal computers will take about 43% of the PC market by 2025, and this figure will reach 60% by 2027. Regardless of the extent to which the above estimates come true, the most important companies involved in the construction of AI hardware are:

At the beginning of 2023, when the value of the Nvidia company exceeded one trillion dollars, this technology giant became one of the main players in the artificial intelligence hardware market. Nvidia has released the A100 chip and the Volta GPU graphics processor specifically for data centers and announced its readiness to produce hardware equipped with artificial intelligence for the gaming sector.

Last August, this company introduced its newest product, which uses the HBM3e processor, to the world of technology: the Grace Hopper platform, which has three times the bandwidth and memory capacity of current Superchips.

And finally, Nvidia’s NVLink technology can connect the Grace Hopper super chip to other chips. This technology enables multiple GPUs to communicate with each other through a high-speed connection.

Intel

Intel has achieved a great position in the CPU market with its artificial intelligence products, and this has caused many competitors to accuse this company of monopoly in the field of AI. Although Intel has not overtaken Nvidia in GPUs, the company’s CPUs handle about 70 percent of the world’s data center inference.

As of last fall, Intel had worked with 100 independent software vendors on more than 300 AI-accelerated features to improve PC experiences in audio effects, content creation, gaming, security, streaming, video collaboration, and more.

After the introduction of Core Ultra processors in December, it was announced that this leading product will be used in the design of more than 230 series of laptops. The most important advantages of Intel in the field of artificial intelligence PCs are software activation, scalability, and immediate availability of products.

Alphabet

Google’s parent company offers a variety of products for mobile devices, data storage, and cloud infrastructure. The company has developed Cloud TPU v5e for large language models and generative artificial intelligence, which performs data processing five times faster at half the cost of the previous generation.

Now Alphabet is focused on producing powerful artificial intelligence chips to meet the demand of large projects. In addition, the company has also unveiled Multislice performance scaling technology. The fourth edition of Alphabet TPUs improves floating-point operations by up to 60% in multibillion-parameter models.

Apple

Apple’s chip-based specialized cores, known as Neural Engines, have advanced the design and performance of the company’s AI hardware. This technology was first used in the M1 chips of MacBooks and made the general performance of laptops 3.5 times faster and their graphic performance five times faster than the previous generation.

The success of Apple’s M1 chip led to the introduction of the M2 and M3 series, which benefited from more powerful cores and much better graphics performance.

IBM

After the success of its first specialized artificial intelligence chip, Telum, IBM decided to design a powerful successor to compete with other companies in the artificial intelligence market. This company launched a new specialized department called the Artificial Intelligence Unit in 2022, and its first AI chip uses more than 23 billion transistors and 32 processing cores.

One of the most important differentiators of IBM’s AI vision is that instead of focusing on GPUs, it has shifted to producing mixed-signal analog chips, with improved energy efficiency and competitive performance.

Qualcomm

Although Qualcomm has been a newer and relatively late entrant to the AI ​​hardware market compared to the other competitors we mentioned, its experience in the telecommunications and mobile phone sectors makes the company a serious player in the AI ​​hardware scene.

Qualcomm’s Cloud AI 100 chip beat the Nvidia H100 in a series of benchmarks . In one of these tests, it was found that the Qualcomm chip responded to 227 requests from the data center server per watt, while this number reached 100 requests for the Nvidia chip. In the “object detection” test, the Cloud AI 100 chip managed to prove its superiority to the H100 by responding to 3.8 requests per watt with a rate of 2.4 requests per watt.

Amazon

Amazon shifted its focus somewhat from cloud infrastructure to chips in order to maintain its stock value and technology market share.

For example, the company developed Elastic Compute Cloud Trn1s virtual servers specifically for deep learning and generative AI models. Said servers use the Trainium chip, which is a kind of artificial intelligence accelerator.

The first version of Amazon’s Trn1.2xlarge machine learning instance uses a network bandwidth of 12.5 gigabytes per second and a 32-gigabyte memory instance. The new version of this chip was also released with the name trn1.32xlarge, which has 16 accelerators, 521 GB of memory, and a bandwidth of 1,600 GB per second.

With all the hype surrounding AI these days, it’s no surprise that chipmakers are scrambling to implement AI into their products as quickly as possible before consumer interest wanes.

There’s no doubt that adding NPUs to processors will bring amazing benefits to end users in the long run, but the early waves of AI PCs mostly benefited from trends that hit the mainstream.

Of course, this issue was also true at the beginning of the release of JPT chat and other artificial intelligence tools. AI chatbots at the beginning seemed more hype than practicality; But as their meaning was more widely and deeply understood, they also became more powerful tools.

Currently, NPUs are not considered a vital and extraordinary element for personal computers. They simply speed up what you’re currently doing with your computer and make programs more efficient, but they don’t change the playing field by themselves. The advancement and ubiquity of AI PCs seem to be in the hands of developers who must use this new chip architecture to create innovative software that brings tangible value to consumers.

Perhaps in the future, when applications bring artificial intelligence to their platforms and new technologies are developed focusing on this technology, there will be a greater difference between normal computers and artificial intelligence PCs.

If you have had a Galaxy Fit 2 and want to stay in the Samsung ecosystem at a much higher cost than Chinese smart bands, you will not regret buying the Galaxy Fit 3; But I don’t think many people are going to upgrade now. You probably either want to know which one to choose for your first smartwatch, between the Fit 3 and the Xiaomi Smart Band 8, or you want to know if you can spend more than half the price of the Galaxy Watch 6 and get all the features and functions that make this watch one of the best. Has the market smartwatch become accessible or not?

Before we go to the features, let me tell you about the feel of the Galaxy Fit 3. Samsung’s new smart band with an aluminum body weighing only 18.5 grams is very light, comfortable, and well-made, and although it has relatively large dimensions, it fits well on narrow wrists.

The Fit 3 silicone strap, which you can get in three colors, black, white, and rose gold, is very soft and high-quality, and it has changed from the previous generation’s integrated mode, where the screen was placed inside, to a more standard two-piece model. Fastening the strap and connecting it to the wristband is done easily; Perhaps the only fault that can be found is that there are not enough holes on the strap to firmly fasten the body on narrow wrists.

Having said that, if you are the type of person who wants to monitor your health status 24 hours a day, even while you sleep, the Galaxy Fit 3 is a more logical choice of watch, because apart from the lower price (albeit at the expense of fewer features), it is smaller and weighs less. Almost half of the Galaxy Watch 6; So it won’t bother you when you sleep.

In addition, Galaxy Fit 3 benefits from the highest certificate of resistance against dust penetration (IP68) and resistance up to 5-atmosphere pressure (50 meters depth) against water penetration so that you can easily use it to record information related to swimming in the pool.

Like the previous two generations, Galaxy Fit 3 uses the open-source operating system FreeRTOS, which can be considered a lighter and simpler version of WearOS. Samsung has preferred using FreeRTOS for its smartwatch because cheaper and less powerful chips can handle it well and do not lag. In addition, the life of the battery increased many times; Fit 3’s battery lasted about a week in my daily use, while continuous monitoring of heart rate, stress, and sleep was active, but Always-on was disabled, and I spent 30 minutes exercising and 15 minutes checking the time and notifications. With a day or two of charging, the Galaxy Watch 6 is fantastic.

The FreeRTOS user interface is similar to WearOS in many ways, and even the application icons are almost the same; But unlike WearOS, it does not support Google Play and the ability to install external applications, and you have to go with the same default apps; including health application, music control, phone finder, weather, calendar, timer, alarm, stopwatch, world clock, calculator and camera shutter control. Galaxy Fit 3 has almost all smartband applications; However, the possibility of downloading favorite applications may not be pleasant for some users.

Leaving aside the limitation of FreeRTOS in installing applications, during the time I was testing the Galaxy Fit 3, the operating system performed very smoothly and even appeared as good as the Galaxy Watch 6. Fit 3’s user interface is also very simple and straightforward. By pressing the physical home button once, you will return to the main screen. Pressing the button twice will open the list of workouts, where you can choose another application for this command from the Advanced Feature section of the smartband settings.

Unfortunately, on the Galaxy Fit 3, unlike the Galaxy Watch, there is no possibility to reply to a message, and at best, you can only send predefined replies, which are not very useful. I think it’s time for sending messages from smart watches and wristbands to become a standard, not to remain exclusive to luxury devices.

Galaxy Fit 3 does not lack in the watch face department; From the Wearable application, you can access more than a hundred watch faces with various designs and colors. If none of the watch faces catch your eye, you can use your favorite images and edit them with the application’s tools, and even change the color of the time display for better readability on any background. Samsung also lets you switch between watchfaces you’ve created by saving multiple images in the Watchfaces section and tapping on the Fit 3’s home screen.

Galaxy Fit 3 has almost all the health and sports features of Galaxy Watch 6 (except ECG and irregular heart rate measurement, which is not available in Iran), but in some features, it shows different accuracy; For example, in the heart rate test, the Fit 3 was about 5% different from the Watch 6. While I was sleeping, with both devices strapped to my wrist, the Galaxy Watch 6 reported that the blood oxygen level dropped below 90%, but the Fit 3 reported everything as normal. In the stress test, Watch 6 showed a slightly lower stress level.

Galaxy Fit 3 has over a hundred workouts to cover almost any sport you want. For some sports activities, including walking, running, elliptical, and swimming, which have just been added, it has an automatic detection mode so that if you forget to start the workout, the smart band will start the corresponding workout after a few minutes. Fit 3’s pedometer was also about 10 steps different from reality and is generally accurate.

By activating Emergency SOS and selecting a person as an emergency contact, you can send your location to this person by pressing the button 5 times. If you have already entered your medical information, it will be displayed on the screen of the smart band.

The Galaxy Fit 3 is now equipped with an ambient light sensor to adjust the screen brightness according to the environment. Samsung hasn’t announced the Fit 3’s maximum brightness, but it seems to be around the 600 nits we’d expect from this price range.

Samsung’s new smart band uses two interesting features in the security department that may come in handy; First, you can choose a pin code for it; As long as the smart band is on your wrist, you don’t need to enter a passcode, but as soon as you remove it from your wrist, the device is locked and a PIN code is required to unlock it.

The second feature, which is enabled by default, prevents the display of notifications as long as the smartband is not attached to your wrist. For example, if you put the Galaxy Fit 3 on the table and leave it behind the table, another person cannot read the messages; Of course, if you notice that the notifications are not displayed even when you wear the smartband on your wrist, disable this feature from the security section, because there is probably an interference between the skin of your hand and the sensor.

So far, we talked about the features and capabilities that seem to put the Galaxy Fit 3 almost at the level of the Galaxy Watch 6; But the Samsung Smartband lacks some of the basic functions of the Galaxy Watch, including built-in GPS, speaker, and microphone for answering calls, sending replies to messages, installing additional applications from Google Play, Wi-Fi connectivity and LTE options, and models with different sizes to better fit the size of the watch. Different wrists. In terms of appearance, the Galaxy Watch has a more luxurious and attractive design and is more similar to a classic watch.

Considering the differences, the Galaxy Fit 3 cannot be considered a replacement for the Galaxy Watch 6. If answering calls and messages, internal GPS, installing applications and the classic appearance of the watch is not your priority, and at the same time you want the device to be attached to your wrist all the time, the battery life is satisfactory, and to spend half the price of the Galaxy Watch, the Galaxy Fit 3 at a price of about 4 4.5 million tomans is a more appropriate choice in the Iranian market; But if you don’t care about staying in the Samsung ecosystem and a bigger screen, and you just want to get a smart band for your Android phone with all the health and sports features, including swimming, the Xiaomi Smart Band 8 with a price of around 1.5 to 2 million Tomans seems like an attractive option. .