{"id":40976,"date":"2023-10-31T16:17:56","date_gmt":"2023-10-31T20:17:56","guid":{"rendered":"https:\/\/mjtsai.com\/blog\/?p=40976"},"modified":"2024-05-09T10:13:50","modified_gmt":"2024-05-09T14:13:50","slug":"apple-m3-m3-pro-and-m3-max","status":"publish","type":"post","link":"https:\/\/mjtsai.com\/blog\/2023\/10\/31\/apple-m3-m3-pro-and-m3-max\/","title":{"rendered":"Apple M3, M3 Pro, and M3 Max"},"content":{"rendered":"

Apple<\/a> (Hacker News<\/a>):<\/p>\n

\n

These are the first personal computer chips built using the industry-leading 3-nanometer process technology, allowing more transistors to be packed into a smaller space and improving speed and efficiency.<\/p>\n

[…]<\/p>\n

The M3 family of chips features a next-generation GPU that represents the biggest leap forward in graphics architecture ever for Apple silicon. The GPU is faster and more efficient, and introduces a new technology called Dynamic Caching, while bringing new rendering features like hardware-accelerated ray tracing and mesh shading to Mac for the first time. Rendering speeds are now up to 2.5x faster than on the M1 family of chips. The CPU performance cores and efficiency cores are 30 percent and 50 percent faster than those in M1, respectively, and the Neural Engine is 60 percent faster than the Neural Engine in the M1 family of chips. And, a new media engine now includes support for AV1 decode, providing more efficient and high-quality video experiences from streaming services.<\/p>\n

[…]<\/p>\n

Additionally, support for up to 128GB of memory unlocks workflows previously not possible on a laptop, such as AI developers working with even larger transformer models with billions of parameters.<\/p>\n<\/blockquote>\n\n

Tim Hardwick<\/a>:<\/p>\n

However, looking at Apple’s own hardware specifications, the M3 Pro system on a chip (SoC) features 150GB\/s memory bandwidth, compared to 200GB\/s on the earlier M1 Pro and M2 Pro. As for the M3 Max, Apple says it is capable of “up to 400GB\/s.”<\/p>

[…]<\/p>

Notably, Apple has also changed the core ratios of the higher-tier M3 Pro chip compared to its direct predecessor. The M3 Pro with 12-core CPU has 6 performance cores (versus 8 performance cores on the 12-core M2 Pro) and 6 efficiency cores (versus 4 efficiency cores on the 12-core M2 Pro), while the GPU has 18 cores (versus 19 on the equivalent M2 Pro chip).<\/p>

[…]<\/p>

According to Apple, the M3 Neural Engine is capable of 18 TOPS, whereas the A17 Pro Neural Engine is capable of 35 TOPS.<\/p>

[…]<\/p>

Taken together, it’s presently unclear what real-world difference these changes make to M3 performance when pitted against Apple’s equivalent precursor chips in various usage scenarios[…]<\/p><\/blockquote>\n\n

Phil Dennis-Jordan<\/a>:<\/p>\n

\n

So the M3 Pro is basically a 50% scaled-up M3: unlike the M2 Pro it doesn’t have double the memory channels, “only” half again.<\/p>\n<\/blockquote>\n\n

Jeff C.<\/a>:<\/p>\n

\n

It seems that they’re doing a bit more this generation to differentiate between Pro and Max.<\/p>\n<\/blockquote>\n

Previously, the Pro and Max had the same number of CPU cores, so I never had any interest in the Max once I realized that my work fit into the Pro’s RAM ceiling. Now, the Pro’s CPU core advantage over the base chip has been cut in half. To get double the cores of the M3 you need the M3 Max.<\/p>\n\n

Om Malik<\/a>:<\/p>\n

\n

The new M3 chips are coming at an opportune time — Apple’s rivals, Qualcomm, Nvidia, AMD, and Intel, have been making noises about catching up with Apple. […] Qualcomm recently announced the Snapdragon X<\/a>, a PC chip that it says is better than the M2 processor. Nvidia, too, is working on its own chip, as is AMD. All three companies are using Arm’s technology. Intel, on the other hand, is moving forward with its own technologies.<\/p>\n

[…]<\/p>\n

How caching is implemented varies based on the intended use — whether it be for gaming, professional graphics, or data center applications. NVIDIA, for example, employs various forms of cache<\/a>, including L1\/L2 caches and shared memory, which are dynamically managed to optimize performance and efficiency. AMD uses large L3 caches (“Infinity Cache<\/a>”) to boost bandwidth and reduce latency — an approach beneficial for gaming. Intel’s Xe graphics architecture focuses on smart caching, balancing power efficiency and performance.<\/p>\n

[…]<\/p>\n

Apple has a substantial opportunity to integrate generative AI into its core platform, mainly because of its chip and hardware-level integration.<\/p>\n<\/blockquote>\n\n

Previously:<\/p>\n