Karachi, August 24, 2023 – MediaTek, a global leader in fabless semiconductor technology, has announced a strategic partnership with Meta’s Llama 2, the next-generation open-source Large Language Model (LLM).
This collaboration aims to revolutionize the development of Artificial Intelligence (AI) applications on edge devices, including smartphones, Internet of Things (IoT) devices, vehicles, and smart homes.
MediaTek, renowned for powering more than two billion connected edge devices annually, intends to leverage Meta’s Llama 2 in conjunction with MediaTek’s cutting-edge Application Processing Units (APUs) and NeuroPilot AI Platform. The goal is to establish a comprehensive edge computing ecosystem, specifically tailored to accelerate AI application development in the aforementioned domains.
READ MORE: Updated price of Samsung Galaxy S23 from Aug 25
Traditionally, Generative AI processing primarily occurs in the cloud. However, MediaTek’s utilization of Llama 2 models will enable the execution of Generative AI applications directly on edge devices. This approach offers several advantages to both developers and end-users, including:
Seamless Performance: On-device AI applications provide smoother performance.
Enhanced Privacy: Sensitive data remains on the device, bolstering user privacy.
Improved Security and Reliability: Reduced reliance on external servers enhances security and system reliability.
Lower Latency: Real-time processing with minimal delays.
Offline Functionality: Functions in areas with limited or no connectivity.
Increased price of Oppo F21 Pro 5G from Aug 25
Reduced Operation Costs: Decreased dependence on cloud resources leads to cost savings.
To fully harness on-device Generative AI technology, manufacturers of edge devices will need high-performance, low-power AI processors and faster, more dependable connectivity. MediaTek is already equipping its 5G smartphone System-on-Chips (SoCs) with APUs capable of handling various Generative AI features, including AI Noise Reduction, AI Super Resolution, and AI MEMC.
Moreover, MediaTek’s upcoming flagship chipset, slated for release later this year, will boast a software stack optimized for running Llama 2 models. It will feature an upgraded APU with Transformer backbone acceleration, reduced memory footprint, and more efficient use of DRAM bandwidth. These enhancements will significantly elevate the performance of Large Language Models (LLMs) and AI Generative Computing (AIGC), accelerating the development of on-device Generative AI use cases.
Latest price of Samsung Galaxy S22 Ultra from Aug 25
JC Hsu, Corporate Senior Vice President and General Manager of the Wireless Communications Business Unit at MediaTek, commented, “The increasing popularity of Generative AI is a significant trend in digital transformation, and our vision is to provide the exciting community of Llama 2 developers and users with the tools needed to fully innovate in the AI space. Through our partnership with Meta, we can deliver hardware and software with far more capability at the edge than ever before.”
MediaTek anticipates that Llama 2-based AI applications will be available on smartphones powered by the next-generation flagship SoC, scheduled for release by the end of the year. This collaboration marks a significant stride toward bringing the power of AI directly to consumers’ fingertips while maintaining their data privacy and device performance.
