Microsoft recently unveiled Phi-3, a groundbreaking series of small language models (SLMs) designed to be smaller and more efficient than traditional AI models. This is a significant development with the potential to democratize AI by making it more accessible to a wider range of users. Here’s what Phi-3 brings to the table:
Microsoft introduce Phi-3, a family of open AI models developed by Microsoft. These models redefine what’s possible with small language models (SLMs), offering unparalleled capabilities and cost-effectiveness.
A New Era in AI Models
A groundbreaking family of open AI models developed by Microsoft. These models redefine what’s possible with small language models (SLMs), offering unparalleled capabilities and cost-effectiveness. Let’s dive into the details of this exciting development.
Phi-3 Models: The Power of Small
1. Phi-3-mini: A 3.8B Language Model
- Context-Length Variants: Phi-3-mini is available in two context-length variants—4K and 128K tokens.
- Instruction-Tuned: Phi-3-mini is trained to follow different types of instructions, making it ready to use out-of-the-box.
- Optimized for ONNX Runtime: It supports Windows DirectML and offers cross-platform compatibility across GPU, CPU, and even mobile hardware.
- NVIDIA NIM Microservice: Phi-3-mini is available as an NVIDIA NIM microservice with a standard API interface that can be deployed anywhere.
2. Performance Metrics
- Phi-3 models significantly outperform language models of the same and larger sizes on key benchmarks:
- Massive Multitask Language Understanding (MMLU): Phi-3-mini scores an impressive 69%, showcasing its versatility across various language tasks.
- Phi-3-mini does better than models twice its size, and Phi-3-small and Phi-3-medium outperform much larger models, including GPT-3.5T.
3. Safety-First Model Design
- Responsible AI principles guide the development of Phi-3 models, ensuring ethical and safe usage.
Availability and Future Developments
- Phi-3-mini is now available on Microsoft Azure AI Studio, Hugging Face, and Ollama.
- Additional models, including Phi-3-small (7B) and Phi-3-medium (14B), will be added to the Phi-3 family in the coming weeks.
- Microsoft continues to offer the best models across the quality-cost curve, and Phi-3 expands the selection of state-of-the-art small models.
Final Words
Phi-3 represents a leap forward in AI model design, combining groundbreaking performance with a compact size. As we celebrate 20 years of innovation, Phi-3 opens up new possibilities for generative AI applications. Explore Phi-3-mini on Azure AI Studio and witness the future of AI.