Tiny but mighty: The Phi-3 small language models with big potential

Sometimes applying a child's perspective to a complex situation can yield the best solution.  

Microsoft researchers discovered a way to fit more power into a much smaller compact, and that's the lesson they learnt.  

Last year, Ronen Eldan of Microsoft was reading bedtime stories to his daughter after spending his morning brainstorming answers to machine learning puzzles. He wondered, to himself,   

how did she learn this word? How does she understand the meaning of these words?   

That made the machine learning specialist at Microsoft Research wonder how much an AI model could learn with just words that a 4-year-old could understand.   

This curiosity eventually led to the development of a novel training strategy that has created a new class of more powerful small language models,  

which holds the potential to increase the accessibility of AI for a wider range of users.  

With AI, large language models (LLMs) have opened up fascinating new possibilities for increased productivity and creativity.    

Select Red Wings eliminated from playoff race despite comeback victory against CanadiensRed Wings eliminated from playoff race despite comeback victory against Canadiens 

Thanks For Watching

Read More :