
ãéå ±ãKimi K3ããœãŒã¹ã³ãŒããå ¬é
ã®ç¶å ±ã§ãã
ã¯ããã«ïŒAIçã«ãŸãããŠãã倧æ¿éããèµ°ã£ã
ã2026幎7æ27æ¥ãAIã®æŽå²ã«ããŸãäžã€æ°ãããã€ã«ã¹ããŒã³ãå»ãŸããŸããã
ãäžåœã®æåAIã¹ã¿ãŒãã¢ãããMoonshot AIïŒæä¹æé¢ïŒãããäžçæé«å³°ã®æ§èœãèªãè¶ å·šå€§AIãKimi K3ãã®ãœãŒã¹ã³ãŒãïŒã¢ãã«ãŠã§ã€ãïŒãçªåŠãå®å šç¡æã»åçšå©çšå¯èœãªã©ã€ã»ã³ã¹ã§äžè¬å ¬éããã®ã§ãã
ããŸãæ°ããAIãåºãã ãã§ããïŒã
ãã©ããäžè¬äººã«ã¯é¢ä¿ãªãããšã³ãžãã¢åãã®è©±ã§ããïŒã
ãããæã£ãæ¹ã«ããããã®èšäºãèªãã§ã»ããã®ã§ããä»åã®å ¬éã¯ãåãªããæè¡ã®çºè¡šãã§ã¯ãããŸãããç±³åœã®GPT-5ã¯ã©ã¹ã«å¹æµãããè¶ ãçŽã®æªç©AIãã®è³ã¿ãã®äžèº«ãããã®ãŸãŸäžžè£žã«ãªã£ãŠäžçã«å·®ãåºãããããšãæå³ããŠããŸãã
ãªããäžçäžã®ãšã³ãžãã¢ããããŸã§å€§éšãããŠããã®ãïŒ
ãçç±ã¯ã·ã³ãã«ã§ãã
ãå
¬éãããã³ãŒããèªã¿è§£ããšãããã«ã¯ããããŸã§ã®AIã®åžžèãã²ã£ããè¿ããå·å¿µãšãèšãã3ã€ã®å€§çºæããé ãããŠããããã§ãã
2.8å ãã©ã¡ãŒã¿ãšããåãç©ãµã€ãºãªã®ã«ãçéãã€çãšãã§åãè¬
100äžæåã®è¶ é·æãèªãŸããŠãããµãŒããŒãæ²é³Žãäžããªãã«ã©ã¯ãª
AIããèªåã§ç»é¢ãèŠãŠãã°ãçŽãããšãããæããã匷ååŠç¿ã®è£åŽ
ãä»åã®æè¡å ¬éã«ãã£ãŠãAIã®é²åã¯ããã è³¢ããç«¶ããã§ãŒãºãããããã©ãã ãå§åçãªå¹çã§ãèªåŸããŠåããããããšããæ°æä»£ãžçªå ¥ããŸããã
ããã®èšäºã§ã¯ãå ¬éãããã°ããã®æè¡è«æãšãœãŒã¹ã³ãŒããã倿ãããKimi K3ã®ã€ããããäžèº«ãã«ã€ããŠãå°éçšèªãã§ããã ã䜿ãããå³è§£ã亀ããªããäžçäžãããããã解説ããŸãã
ãAIã®æªæ¥ãããããã©ããžåããã®ããäžç·ã«èŠããŠã¿ãŸãããïŒ
2. ãè¡æãç·ãã©ã¡ãŒã¿æ°2.8å ïŒã§ããåãã®ã¯ã16åã®ãšãã¹ããŒããã ã
ããŸããå ¬éããããœãŒã¹ã³ãŒããã確å®ãããäžçªã®ãæªç©ã¹ããã¯ãããã¡ãã§ãã
Kimi K3ã®ç·ãã©ã¡ãŒã¿æ°ã¯ããªããšã2.8å ãã
ãAIã®ããã©ã¡ãŒã¿æ°ããšã¯ã人éã®è³ã§ãããç¥çµçްèïŒã·ããã¹ïŒã®æ°ãã®ãããªãã®ã§ããçŸåšãäžçäžã§åºã䜿ãããŠããæšæºçãªé«æ§èœAIãæ°çŸåãæ°ååèŠæš¡ã§ãããã2.8å ãšããæ°åãããã«èŠæ Œå€ã®å·šäœã§ããããåãããŸãã
ãæ®éãããã ãè³ã¿ãã巚倧ã«ãªããšãåããããã«åœå®¶ã¬ãã«ã®è¶ 巚倧ãªããŒã¿ã»ã³ã¿ãŒãšã倩æåŠçãªé»æ°ä»£ãå¿ èŠã«ãªããŸãããè³¢ãããã©ãéãããŠå®çšåã§ããªããââããããããŸã§ã®è¶ 巚倧AIã®å®¿åœã§ããã
ãããããKimi K3ã¯éããŸããé©ãã»ã©ãçéãã§ãããããçãšããã§åãã®ã§ãã
ãã³ãŒãããæããã«ãªã£ããã®ã«ã©ã¯ãªãããMoEïŒMixture of ExpertsïŒæ··åå°éå®¶ïŒããšããä»çµã¿ã®è¶
é²åç³»ã§ããã
896人ã®å°éå®¶ãéãŸããè¶ å·šå€§ã®ã«ãã
ãKimi K3ã®äžèº«ãäŸãããªããã896人ã®è¶ ãšãªãŒãå°éå®¶ãéãŸã£ã巚倧ãªäŒç€Ÿãã§ãã
ãåŸæ¥ã®AIã¯ãã©ããªç°¡åãªè³ªåã«å¯ŸããŠããå šç€Ÿå¡ïŒ2.8å ãã©ã¡ãŒã¿ïŒããç·åºã§èããŠããŸãããããã§ã¯å¹çãæªãããŸãããã
ã察ããŠKimi K3ã¯ããŠãŒã¶ãŒãã質åãé£ãã§ãããšãAIã®å
¥ãå£ã«ããåžä»€å¡ããã倿ããŸãã
ããããã®è³ªåã¯ãããã³ããšã³ãã®ããã°ã©ãã³ã°ããšããã°ã®æ€ç¥ãã«é¢ãã質åã ãªã
ããããŠã896人ããå°éå®¶ã®äžããããã®åéã«æãç¹åããã16人ïŒ16ãšãã¹ããŒãïŒãã ãããã³ãã€ã³ãã§åŒã³åºãã®ã§ãã
å šäœãµã€ãºïŒ2.8å ãã©ã¡ãŒã¿ïŒ896人ã®å°éå®¶ïŒ
å®éã«åããµã€ãºïŒçŽ1040åãã©ã¡ãŒã¿ïŒéžã°ãã16人 ïŒ åžžæçšŒåãã2人ã®ãŸãšã圹ïŒ
ãã€ãŸããè³ã¿ãã®ç·éã¯2.8å ãšãã倧倩æãªã®ã«ãç§ãã¡ã䜿ããšãã®ãšãã«ã®ãŒãèšç®ã³ã¹ãã¯ããã®30ååã®1以äžïŒ104Bã¯ã©ã¹ïŒã®ãµã€ãºã«ãŸã§ã®ã¥ããšå§çž®ãããŠããããã§ãã
ãä»äºã®æŒãä»ãåããã解決ããæ°çããžãã¯
ãããã»ã©å€§éã®å°éå®¶ïŒ896åïŒãæ±ãããšãæ®éã®AIã§ã¯ãã倧åé¡ãçºçããŸããããã¯ãç¹å®ã®äººæ°ãªå°éå®¶ã ãã«ä»äºãéäžããŠããŸããä»ã®å°éå®¶ãããŒãåããïŒããã«ããã¯åé¡ïŒããšããçŸè±¡ã§ãã
ããããŸã§ã®AIã¯ããã¿ããªå¹³çã«ä»äºãããŠãããšããç¡çãªã«ãŒã«ïŒè£å©æå€±ïŒã課ãããšã§ããã解決ããããšããŠããŸãããããã®ããã§å šäœã®è³¢ããèœã¡ãŠããŸãã®ã匱ç¹ã§ããã
ãããããKimi K3ã®ãœãŒã¹ã³ãŒãããã¯ããQuantile BalancingïŒéååãã©ã³ã·ã³ã°ïŒããšããæ°ããæ°åŠçææ³ãçºèŠãããŸããã
ããã¯ãã«ãŒã«ã§çžãã®ã§ã¯ãªããä»äºã®äº€éæŽçãå®å
šã«èªååãã896åã®ãšãã¹ããŒãã«ããŒã¹ãã¬ã¹ã§åçã«ä»äºãããïŒåé
ïŒããæè¡ã§ãã
ããã®æè¡ã®ãããã§ãKimi K3ã¯ã2.8å ã®é è³ãã®ããã³ã·ã£ã«ã100%åŒãåºããªãããæ¶Œããé¡ãããŠçéã§åçãè¿ããŠããããšãã§ããã®ã§ãã
3. ãçºæãã®1ãã2ã€ã®ã¢ãã³ã·ã§ã³ãã®ãã€ããªããæ§é ãã€ãã
ãKimi K3ã®ãœãŒã¹ã³ãŒããè§£æãããšã³ãžãã¢ãã¡ããæããçŸããïŒããšé©åããã®ãããã®ã¢ãã³ã·ã§ã³ïŒæ³šç®ïŒæ©æ§ã®èšèšã§ãã
ãAIã«é·æïŒæ°äžæåã®æžé¡ããèšå€§ãªããã°ã©ã ã®ã³ãŒãïŒãèªã¿èŸŒãŸãããšãããããŸã§ã®AIã«ã¯èŽåœçãªåŒ±ç¹ããããŸãããããã¯ããæç« ãé·ããªãã°ãªãã»ã©ãèšç®éãéªã ããŸåŒã«èšãäžãããããœã³ã³ããµãŒããŒããã¢ããã¢ãã«ããªãŒãºããŠããŸãããšããåé¡ã§ãã
ãKimi K3ã¯ããªããšã100äžããŒã¯ã³ïŒæ¬ã«ãããšæ°ååãã³ãŒããªãæ°äžè¡ïŒãã®é·æãäžåºŠã«é£²ã¿èŸŒããŸããããããåŠçã³ã¹ãã¯åŸæ¥ã®æå€§6åã®1ã
ããªããããªéæ³ã®ãããªç䌌ãã§ããã®ãïŒ
ãã³ãŒãããèŠã€ãã£ãã®ã¯ãæ§è³ªã®éã2ã€ã®è³åè·¯ãã3ïŒ1ãã®é»éæ¯çã§çµã¿åããããšããããŸã£ããæ°ããäºåæµã®ãã€ããªããæ§é ã§ããã
â æ®æ®µã®ã¡ã¢åœ¹ïŒãKDAïŒKimi Delta AttentionïŒãã69å±€
ãKimi K3ã®è³ã¿ãã®å€§åïŒ69ã®ã¬ã€ã€ãŒïŒãå ããŠããã®ããæ°éçºããããKDAããšããä»çµã¿ã§ãã
ãããã人éã«äŸãããªããã話ãèããªãããç®ãŸããããããŒããèŠçŽããŠããè¶ åªç§ãªæžèšãã§ãã
ãåŸæ¥ã®AIã¯ã1äžæåç®ãèªããšãã«ãã1æåç®ããã®ãã¹ãŠã®æåãæçŽã«èŠè¿ããŠèšç®ããŠããŸããïŒãã«ã¢ãã³ã·ã§ã³ïŒãããã§ã¯é·æã«ãªãã»ã©è³ããã³ã¯ããŸãã
ãäžæ¹ãKDAã¯ãéå»ã®æµããã®ã¥ããš1åã®ã¹ããŒããªããŒãïŒåçã¡ã¢ãªïŒã«ãŸãšããæ°ãã話ãèããã³ã«ãã®ããŒããäžæžãæŽæ°ããŠããããšããææ³ïŒç·åœ¢ã¢ãã³ã·ã§ã³ïŒããšã£ãŠããŸãã
ãããã«ãããã©ãã ãé·ãæç« ãèªãŸããŠããèšç®ã®éãããã£ãšäžå®ã«ããŒããããããã«ãªããçéã®åŠçã¹ããŒããå®çŸããŠããŸãã
â¡ ããããšããæã®èŸæžåœ¹ïŒãGated MLAãã24å±€
ããèŠçŽããŒãïŒKDAïŒã ãã ãšã现ããæ°åãã10äžæååã«æžããããã³ãã€ã³ãã®åèªãå¿ãã¡ããããããªãã®ïŒã
ããã®éãã§ããèŠçŽã¯ã¹ããŒããåºãŸããã现ããéšåã®èšæ¶ããã€ããã®ã匱ç¹ã§ããã
ãããã§Kimi K3ã¯ãè³ã¿ãã®åéïŒ24ã®ã¬ã€ã€ãŒïŒã«ãGated MLAããšãããèšæ¶ã®ã»ãŒããã£ããããæã¿èŸŒã¿ãŸããã
ãããã¯ããæ®æ®µã¯éããŠããããã©ãè¶ ç·»å¯ãªæ€çŽ¢ãå¿ èŠã«ãªã£ãç¬éã ããããšéããéå»ãã°ã®å šæ€çŽ¢ã·ã¹ãã ãã§ãã
ã100äžæåã®ç æŒ ã®äžããããã£ã1æ¬ã®éïŒç¹å®ã®ããŒã¿ïŒããæ¢ãåºããããªè¶ é«ç²ŸåºŠãªäœæ¥ã®ãšãã ãããã®Gated MLAãäœåããéå»ã®å šããŒã¿ããã€ã¬ã¯ãã«ã¹ãã£ã³ããŸãã
ãã¹ããŒããªããŒãããšãå®ç§ãªèŸæžãã®äºåæµ
æ®æ®µã®èªã¿èŸŒã¿ïŒKDAïŒããŒã圹ïŒãå§åçãªã¹ããŒãã§åŠç
éèŠãªäŒç·ã®ååïŒGated MLAïŒèŸæžåœ¹ïŒãéå»ãã°ãå®ç§ã«æ€çŽ¢
ããã®2ã€ã粟å¯ã«é£æºããããšã§ãKimi K3ã¯ãã¹ããŒããäžåèœãšããã«ã100äžæåã®èšæ¶ãå®ç§ã«ä¿æããããšããããããŸã§ã®AIãå°éã§ããªãã£ãé åã«éããã®ã§ãã
4. ãçºæãã®2ãæåããã4ãããïŒMXFP4ïŒãã§æé©åãããŠçãŸããŠãã
ãKimi K3ã®ãœãŒã¹ã³ãŒããå ¬éãããéãäžçäžã®ã€ã³ãã©ãšã³ãžãã¢ãæãé©ãããã€ã³ãããããŸãã
ãããã¯ãã¢ãã«ã®ããŒã¿ããæåããMXFP4ïŒ4ãããïŒãšããè¶ è»œéãªåœ¢åŒã«æé©åãããç¶æ ã§å ¬éãããããšããããšã§ãã
ãããã«ã¯ãæšä»ã®åœéæ å¢ããã¥ãŒã¹ã§è¿œã£ãŠããæ¹ãªããã³ãšãããäžåœã®AIäŒæ¥ãçŽé¢ããŠãããããåå®ãªèå°è£ããšããããä¹ãè¶ããæè¡è ãã¡ã®å·å¿µãé ãããŠããŸãã
ãæå 端ã®åå°äœãæã«å ¥ããªãããšããå£
ãçŸåšãç±³åœã«ãã茞åºèŠå¶ã®åœ±é¿ã§ãäžåœã®AIäŒæ¥ã¯æå 端ã®AIçšåå°äœïŒNVIDIAã®æé«å³°ããããªã©ïŒã倧éã«å ¥æããããšã極ããŠé£ãããªã£ãŠããŸãã
ãéãããããŒããŠã§ã¢ïŒå°ãäžä»£ã®å€ãGPUããæ§èœãæãããããããïŒã§ãã©ããã£ãŠç±³åœã®ææ°AIïŒGPT-5ãªã©ïŒã«æã¡åã€å·šå€§ãªAIãåãããïŒ
ããã®çãããããŒã¿ã®åŸ¹åºçãªãã€ãšãããã€ãŸããéååïŒãããããïŒãã§ããã
åŸæ¥ã®ãåŸãããã€ãšããããããã
ãåŸæ¥ã®AIéçºã§ã¯ããŸãã16ãããïŒFP16ïŒããªã©ã®é«ç»è³ªã»å€§å®¹éãªç¶æ ã§AIã1ãã10ãŸã§åŠç¿ããã宿ããåŸã«ãäžè¬ã®äººã§ãåãããããã«ã4ããããããã«ããŒã¿ãåã£ãŠè»œãããããšããæé ãèžãã®ãäžè¬çã§ããã
ããããããã®ãåŸãããã€ãšããïŒåŸæ®µéååïŒãããããšããã£ããè³¢ãã£ãAIã®è³ã¿ããåãããèšèã®æå³ãåãéããããèšç®èœåãã¬ã¯ã³ãšèœã¡ãŠããŸãïŒéååãã¹ïŒãšãã倧ããªåŒ±ç¹ããããŸããã
ãããã§Moonshot AIã®ããŒã ã¯ãåžžèãèŠãã¢ãããŒããåããŸããã
ãã ã£ãããæåãã4ãããïŒMXFP4ïŒã®è¶
軜éãªè³ã¿ããšããŠã1ããè±ææè²ãæœãã°ãããããªããããšèããã®ã§ãã
容éã¯é©ãã®ã1.4ãã©ãã€ããã«
ãæåãã4ãããã§åãããã«èšèšãããã®ãŸãŸäœå æåãã®ããŒã¿ãåŠç¿ãããïŒéååã¢ãŠã§ã¢ãã¬ãŒãã³ã°ïŒã®ã¯æè¡çã«è³é£ã®æ¥ã§ããããããKimi K3ã¯èŠäºã«ãããæåãããŸããã
æ®éã«äœãã°ïŒããŒã¿å®¹éã5ã6ãã©ãã€ã以äžã«ãªãã巚倧ãªãµãŒããŒã§ãåããã®ãäžèŠåŽã
æåãã4ãããïŒMXFP4ïŒïŒ2.8å ãã©ã¡ãŒã¿ãšããåãç©ãµã€ãºãªã®ã«ããããã1.4ãã©ãã€ããã«åãŸãã
ãããã¯ãè¶ é«ç»è³ªãª4Kæ ç»ã®ããŒã¿ããç»è³ªïŒè³¢ãïŒãå šãèœãšããã«ãã¹ããã§ãåçã§ããããã軜ããã¡ã€ã«ãµã€ãºã«å§çž®ããŠæ®åœ±ãããããªãã®ã§ãã
ãããŒããŠã§ã¢ã®å¶çŽãšãããçµ¶æçãªå£ãããç¬èªã®æ°åŠçã»ãšã³ãžãã¢ãªã³ã°ã®å·¥å€«ïŒMXFP4圢åŒã®æ¡çšïŒã«ãã£ãŠãäžçæé«å³°ã®å¹çãæã€AIããšããæå€§ã®æŠåšã«å€ããŠããŸã£ãã
ããã®ãã³ã°ãªãŒç²Ÿç¥ãšæè¡åããããå ¬éããããœãŒã¹ã³ãŒãããèªã¿è§£ããKimi K3ã®è£ã®äž»åœ¹ãªã®ã§ãã
5. ãçºæãã®3ããèªåã§ç»é¢ãèŠãŠãèªåã§ãã°ãçŽããè¶ ã¹ãã«ã¿æè²
ãKimi K3ãå ¬éãããçŽåŸãAIã®æ§èœãç«¶ããã³ãããŒã¯ïŒFrontend Code Arenaãªã©ïŒã§ã䞊ã¿å± ãç«¶åãæããŠäžç1äœã«èŒããããšã倧ããªè©±é¡ã«ãªããŸããã
ããªããããã»ã©ãŸã§ã«å®è·µçãªããã°ã©ãã³ã°ããèªåŸçãªäœæ¥ãã§ããã®ãïŒã
ããã®ç§å¯ãããã¯ãã«ã«ã¬ããŒãã«è©³ããæžãããŠãããç¬èªã®ã¹ãã«ã¿æè²ïŒåŒ·ååŠç¿ããã»ã¹ïŒãã§ãã
ããããŸã§ã®å€ãã®AIã¯ãããã°ãæç§æžãäžžæèšããåªççãã§ããããããäžã®å€§éã®æç« ãèªã¿èŸŒã¿ããæ¬¡ã®åèªã«äœãæ¥ããããäºæž¬ããèšç·Žã°ãããåããŠããã®ã§ãããã®ããããã£ãšããããåïŒãã«ã·ããŒã·ã§ã³ïŒãã€ããããå®éã«ã³ãŒããåãããšãšã©ãŒãŸã¿ãã ã£ããããããšããããããŸããã
ããããKimi K3ã®è²ãŠæ¹ã¯æ ¹æ¬ããéããŸãã
AIã®è³ã¿ããã9ã€ã®äººæ Œãã«åããŠéããïŒMOPDïŒ
ãKimi K3ã¯ãæåããäžã€ã®å¡ãšããŠè²ãŠãããããã§ã¯ãããŸããã
ãããã°ã©ãã³ã°å°éããAIãšãŒãžã§ã³ãïŒèªåŸè¡åïŒå°éããäžè¬è«çæèå°éããªã©ãåèš9ã€ã®é åããšã«ãããããæé©ãªæèã¬ãã«ïŒReasoning EffortïŒãæãããã9人ã®å°éæåž«ã¢ãã«ããåå¥ã«çšæããŸããã
ãããããã®åéã§æ¥µéãŸã§éãäžãã9ã€ã®é è³ããæåŸã«ãå€æåž«ãªã³ããªã·ãŒèžçïŒMulti-Teacher On-Policy DistillationïŒããšããç¹æ®ãªæè¡ã§ãã²ãšã€ã®æŽç·Žãããäººæ ŒïŒKimi K3ïŒãžãšçµ±åããã®ã§ãã
ä»®æ³ç©ºéïŒãµã³ãããã¯ã¹ïŒã§äœäžåããå®åããçµéš
ãããã«æãããã®ã¯ãçµ±åãããåŸã®ã宿èšç·Žãã§ãã
Kimi K3ã«ã¯ãæåãèªãã ãã§ãªããå®éã«ããœã³ã³ãæäœã§ãããAgentENVããšããå°çšã®ä»®æ³ç©ºéïŒãµã³ãããã¯ã¹ç°å¢ïŒãäžããããŸããã
ãAIã¯ããã®ç©ºéã®äžã§äººéã®æ°äººãšã³ãžãã¢ãšåãããã«ã次ã®ãããªç¹èšãäœäžåãç¹°ãè¿ããŸããã
æç€ºãåããïŒãããããWebãµã€ããäœã£ãŠã
ã³ãŒããæžãïŒå®éã«ããã°ã©ã ã®ã³ãŒããæã¡èŸŒã
ãã©ãŠã¶ãèµ·åããïŒä»®æ³ç©ºéã®äžã§èªåã§Webãã©ãŠã¶ãéããäœã£ããµã€ãã衚瀺ããã
ç»é¢ãç®ã§ç¢ºèªããïŒçæãããç»é¢ã®ã¹ã¯ãªãŒã³ã·ã§ããããAIèªãã®ãç®ïŒãã«ãã¢ãŒãã«èŠèŠæ©èœïŒãã§èŠãŠç¢ºèªãã
ãã°ãçŽãïŒããããã¿ã³ã®äœçœ®ããºã¬ãŠãããªãããšã©ãŒç»é¢ãåºããªããšæ°ã¥ããèªåã§ãœãŒã¹ã³ãŒããæžãæããŠä¿®æ£ãã
ããã®ãèªåã§äœã£ãŠãèªåã®ç®ã§ç¢ºãããŠãèªåã§ãã°ãçŽãããšããã»ã«ãä¿®æ£ã«ãŒãïŒèªå·±ä¿®æ£åŒ·ååŠç¿ïŒãæ°ãé ããªãã»ã©ç¹°ãè¿ããçµæãKimi K3ã¯ãåãã³ãŒãã確å®ã«æžãããšã©ãŒãèµ·ããŠãèªåã§ãªã«ããªãŒã§ããããšãããå®åã«å³ããå§åçãªåŒ·ããæã«å ¥ããã®ã§ãã
ãç§ãã¡ããã£ããç»é¢ã§æç€ºãåºããè£åŽã§ãKimi K3ããŸãã§çç·Žã®è·äººã®ããã«ãããããšè£ã§ããŒã«ãåãããŠæ£è§£ã«ãã©ãçãã®ã¯ããã®éé ·ãªã¹ãã«ã¿æè²ã®è³ç©ã ã£ãããã§ãã
6. ãçŸå®ãå人ã§ããŒã«ã«èµ·åã§ããïŒå¿ èŠãªã¢ã³ã¹ã¿ãŒç°å¢
ããããŸã§Kimi K3ã®é©æ°çãªäžèº«ãèŠãŠãããšãããæãæ¹ãå€ãã¯ãã§ãã
ããœãŒã¹ã³ãŒãïŒã¢ãã«ãŠã§ã€ãïŒãç¡æå ¬éãããã£ãŠããšã¯ãèªåã®ããœã³ã³ã«ããŠã³ããŒãããŠãå®å šç¡æã§åãããã®ïŒã
ãçµè«ããèšããšãã©ã€ã»ã³ã¹çã«ã¯ãYESãã§ãããç©ççã«ã¯ãã»ãŒäžå¯èœãã§ãã
ãä»åã®å ¬éã§èšå®ããããModified MITã©ã€ã»ã³ã¹ãã¯éåžžã«å€ªã£è ¹ã§ãåçšå©çšãåºæ¬çã«ã¯èªç± [13]ãèŠçŽã®äžã§ã¯ã誰ã§ããã®å€§å€©æAIãèªåã®ãã®ã«ã§ããŸããããããå®éã«åããããšããç¬éãäžè¬äººã«ã¯çµ¶å¯Ÿã«è¶ ããããªããã¢ã³ã¹ã¿ãŒçŽã®ã€ã³ãã©ã®å£ããç«ã¡ã¯ã ãããŸãã
ããŒã¿ã®ãã€ãšããã«æåããŠããçžæã¯ã2.8å ã
ã第4ç« ã§ãããŒã¿ã®ãã€ãšããïŒ4ãããéååïŒã«æåãã容éãããã1.4ãã©ãã€ãã«åãŸã£ãããšã話ãããŸããã
ã1.4TBãªããåžè²©ã®ããŒã¿ãã«SSDïŒ2TBïŒã«äœè£ã§å
¥ããããïŒããšæããããããŸããã
ã確ãã«ãä¿åãããã ããªãå¯èœã§ããããããAIããåããïŒæšè«ããïŒãã«ã¯ããã®1.4TBã®ããŒã¿ãäžžããšãGPUã®è¶
é«éãªã¡ã¢ãªïŒVRAMïŒãã®äžã«èŒããªããã°ãªããŸããã
ãããããäžè¬ã®ããœã³ã³ãšããçšãµãŒããŒã®æ±ºå®çãªéãã§ãã
ãç§ãã¡ãæ®æ®µäœ¿ã£ãŠããææ°ã®é«çŽã²ãŒãã³ã°PCã«æèŒãããŠããã°ã©ãã£ãã¯ããŒãïŒäŸïŒNVIDIA GeForce RTX 4090ïŒã§ããã¡ã¢ãªå®¹éã¯ãã£ãã®ã24GBãã§ãã1.4TBïŒ1400GBïŒã®ããŒã¿ãèŒããã«ã¯ãRTX 4090ãçŽ60æãå¿ èŠã«ãªã£ãŠããŸããŸãã
å¿ èŠãªã®ã¯ãåœå®¶äºç®ã¬ãã«ãã®ç°å¢
ãã§ã¯ãå ¬éãããã³ãŒãïŒvLLMãªã©ã®ææ°æšè«ãšã³ãžã³ ïŒã®ããŒã¿ããéç®ããŠãKimi K3ããŸãšãã«ããŒã«ã«ã§åããã«ã¯ãäžäœã©ãã»ã©ã®ç°å¢ãå¿ èŠãªã®ã§ããããïŒ
æäœã©ã€ã³ïŒNVIDIAã®AIå°çšã¢ã³ã¹ã¿ãŒããããB200ããæäœ16åºã
çæ³ã©ã€ã³ïŒææ°ã®æ¬¡äžä»£ããŒã¿ã»ã³ã¿ãŒã·ã¹ãã ïŒNVIDIA B300ãGB300 NVL72ãªã©ïŒã®ãã«ããŒãã8åºä»¥äžã
ããµãŒããŒ1å°ã®äŸ¡æ Œã ãã§æ°åäžåããæ°ååãããã«ãããç¶æããããã®é»æ°ä»£ãå·åŽã·ã¹ãã ãå«ãããšãå®å šã«ãå€§äŒæ¥ãåœå®¶ãããžã§ã¯ããã®é åã§ããééã£ãŠããå人ã®èªå® ã®ã³ã³ã»ã³ãã§åããã代ç©ã§ã¯ãããŸããã
ãããããªããäžè¬å ¬éãã«äŸ¡å€ãããã®ãïŒ
ãçµå±ãå€§äŒæ¥ãã䜿ããªããªãå ¬éãããæå³ãªããŠãªãã®ã§ã¯ïŒããšæããããããŸããããããããããããä»åã®çºè¡šã®æå€§ã®ãã€ã³ãã§ãã
ãä»åã®å ¬éã®çã®äŸ¡å€ã¯ãããããŸã§GAFAãOpenAIã®ãããªè¶ 巚倧ããã¯äŒæ¥ããæãŠãªãã£ããäžçæé«å³°ã®AIã®è³ã¿ããããã»ãã¥ãªãã£ãæãå³ããå€§äŒæ¥ãç ç©¶æ©é¢ããèªç€Ÿã®ç§å¯åºå°ïŒãã©ã€ããŒããµãŒããŒïŒã«äžžããšã³ããŒããŠç¬å ã§ããããã«ãªã£ãããšããç¹ã«ãããŸãã
ãããŸã§ã®ç€Ÿå AIïŒå€éšã®APIïŒChatGPTãªã©ïŒã«ããŒã¿ãéä¿¡ããããåŸããæ©å¯æŒæŽ©ã®ãªã¹ã¯ãåžžã«ãã£ãã
ããããã®ç€Ÿå AIïŒKimi K3ãèªç€ŸãµãŒããŒã«äžžããšéã蟌ããããšã§ããäžåããŒã¿ãå€ã«æŒããªããèªç€Ÿå°çšã®äžçæåŒ·AIããæ§ç¯ã§ããã
ãã€ãŸããä»åã®äžè¬å ¬éã¯ãå人ã®ãããŒçšããšããŠã§ã¯ãªãããäžçã®ããžãã¹ãã»ãã¥ãªãã£ã®åžžèãå¡ãæ¿ããããã®ãªãŒãã³åãã ã£ãã®ã§ãã
7. ãŸãšãïŒKimi K3ã®ç»å Žã§ãAIã®æªæ¥ã¯ã©ãå€ããïŒ
ããããŸã§ãçªåŠäžè¬å ¬éããããKimi K3ãã®ãœãŒã¹ã³ãŒããæè¡è«æããèŠããŠãããé©ç°ã®ã¢ãŒããã¯ãã£ã«ã€ããŠè§£èª¬ããŠããŸããã
ãæåŸã«ãä»å倿ãããã€ã³ããããäžåºŠæ¯ãè¿ã£ãŠã¿ãŸãããã
MoEïŒæ··åå°éå®¶ïŒã®é²åïŒ2.8å ãã©ã¡ãŒã¿ãšããå·šäœãªãããåãã®ã¯éžã°ããã16åã®ãšãã¹ããŒããã ããšãã究極ã®çãšãã
äºåæµã®ã¢ãã³ã·ã§ã³ïŒæ®æ®µã¯ãããŒãïŒKDAïŒãã§çéåŠçããå¿ èŠãªæã ããèŸæžïŒGated MLAïŒããéãããšã§ã100äžæåã®å£ãçªç Žã
æåããã®4ãããåïŒããŒããŠã§ã¢èŠå¶ã®éå¢ãè·³ãè¿ããæåãããMXFP4ãã§è±ææè²ãæœãããšã§å®¹éã1.4TBã«å§çž®ã
å®è·µåã®ã¹ãã«ã¿æè²ïŒä»®æ³ç©ºéã§ãèªåã§ç»é¢ãèŠãŠãã°ãçŽããèšç·ŽãéããæåŒ·ã®èªåŸãšãŒãžã§ã³ããžã
AIã®æŠãã¯ãè³¢ãããããå§åçãªå¹çæ§ãã®æä»£ãž
ãKimi K3ã®ç»å Žãç§ãã¡ã«æããŠãããæå€§ã®ã¡ãã»ãŒãžãããã¯ãAIã®é²åã®ãã¬ã³ããããã é ã®è¯ãïŒãã©ã¡ãŒã¿æ°ã®å€§ããïŒãç«¶ããã§ãŒãºãããããããã«çŸå®çãªã³ã¹ãã§ãå§åçãªå¹çã§åããããããšãããã§ãŒãºã«å®å šã«ã·ãããããšããããšã§ãã
ãã©ããªã«é ãè¯ããŠããåããã®ã«åœå®¶ã¬ãã«ã®é»æ°ä»£ããããAIã¯ãç§ãã¡ã®æ¥åžžãããžãã¹ã«ã¯æµžéããŸãããããŒããŠã§ã¢ã®å¶çŽãšããå³ããçŸå®ããç¬èªã®æ°åŠçã¢ãããŒããšå·å¿µã®ãšã³ãžãã¢ãªã³ã°ã§ä¹ãè¶ããKimi K3ã®æ§é ã¯ãããããã®AIéçºã®ãæ°ããæç§æžãã«ãªãã¯ãã§ãã
ç§ãã¡ã®æªæ¥ã¯ã©ãå€ããïŒ
ä»åã®ããªãŒãã³ãŠã§ã€ãïŒè³ã¿ãã®å ¬éïŒãã«ãã£ãŠãããããäžçäžã®äŒæ¥ãç ç©¶è ããKimi K3ã®åªããæ§é ãããŒã¹ã«ãããæŽŸçAIããæ¬¡ã ãšçã¿åºããŠããã§ãããã
ãæ°ã¶æåŸã«ã¯ããã®æè¡ãå¿çšããããã£ãšè»œããŠãå人ã®ããœã³ã³ã§ãåãè¶ é«æ§èœãªAIããããç¹å®ã®ããžãã¹ã«ç¹åããæåŒ·ã®èªåŸãšãŒãžã§ã³ãããç§ãã¡ã®ç®ã®åã«çŸãããããããŸããã
ããªãŒãã³ãœãŒã¹åãããå·šäœã®åºçŸã«ãã£ãŠãAIã®æ°äž»åãšé²åã®ã¹ããŒãã¯ããã«å éããŠãããŸãããã®åºæ¿çãªæ°æä»£ãããããããã¯ã¯ã¯ã¯ããªãã远ããããŠãããŸãããïŒ
é¢é£èšäºïŒ
#AI #çæAI #LLM #KimiK3 #ãã¯ãããžãŒ #ææ°æè¡ #ããã°ã©ãã³ã° #ãšã³ãžã㢠#ããžãã¹ #ãªãŒãã³ãœãŒã¹