
Reflection Llama-3.1 70B ã詊ã
tl;dr
Reflection Llama-3.1 70B  ããªãŒãã³ LLM ã®äžã§äžçæé«æ§èœã謳ã
Llama 3.1 70B ã Reflection-Tuning ãçšããŠäºåŸåŠç¿
<output> / <thinking> / (reflection) ãªã©ã®ã¿ã°ãçšããŠæšè«
Ollama ã䜿ã£ãŠæšè«ãããŠã¿ã
泚ïŒçŸåšãã®ã¢ãã«ã«ã€ããŠæ§ã ãªè°è«ããããŠããããã§ãããæ§èœè©äŸ¡ã«é¢ããŠã¯æºãåããŠããããšã«ã泚æãã ãããèœã¡çãæ¬¡ç¬¬ã倿Žç¹çããå Žåã¯èšäºãä¿®æ£ããäºå®ã§ããããè°è«ã®å å®¹ãæ°ã«ãªãæ¹ãããããããäžèšã® Hugging Face ã®Â Refleciton Llama ã®ã³ãã¥ããã£æ¬ãã芧ãã ããã
Reflection Llama-3.1 70B ãšã¯
HyperWrite ã® CEO Matt Shumer æ°ã®å ¬éãã Llama 3.1 ããŒã¹ã®ãªãŒãã³ãªå€§èŠæš¡èšèªã¢ãã«ã
I'm excited to announce Reflection 70B, the worldâs top open-source model.
â Matt Shumer (@mattshumer_) September 5, 2024
Trained using Reflection-Tuning, a technique developed to enable LLMs to fix their own mistakes.
405B coming next week - we expect it to be the best model in the world.
Built w/ @GlaiveAI.
Read on â¬ïž: pic.twitter.com/kZPW1plJuo
Matt æ°ã®è§£èª¬ãäžèšã®ãã¹ããšã¹ã¬ããã«ãããŸãããŸãšããŸãã
äžçæé«ã®ãªãŒãã³ã¢ãã« Reflection 70B ãçºè¡š
LLM ãééããèªåã§ä¿®æ£ã§ããããã«ãã Reflection-Tuning ãçšããŠèšç·Ž
Glaive AI ãçšããŠèšç·Ž
ãããã¯ã©ã¹ã®ãããã©ã€ãšã¿ãªã¢ãã«ïŒéå ¬éã®ã¢ãã«: Claude 3.5 SonnetãGPT-4oïŒã«äžŠã¶æ§èœãèªã
å°ãªããšã MMULãMATHãIFEvalãGSM8K ã«ãããŠã¯æé«æ§èœ
ãã¹ããããã¹ãŠã®ãã³ãããŒã¯ã§ GPT-4o ãäžåã
Llama 3.1 405B ãå§åçã«åé§ããŠã
èšç»ãç«ãŠãã¹ããããåããããšã§ CoTïŒChain-of-ThoughtïŒã®å¹æãé«ãããšã³ããŠãŒã¶ãŒã«ãšã£ãŠã·ã³ãã«ã§ç°¡æœãªåºåãç¶æ
LMSYS ã®LLM Decontaminator ã䜿çšããŠãèšåãããã¹ãŠã®ãã³ãããŒã¯ã«å¯Ÿããæ±æé€å»ã確èª
æ¥é± Reflection-405B ãå ¬éããããã»ã¹ãçºèŠããäºé ã«ã€ããŠãã詳现ãªçãã®ã¬ããŒããå ¬éäºå®
äžèšã® Hugging Face ãªããžããªã«ãŠã¢ãã«ãå ¬éãMatt æ°ãã¹ãã§èšåãããŠããªãéšåããŸãšããŸãã
Glaive ã«ãŠçæããåæããŒã¿ãçšããŠèšç·Ž
ãã³ãããŒã¯ã®æž¬å®æã¯ <output> ã¿ã°å ã®éšåã®ã¿ãæœåºããŠè©äŸ¡

Llama 3.1 70B Instruct ãããŒã¹ã«èšç·Ž
Llama 3.1 ãã£ãããã³ãã¬ãŒã圢åŒãæ¡çšïŒããã€ãã®ã¹ãã·ã£ã«ããŒã¯ã³ã远å ïŒ
æšè«æã« <thinking></thinking> ã¿ã°å ã§æšè«ãåºåãããã®åŸ <output></output> ã¿ã°å ã«æçµçãªåçãåºåïŒClaude ã® <antThinking></antThinking> ãšåãã§ããïŒïŒ
äžèšã®ã¿ã°ã¯ããããã¹ãã·ã£ã«ããŒã¯ã³ãšããŠèšç·Ž
<thinking> ã¿ã°ã«ãŠã¢ãã«ã¯ <reflection> ã¿ã°ãåºåããããšãããããããã¯ã¢ãã«ãæšè«ã®èª€ããçºèŠããæçµåçãæäŸããåã«ä¿®æ£ã詊ã¿ãããšã瀺ããŠãã
System PromptïŒç¿»èš³ïŒ
ããªãã¯è€éãªæšè«ãšå çãå¯èœãªäžçã¯ã©ã¹ã®AIã·ã¹ãã ã§ãã<thinking>ã¿ã°å ã§ã¯ãšãªã«ã€ããŠæšè«ããæçµçãªåçã<output>ã¿ã°å ã«æäŸããŠãã ãããæšè«ã®éçšã§èª€ãã«æ°ã¥ããå Žåã¯ã<reflection>ã¿ã°å ã§èªå·±ä¿®æ£ããŠãã ããã
ããã©ãŒãã³ã¹ãæå€§åããã«ã¯ãäžèšã®ã·ã¹ãã ããã³ããããã®ãŸãŸäœ¿çšããããšãæšå¥š
äžèšã®ã·ã¹ãã ããã³ãããšç¬èªã®ã«ã¹ã¿ã ã€ã³ã¹ãã©ã¯ã·ã§ã³ãçµã¿åãããŠãã¢ãã«ã®åäœãã«ã¹ã¿ãã€ãºããããšãå¯èœ
ãã£ãããã©ãŒãããïŒç¿»èš³ïŒ:Â
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
ããªãã¯è€éãªæšè«ãšå çãå¯èœãªäžçã¯ã©ã¹ã®AIã·ã¹ãã ã§ãã<thinking>ã¿ã°å ã§ã¯ãšãªã«ã€ããŠæšè«ããæçµçãªåçã<output>ã¿ã°å ã«æäŸããŠãã ãããæšè«ã®éçšã§èª€ãã«æ°ã¥ããå Žåã¯ã<reflection>ã¿ã°å ã§èªå·±ä¿®æ£ããŠãã ããã<|eot_id|><|start_header_id|>user<|end_header_id|>
2+2ã¯ããã€ã§ããïŒ<|eot_id|><|start_header_id|>assistant<|end_header_id|>
ããã©ãŒãã³ã¹ããããã³ã
temperature 㯠0.7ãtop_p 㯠0.95 ãæšå¥š
ã¡ãã»ãŒãžã®æåŸã«ãThink carefully.ãã远å
ããŒã¿ã»ãã / ã¬ããŒãã¯æ¥é±å ¬éäºå®
å ¬åŒãã¢ã詊ã

泚ç®åºŠåãã倧ããã®ã§ããããOllama å ¬åŒã GGUF ã¢ãã«ãé åžããŠããã®ã§ãã¡ãã䜿ããŸãã
ç°å¢æ§ç¯
æå ã§æšè«ãããã Ollama ã®æ¹ã楜ãªã®ã§ Ollama çµç±ã§åãããŸãã
ãã Ollama ãå ¥ã£ãŠããªããã° Ollama ãå ¥ããŠãã ããã
brew install --cask ollamaReflection Llama-3.1 70B ãå ¥ããŠãã ããããã¡ãã®å®æ ã¯Â 70b-q4_0 GGUF ã§ããVRAM 40GB å°ãã§æšè«å¯èœã§ãã
ollama pull reflectionReflection Llama-3.1 70B ã®æšè«
$ ollama run reflection
>>> ããã«ã¡ã¯ã
<thinking> Ah, it seems like I've been greeted in Japanese! "Konnichiwa" is a common way to say hello in Japan. I
should respond accordingly.</thinking>
<output> ããã«ã¡ã¯ïŒ (Konnichiwa!) </output>
(Note: If you'd like to have a conversation in Japanese or switch to English, please let me know!)ããŒã¹ãšãªã£ãŠãã Llama 3.1 70B Instruct ã¯æ¥æ¬èªåºåãåŸæã§ã¯ãªãã®ã§ãæ¥æ¬èªã®ããã³ããã«å¯ŸããŠæ¥æ¬èªãšè±èªãšäž¡æ¹ã®æç« ãçæããŠããŸããã§ã¯è±èªã§èããŠã¿ãŸãããã
>>> Do you know a nuclear fusion?
<thinking> Ah, nuclear fusion! That's a topic from physics. Nuclear fusion is the process where two or more atomic
nuclei combine to form a single, heavier nucleus, releasing energy in the process. This is the same process that
powers stars like our sun. On Earth, scientists are working on achieving controlled nuclear fusion as a potential
source of clean and sustainable energy.</thinking>
<output> Yes, I'm familiar with nuclear fusion! It's an exciting area of research with huge potential benefits for
humanity. Are you interested in learning more about it?</output>
(reflection) Ah, wait! I should clarify that my explanation is simplified, and there are many complexities
involved in achieving controlled nuclear fusion on Earth. If the user wants more details or clarification, I'll be
happy to provide them!</reflection>## 翻蚳æç«
<thinking> ãããæ žèåã§ããïŒããã¯ç©çåŠã®è©±é¡ã§ããæ žèåãšã¯ã2 ã€ä»¥äžã®ååæ žãçµåã㊠1 ã€ã®éãæ žã圢æãããã®éçšã§ãšãã«ã®ãŒãæŸåºããããã»ã¹ã§ããããã¯ã倪éœã®ãããªæãåããã®ãšåãããã»ã¹ã§ããå°çäžã§ã¯ãç§åŠè
ãã¯ãªãŒã³ã§æç¶å¯èœãªãšãã«ã®ãŒæºãšããŠå¶åŸ¡ãããæ žèåã®å®çŸã«åãçµãã§ããŸãã</thinking>
<output> ã¯ããæ žèåã«ã€ããŠã¯ããç¥ã£ãŠããŸãïŒããã¯äººé¡ã«å€§ããªå©çãããããå¯èœæ§ã®ãããšããµã€ãã£ã³ã°ãªç ç©¶åéã§ããããã«ã€ããŠãã£ãšç¥ãããã§ããïŒ</output>
(reflection) ãããåŸ
ã£ãŠãã ããïŒç§ã®èª¬æã¯ç°¡ç¥åãããŠãããå°çäžã§å¶åŸ¡ãããæ žèåãå®çŸããã«ã¯å€ãã®è€éãªèŠçŽ ãé¢ä¿ããŠããããšãæç¢ºã«ããŠããå¿
èŠããããŸãããŠãŒã¶ãŒã詳现ã説æããã£ãšå¿
èŠãšããŠããå Žåã¯ãåãã§æäŸããŸãïŒ</reflection>ã¢ãã«ã«ãŒããèŠãã ãã§ã¯ã€ã¡ãŒãžãã€ããªãã£ãã®ã§ãããçææç« ãèŠãŠçè§£ã§ããŸããã<output></output> ã¿ã°ã®äžèº«ããŠãŒã¶ã«è¡šç€ºããã®ã§ããããèªèº«ã®åºåãã©ãããç²åºŠã§æšè«ãããŠããã (reflection) ã®äžã«æžãããŠããã®ã¯ãšãŠãè峿·±ãããã£ãšè©³ããèããŠã¿ãŸãããã
>>> Could you tell me more about this process?
<thinking> Ah, sure! Nuclear fusion is a complex process, but I can try to break it down further. There are
several types of nuclear fusion reactions, but the most commonly discussed one is the deuterium-tritium (D-T)
reaction. This involves combining an isotope of hydrogen called deuterium (which has one proton and one neutron in
its nucleus) with another isotope called tritium (which has one proton and two neutrons).
When these two nuclei are heated to incredibly high temperatures, typically above 150 million degrees Celsius,
they fuse together to form a single nucleus of helium. This process releases a vast amount of energy in the form
of light and heat.
In stars like our sun, this process occurs naturally due to the immense pressure and temperature at their cores.
However, on Earth, scientists are trying to replicate this process using specialized devices called tokamaks or
stellarators. These machines use powerful magnetic fields to confine and heat a plasma (ionized gas) to achieve
the necessary conditions for fusion.
The challenges in achieving controlled nuclear fusion are significant, though. The plasma needs to be heated to
extremely high temperatures while being confined within the device's magnetic field. Additionally, the reaction
must be sustained long enough to produce more energy than is consumed by the process itself.</thinking>
<output> Nuclear fusion involves combining atomic nuclei to release vast amounts of energy. Scientists are working
on replicating this process in specialized devices called tokamaks or stellarators, which use magnetic fields to
confine and heat a plasma to achieve conditions suitable for fusion. However, achieving controlled nuclear fusion
is a complex challenge that requires overcoming significant technical hurdles.</output>
(reflection) Ah, I hope that helps clarify the process of nuclear fusion! If you'd like me to elaborate on any
specific aspect or discuss potential applications of fusion energy, feel free to ask!</reflection>## 翻蚳
<thinking> ããããã¡ããã§ã! æ žèåã¯è€éãªããã»ã¹ã§ããããã£ãšè©³ãã説æããŠã¿ãŸããæ žèååå¿ã«ã¯ããã€ãã®çš®é¡ããããŸãããæããã話é¡ã«ãªãã®ã¯éæ°ŽçŽ -äžéæ°ŽçŽ (D-T) åå¿ã§ããããã¯ãéæ°ŽçŽ (ååæ žã«éœå 1 åãšäžæ§å 1 å) ãšåŒã°ããæ°ŽçŽ ã®åäœäœãšãäžéæ°ŽçŽ (éœå 1 åãšäžæ§å 2 å) ãšåŒã°ããå¥ã®åäœäœãçµåãããåå¿ã§ãã
ãã® 2 ã€ã®ååæ žããéåžž 1 å 5000 äžåºŠãè¶
ããéåžžã«é«ã枩床ã«å ç±ããããšãèåã㊠1 ã€ã®ããªãŠã ååæ žã圢æããŸãããã®ããã»ã¹ã§ã¯ãå
ãšç±ã®åœ¢ã§èšå€§ãªéã®ãšãã«ã®ãŒãæŸåºãããŸãã
倪éœã®ãããªæã§ã¯ãäžå¿æ žã®å§åãšæž©åºŠãéåžžã«é«ãããããã®ããã»ã¹ã¯èªç¶ã«çºçããŸããããããå°çäžã§ã¯ãç§åŠè
ãã¡ã¯ãã«ãã¯ãã¹ãã©ã¬ãŒã¿ãšåŒã°ããç¹æ®ãªè£
眮ã䜿ã£ãŠãã®ããã»ã¹ãåçŸããããšããŠããŸãããããã®è£
眮ã¯åŒ·åãªç£å Žã䜿ã£ãŠãã©ãºãïŒã€ãªã³åããã¬ã¹ïŒãéã蟌ããŠå ç±ããæ žèåã«å¿
èŠãªæ¡ä»¶ãå®çŸããŸãã
ãã ããå¶åŸ¡ãããæ žèåãå®çŸããã«ã¯å€§ããªèª²é¡ããããŸãããã©ãºãã¯è£
眮ã®ç£å Žå
ã«éã蟌ããããç¶æ
ã§éåžžã«é«ã枩床ã«å ç±ããå¿
èŠããããŸããããã«ãåå¿ã¯ããã»ã¹èªäœã§æ¶è²»ããããšãã«ã®ãŒãããå€ãã®ãšãã«ã®ãŒãçã¿åºãã®ã«ååãªæéæç¶ããå¿
èŠããããŸãã</thinking>
<output> æ žèåã§ã¯ãååæ žãçµåããŠèšå€§ãªéã®ãšãã«ã®ãŒãæŸåºããŸããç§åŠè
ãã¡ã¯ããã«ãã¯ãã¹ãã©ã¬ãŒã¿ãšåŒã°ããç¹æ®ãªè£
眮ã§ãã®ããã»ã¹ãåçŸããããšããŠããŸãããããã®è£
眮ã¯ç£å Žã䜿ã£ãŠãã©ãºããéã蟌ããŠå ç±ããæ žèåã«é©ããæ¡ä»¶ãå®çŸããŸããããããå¶åŸ¡ãããæ žèåãå®çŸããã«ã¯ã倧ããªæè¡çããŒãã«ãå
æããå¿
èŠãããè€éãªèª²é¡ã§ãã</output>
(reflection) ãããããã§æ žèåã®ããã»ã¹ãæç¢ºã«ãªã£ããšæããŸãïŒæ žèåãšãã«ã®ãŒã®ç¹å®ã®åŽé¢ã«ã€ããŠè©³ãã説æããããæœåšçãªçšéã«ã€ããŠè©±ãåã£ãããããå Žåã¯ãé æ
®ãªããå°ããã ããã</reflection><output></output> ã¿ã°å ã¯ãã¡ãã <thinking></thinking> ã¿ã°å ããã«ã·ããŒã·ã§ã³ãããŠããªãããã㯠70B Instruct èµ·å ã ãšæããŸãããçŽ æŽãããã
å人çã«ã¯ Reflection-Tuning ãš SELF-ROUTE ãåããããã¢ããªã±ãŒã·ã§ã³éçºã«ããã LLM çµã¿èŸŒã¿ãããªããã«ã·ããŒã·ã§ã³è»œæžã§ãããã§ãããæåŸ ããŠããŸãã
ããããæ§èœã¯é«ããªã£ãŠãããšã¯æãã®ã§ãããLlama 3.1 70B Instruct ãšæ¯èŒããŠã©ãæ§èœãé«ããªã£ãŠããã®ãããŸãã¡ããã£ãŠããªãã®ã§ãããæšè«ç°å¢ã®ããæ¹ã¯ææãæããŠãã ããïŒ
远èš
ããŒã¹ãšãªã£ãŠãã Llama 3.1 70B Instruct ã¯æ¥æ¬èªåºåãåŸæã§ã¯ãªãã®ã§ãæ¥æ¬èªã®ããã³ããã«å¯ŸããŠæ¥æ¬èªãšè±èªãšäž¡æ¹ã®æç« ãçæããŠããŸãã
äžèšã®ããã«å ã»ã©èšèŒããŸããããããã³ããæ¬¡ç¬¬ã§ã¯æ¥æ¬èªãçµæ§äœ¿ããããšã«æ°ä»ããŸããã
>>> 倪宰治ã®äººéå€±æ Œã®ãããããæããŠãã ããã
<thinking>
"人éå€±æ Œ"ã¯ã倪宰治ã«ãã£ãŠ1948幎ã«çºè¡šãããå°èª¬ã§ãããæ¥æ¬æåŠã®äžã§æãæåãªäœåã®äžã€ã§ãããã®å°èª¬ã¯ãäœè
èª
身ã®äººçãšçµéšãåºã«æžãããèªäŒçèŠçŽ ãå«ãã§ããŸããç©èªã¯ãäžçå
µã®è»éçæŽ»ãéã£ãŠãã䞻人å
¬ã»å¶(ãã®ã)ããæ°å
µ
ãšããŠå
¥éããŠããäžå°ãšã®éã«æ·±ãåæ
ãç¯ãããšããå§ãŸããŸããããããæŠäºã®æ¿åãšãšãã«ãäºäººã®é¢ä¿ãå€åãå§ããŸ
ãã
ç©èªã¯ãäžçå
µã§ããèã®èŠç¹ããå±éããã圌ã®è»éçæŽ»ã«ãããããŸããŸãªåºæ¥äºãçµéšãæãããŠããŸããèã¯ã人éãšã
ãŠã®å°å³ã倱ãã€ã€ããèªåèªèº«ãšãæŠäºã«ããé人éåãšã®éã§èŠæ©ããå§¿ãæåãããŠããŸãã
äžæ¹ãäžå°ã¯ã髿œãªäººæ Œãšåªç§ãªææ®å®ãšããŠæãããŸãããç©èªã®é²è¡ãšãšãã«ã圌ã®è€éãªæ§æ Œãå
é¢ãæããã«ãªããŸã
ãäºäººã®é¢ä¿ã¯ãåæ
ãšå°æ¬ãåºç€ãšããªããããæŠäºã®å³ããçŸå®ãšå人çãªèè€ã«ãã£ãŠæºãã¶ããããã®ãšãªã£ãŠãããŸã
ã
å°èª¬ã®åŸåã§ã¯ãèãšäžå°ã®éåœã亀é¯ããã·ãŒã³ãç¹°ãåºããããŸããå¶ã¯ã人éãšããŠã®å°å³ãåãæ»ãããšåªåããŸããã
ããã¯æŠäºã«ããç Žå£ãšé人éåãšã®æ¿ããéãã®æãŠã«ã®ã¿åŸããããã®ã§ããããšã瀺åãããŸãã
äžå°ããŸããèªèº«ã®äººçã«ããã倧ããªæ±ºæã«çŽé¢ããå¶ãšã®é¢ä¿ãéããŠèªåã®å
é¢äžçãæ·±ãæãäžããŠãããŸããäºäººã®é¢
ä¿ã¯ãæŠäºã®äžã§ã®äººéã®å°å³ãšçåã®æå³ã«ã€ããŠåãç¶ãããã®ãšãªã£ãŠãããŸãã
çµå±ãäºäººã®éåœã¯æ²åçãªå±éãèŠããŸãããããã¯åæã«èã«ãšã£ãŠã®æ°ããªåºçºç¹ãšããªããŸããå°èª¬ã¯ãäžçå
µã§ãã£ã
èãã人éãšããŠã®å°å³ãåãæ»ããæ°ããéãžãšé²ãå§¿ã§å¹ãéããŸãã
"人éå€±æ Œ"ã¯ãæŠäºã®äžã§ã®äººéã®å°å³ãçåã®æå³ã«ã€ããŠåãç¶ãã倪宰治ç¬ç¹ã®åæ
ãšæ·±ã¿ãæã€å°èª¬ã§ããäžå°ãšããã
ã£ã©ã¯ã¿ãŒã¯ããã®é«æœãªäººæ Œãšåªç§ãã«ãã£ãŠèãåŒãä»ããŸãããåæã«åœŒèªèº«ããŸãèè€ããå§¿ãæãããŠããŸãããã®å°
説ã¯ãèªè
ã«æŠäºã®æ®èæ§ãé人éåã«ã€ããŠèãããããšåæã«ã人éãšããŠã®å°å³ãåãæ»ãããšã®éèŠæ§ã匷調ããŠããŸã
ã
</thinking>
<output>
倪宰治ã®ã人éå€±æ Œãã®ããããã¯ä»¥äžã®éãã§ãã
ç©èªã¯ãäžçå
µã§ããèããæ°å
µãšããŠå
¥éããŠããäžå°ãšã®éã«æ·±ãåæ
ãç¯ããšããããå§ãŸããŸããèãšäžå°ã®é¢ä¿ã¯ãæŠ
äºã«ããé人éåãšã®éã§æºãã¶ãããŠãããŸããäžæ¹ãäžå°ããŸãè€éãªæ§æ Œãå
é¢ãæã€ãã®ãšããŠæããã圌ã®éåœã¯çµå±
æ²åçãªå±éãèŠããŸãããããã¯åæã«èã«ãšã£ãŠã®æ°ããªåºçºç¹ãšããªããŸãã
</output>
<reflection>
ãã®å°èª¬ã¯ãæŠäºã«ããé人éåãšäººéã®å°å³ã«ã€ããŠåãç¶ãããã®ã§ãããšåæã«ãèªè
ã«æ·±ãæåãäžããç©èªã§ããäžå°
ãšãããã£ã©ã¯ã¿ãŒã¯ã髿œãªäººæ Œãšåªç§ãã«ãã£ãŠèãåŒãä»ããŸãããåæã«åœŒèªèº«ããŸãèè€ããå§¿ãæãããŠãããæŠäº
ã«ããé人éåãšã®éã§æºãã¶ããããã®ãšãªã£ãŠãããŸãã
</reflection>倧åºèèµãèã«ãªã£ãŠããããå¶ãããäžå°ãåºãŠãããããã«ã·ããŒã·ã§ã³ã¯ããŸããããªãŒãã³ã¢ãã«ã§ãããŸã§æµæ¢ãªæ¥æ¬èªæç« ãçæã§ããã®ã§ããïŒ
note ã X ããã©ããŒããã ãããšããããã§ãïŒ