(ã¹ããã§AIã«æžãããŸãã)
ã¯ããã«
ãçæAIãžã®æç€ºã®æžãæ¹ãåãããªã...ã
èªç¶èšèªãçè§£ããæ©æ¢°ãç»å Žãããã®ã®ãç§ãã¡ã®å€ãã¯ãèªç¶èšèªã§å¹æçã«åœä»€ããæ¹æ³ãããŸã ç¿åŸããŠããŸããã
ããããã®ã¯ãã§ããèªç¶èšèªã¯ãããã°ã©ãã³ã°èšèªãæã€å³å¯ããšã¯ç°ãªããç¡éã®è¡šçŸåãšæè»æ§ãæã€å®å
šäžäœäºæã®ååšã§ãã
ãã®åŒ·åãããèšèªãšããããŒã«ããç§ãã¡ã¯ãããŸã§ãç²ããªãè¶
ç¥çãªäººéããçžæã«ããé·æé䜿ãåãããšãã£ãçµéšãããäºããããŸããã§ããã人éã«ã¯èªç¥è² è·ã®éçãååšããããã§ãã
å ããŠãå€ãã®äººãå®éã«ã¯ã人ã«åœä»€ããåŽãããããã人ã«åœä»€ãããåŽããªã®ãçŸç¶ã§ãã
ããããã誰ãã«ä»äºããããããäºèªäœã«æ
£ããŠããªãã®ã§ãã
ãããŠãåŽååã䜿ãããªãããã®é«åºŠãªæ¹æ³è«ã¯ãæªã ãªã«ã«ãããããæé»ç¥ãã®é åã«çãŸã£ãŠããŸãã
ãããã§ããããç¥èã«ã¢ã¯ã»ã¹åºæ¥ãæä»£ã«ãæªã ã«ããžãã¹æ°æžãå¹³ç©ã¿ãããæ¯æã®ããã«å
¥ãæ¿ãã£ãŠããäºããã®èšŒå·Šã§ãã
ãã®åé¡ãžã®åæã®è§£æ±ºçãšããŠãç§ãã¡ã¯ãããªãã¯ããã®ããã§ãããšãã£ãããããããããŒã«ãã¬ã€ïŒåœ¹å²æŒæïŒãããã³ãããå€çšããŠããŸãããããããAIãæ¥éã«é²åããä»ããã®ææ³ã¯é³è åãããã®å¹æã倱ãã€ã€ãããŸãã
æ¬èšäºã§ã¯ãåçŽãªããŒã«ãã¬ã€ããã³ããããè±åŽããAIã®çã®èœåãåŒãåºãããã®æ°ããã¢ãããŒãããã³ã°ããã£ãã»ãã¶ã€ã³ãã«ã€ããŠè§£èª¬ããŸãã
ãåœ¹å²æŒæããã³ãããã®éç
ãã€ãŠæå¹ã ã£ããããªãã¯ããã®ç·šéè ã§ããã®ãããªæç€ºã¯ãAIã«å¶æãçãããããªãã®ã§ãããç¹å®ã®åœ¹å²ã®ãå¶æããçããããšã§ãããã£ãœãèšèé£ããæèã®åããæã£åãæ©ãåŒã³åºãããšãã§ããã®ã§ãã
ãããããã®ã¢ãããŒãã«ã¯å€§ããªåé¡ããããŸããã
- â é³è åã»æ²¡åæ§å: ã¿ããªãåããå¶æããçãããããã¢ãŠããããã¯ã¹ãã¬ãªã¿ã€ããªãããåãã«åæããŠããŸããŸããããªãèªèº«ããããªãã®çµç¹ãæã€ç¬èªã®å²åŠã¯ããã«ã¯ãããŸããã
- â¡ å¹æã®åžèå: AIãè³¢ããªãã«ã€ããã¿ã¹ã¯ã®å 容ãããããã¯ç·šéè ãšããŠã®èŠç¹ãå¿ èŠã ãªããšèªãæšè«ããèªåã§å¶æãçãããã«ãªããŸãããçµæãšããŠãããããæç€ºããæå³ãèããŠããŸã£ãã®ã§ããããããããŒã«ãã¬ã€æç€ºããäºã«ãããçŽåãåã®ãã«ãœãæš¡å£ã«ãããæ¬æ¥ã®é«åºŠãªæšè«èœåãé»å®³ãããã±ãŒã¹ãå€çºãããŸã§ã«ãªã£ãŠããŸããŸããã
ãã®ãããªåœ¹å²æŒæåœ¢åŒã®ããã³ããã¯ããã¡ã¿ããã³ããããšåŒã°ããŠããŸãã
ã¡ã¿ãšã¯ãã髿¬¡ã®ããšããæå³åãã§ããç©äºã髿¬¡ããæœè±¡åããŠèгå¯ããããšããæŠå¿µã«ãªããŸãã
æœè±¡ãšããã®ã¯ãç¶æ³ã«åãããŠçžå¯Ÿçã«é©çšãããæŠå¿µã§ãã
çæAIãé²åãç¶ããä»ã䜿ãåŽã®æã
ãããã¡ã¿ãã®å®çŸ©ãé²åãããå¿
èŠããããŸãã
ãªãAIã¯ããªãã®ç¶æ³ãçè§£ã§ããªãã®ãïŒ
ãããªãã§ããã質åã§ãã
ããªãã¯å察é¢ã®äººéãšãããªãçµå©ã§ããŸããïŒ
ã»ãšãã©ã®äººããNoããšçããã¯ãã§ãããªããªãããçµå©ããããšãã圢åŒçãªå¥çŽã¯ããããŸã§ã«ç¯ãããèšå€§ãªæé»çãªä¿¡é Œé¢ä¿ïŒäŸ¡å€èгã®å ±æãå ±ã«éãããæéãçžæãžã®çè§£ãªã©ïŒãšããåå°ãªãã«ã¯æãç«ããªãããã§ãã
å®ã¯ãAIãžã®æç€ºããããšå
šãåãæ§é ãããŠããŸãã
ãœãããŠã§ã¢éçºã®äžçã«ãBDD=ããã€ãã¢é§åéçºãšããææ³ããããŸãã
ããã¯
- GivenïŒåæïŒ
- WhenïŒãã€ïŒ
- ThenïŒçµæïŒ
ãšããèªç¶èšèªã«è¿ãæžåŒã§ä»æ§ãèšè¿°ããé¢ä¿è
ã®èªèéœéœ¬ããªããããã®ãã®ã§ãã
ããããå€ãã®éçºè
ãããã®GivenïŒåæïŒãèªç¶èšèªã§èšè¿°ããã®ããå®ã¯æãé£ããããšèšããŸãã
ãªããªããããã¯ãçµå©ãã®æ¯å©ãšåãåé¡ãæ±ããŠããããã§ãã
ç§ãã¡ã¯ç°¡åãªåæãæžããŠããã€ããã§ãããã®è£ã«ããèšå€§ãªãæé»ç¥ãããæèããŸã§ããæ°è¡ã®æç« ã§äŒããããšããŠããã®ã§ãã
ããã¯åççã«äžå¯èœã§ãã
AIãšã®å¯Ÿè©±ã«ãããå°é£ã®æ£äœã¯ããŸãã«ããã§ãã
ç§ãã¡ã¯AIã«Givenãæž¡ããŠããã€ããã§ããã®å®ãèšå€§ãªãä¿¡é Œé¢ä¿ãã®æ§ç¯ããã£é£ã°ããŠãçµå©ïŒïŒã¿ã¹ã¯å®è¡ïŒããè¿«ã£ãŠããã®ã§ãã
次ã®ã¬ãã«ãžïŒãããã¥ã¢ã«ããããæ²æ³ããž
ã§ã¯ãã©ãããã°AIã«ç§ãã¡ã®ãæé»ç¥ããã€ã³ã¹ããŒã«ã§ããã®ã§ããããã
ãã®ãã³ãã¯ããããã¥ã¢ã«ããšãæ²æ³ãã®éãã«ãããŸãã
- ããã¥ã¢ã«ïŒæ§æ¥ã®ããã³ããïŒ:
- ãããããå Žåã¯ãããããªããããšããå ·äœçãªæç€ºã
- æ¢ç¥ã®åé¡ã«ã¯åŒ·ãããããã¥ã¢ã«ã«ãªãæªç¥ã®åé¡ã«ã¯å¯Ÿå¿ã§ããªãã
- æ²æ³ïŒæ°ããã¡ã¿ããã³ããïŒ:
- ããããå€æã®æ ¹å¹¹ãšãªãæé«äœã®åºæ¬ååã
- æªç¥ã®åé¡ã«çŽé¢ãããšããã©ã®ååã«ç«ã¡è¿ã£ãŠå€æãã¹ãããšããæéãäžããã
ãããŠããã®ãæ²æ³ãã®æ£äœãšã¯ãããã°æå³ããããã€ã¢ã¹ã®å®è£
ã«ä»ãªããŸããã
ããã§èšããã€ã¢ã¹ãšã¯ãäžå
¬å¹³ãªåèŠã®ããšã§ã¯ãªãããç¡æ°ã®éžæè¢ã®äžãããæãŸãã倿ãè¡ãããã®æå³çãªæéããã€ãŸãåçç¡çšã®ã欲åãã®ããšã§ãããã®äŸ¡å€å€æã®è»žãAIã«åã蟌ãããšã§åããŠãAIã¯æªç¥ã®ç¶æ³ã§ãäžè²«æ§ã®ãããããªããããããæèãå±éã§ããããã«ãªãã®ã§ãã
ããããã®AIãšã®å¯Ÿè©±ã§æ±ããããã®ã¯ãåå¥ã®ã¿ã¹ã¯ãèšãããããã¥ã¢ã«ããäžããããšã§ã¯ãããŸãããAIãå šãŠã®è¡åã®æ ãæãšãããããªãã ãã®ãã¡ã¿æ²æ³ããå¶å®ããã€ã³ã¹ããŒã«ããããšãªã®ã§ãã
ãããŠãã®ãã¡ã¿æ²æ³ãã¯ã誰ããéæ³ã®ããã«æããŠããããã®ã§ã¯ãããŸããã
ããªãããèªåã§æžãããšã«ãæå³ããããŸãã
ãã®æãæ ¹æºçãªèšèšãä»è
ã«å§ããããšã¯ãèªèº«ã®æèã®æ žãèŠç¥ãã¬èª°ãã«æãæž¡ãè¡çºã«ä»ãªããŸããã
åèŠ=欲åã®æ±ºå®ãä»è
ã«å§ããæç¹ã§ãããã¯ãŸãã«ãAIã«ãã眮æå¯èœãªäžäœäºæã®ååšãã«æãäžãã£ãŠããŸããŸãã
æèã®ã¬ã³ãºãèšèšãããã³ã°ããã£ãã»ãã¶ã€ã³ã
ãã®ãæ²æ³ããAIã«ã€ã³ã¹ããŒã«ããäœç³»çãªæ¹æ³è«ããã³ã°ããã£ãã»ãã¶ã€ã³=èªç¥èšèšã§ãã
ããã¯ãAIã«å€é¢çãªã圹å²ïŒRoleïŒããäžããã®ã§ã¯ãªããå
é¢çãªãäžçã®æãæ¹ã®ã¬ã³ãºïŒLensïŒããäžãããšããèãæ¹ã«åºã¥ããŸãã
ãã®ãã¬ã³ãºãã¯ã以äžã®5ã€ã®èŠçŽ ã§èšèšãããŸãã
æèã®ã¬ã³ãºãèšèšãã5ã€ã®èŠçŽ
-
åæ (Premise):
æèã®ãOSã»ç©çæ³åãããã®äžçã§çãããšã®ãªãäºå®ãå®ãã¹ã䟡å€èгã -
ç¶æ³ (Situation):
æèã®ãçŸåšå°ããä»ãäœãèµ·ããŠããŠãã©ã®ãããªå€æ°ãããã®ãã -
ç®ç (Purpose):
æèã®ãç®çå°ãããã®ã¿ã¹ã¯ã§äœãéæãããã®ããšããå ·äœçãªãŽãŒã«ã -
åæ© (Motive):
æèã®ããšã³ãžã³ãããªããã®ç®çå°ãç®æãã®ãïŒãšããæ ¹æºçãªçç±ãå²åŠã -
å¶çŽ (Constraint):
æèã®ãè¡åç¯å²ããç®çéæã®ããã«ãå®ãã¹ãã«ãŒã«ãè¶ããŠã¯ãªããªãå¢çç·ã
å®è·µäŸïŒã³ã°ããã£ãã»ãã¶ã€ã³ã®ãµã³ãã«
ã§ã¯ããã®ãã³ã°ããã£ãã»ãã¶ã€ã³ããå®è·µã§ã©ã®ããã«äœ¿ãã®ããå ·äœçãªãµã³ãã«ãèŠãŠã¿ãŸãããã
ãé¡ïŒ 瀟å åãã«ãæ°ããAIãã£ãããããéçºã®äºç®ç²åŸãç®æããäŒç»æžãã®ãã©ãããäœæããã
NGãªæç€ºïŒæ§æ¥ã®ããã³ããïŒ
ããªãã¯ããã®ã³ã³ãµã«ã¿ã³ãã§ããAIãã£ããããããå°å
¥ããããã®äŒç»æžãäœæããŠãã ããã
ããã§ã¯ã誰ã«åãããã©ããªèæ¯ãæã€ãäœãæåªå ããäŒç»æžãªã®ããå šãåããããããäžè¬çã§é³è ãªã¢ãŠããããããåºãŠããŸããã
OKãªæç€ºïŒã³ã°ããã£ãã»ãã¶ã€ã³ïŒ
# æèã®ã¬ã³ãº
## åæ (Premise):
- æã
ã®ããžãã¹ã«ãããæåªå
äºé
ã¯ã顧客æºè¶³åºŠã®åäžãã§ããã
- çµå¶é£ã¯åžžã«ROIïŒæè³å¯Ÿå¹æïŒãéèŠããããŒã¿ã«åºã¥ãã倿ã奜ãã
- 瀟å
åãã®äŒç»æžã¯ãèŠç¹ã3ããŒãžä»¥å
ã«ãŸãšããã®ãæ
£äŸã§ããã
## ç¶æ³ (Situation):
- 顧客ããã®åãåããä»¶æ°ããåååææ¯ã§30%å¢å ããŠããã
- ããã«ãããµããŒãéšéã®è² è·ãå¢å€§ããå¿çæéãé·æåã顧客æºè¶³åºŠãäœäžåŸåã«ããã
- ç«¶åã®X瀟ã¯ããã§ã«ãµããŒãæ¥åã«AIãå°å
¥ãææãäžããŠããã
## ç®ç (Purpose):
- çµå¶äŒè°ã«ãããŠãAIãã£ãããããéçºãããžã§ã¯ãã®æ£åŒãªäºç®ïŒ500äžåïŒã®æ¿èªãåŸãã
- ãã®ããã®èª¬åŸææãšããŠãèæ¯ã»ç®çã»æåŸ
广ã»éçºèšç»ãæç¢ºã«èšããäŒç»æžã®ãã©ãããäœæããã
## åæ© (Motive):
- ãã®ãããžã§ã¯ãã®æ ¹æºçãªçãã¯ãåãªãã³ã¹ãåæžã§ã¯ãªãã
- **人éã®ã¹ã¿ãããåçŽãªåãåãã察å¿ããè§£æŸãã圌ããæã€å
±æåãé«åºŠãªåé¡è§£æ±ºèœåããæ¬åœã«å°ã£ãŠãã顧客ã®ããã«éäžãããããšã«ããã**
- ããã«ããã顧客æºè¶³åºŠã ãã§ãªããåŸæ¥å¡æºè¶³åºŠãåäžãããåªç§ãªäººæã®å®çãå³ãã
## å¶çŽ (Constraint):
- å°éçšèªã®äœ¿ããããé¿ãã誰ãèªãã§ãçè§£ã§ããå¹³æãªèšèé£ããããããšã
- æ¢åã®ãµããŒãéšéã®åããåŠå®ãããããªè¡šçŸã¯äžå䜿ããã圌ããæ¯æŽããããã®ããŒã«ã§ãããšããèŠç¹ã貫ãããšã
- Markdown圢åŒã§åºåããããšã
ãã®ããã«ãã¬ã³ãºããèšèšããŠAIã«æž¡ãããšã§ãAIã¯åãªãäºå®ã®çŸ åã§ã¯ãªããããªãã®çµç¹ã®äŸ¡å€èŠ³ïŒæ¬²åïŒã«åºã¥ããã説åŸåã®ããäžè²«ããã¹ããŒãªãŒãçæããããšãå¯èœã«ãªããŸãã
ãŸãšã
AIãšã®åæ¥ã¯ãæ°ãããã§ãŒãºã«çªå ¥ããŸããã
- 衚局çãªåœ¹å²æŒæ=ããŒã«ãã¬ã€ã¯ããã¯ãéçšããªãã
- ãã®æ ¹æºã«ã¯ãæé»ç¥ã®å£ãããã
- 解決çã¯ãåå¥ã®ãããã¥ã¢ã«ãã§ã¯ãªããããŒãœãã«ãªã¡ã¿æ²æ³ãAIã«äžããããšã
- ãã®å ·äœçãªèšèšææ³ãã³ã°ããã£ãã»ãã¶ã€ã³ã§ããã
- ããã¯å®è·µçãªãµã³ãã«ã§ç€ºãããã«ãå ·äœçãªæç€ºãšããŠäœç³»åã§ããã
ç§ãã¡ã®åœ¹å²ã¯ãåãªããããã³ãããæãã人ããããAIã®æèãã®ãã®ãèšèšããæèã®èšèšè
=Cognitive Designerãžãšå€ãã£ãŠãããŸãã
AIã®é²åã«åãããŠç§ãã¡èªèº«ãé²åããŠããããšããããããããã®æä»£ã«æ±ããããã¹ãã«ãªã®ããç¥ããŸããã
åèè«æ
- è«æå: "Constitutional AI: Harmlessness from AI Feedback"
- è«æURL: https://arxiv.org/abs/2212.08073
- å ¬éæ¥: 2022幎12æ
Anthropic瀟ãæå±ãããæ²æ³AIãã¯ãAIã®è¡åãåŸããããã®äžé£ã®**æç€ºçãªååïŒa list of principlesïŒ**ããæ²æ³ããšããŠäžããã¢ãããŒãã§ãã
ããã¯ãAIã«å Žåœããçãªæç€ºãäžããã®ã§ã¯ãªããè¡åã®æ ¹å¹¹ãšãªãã䟡å€èгãããåºæ¬ååããäžããããšã®æå¹æ§ãå®èšŒããŠããŸãããã³ã°ããã£ãã»ãã¶ã€ã³ãã«ãããåæãåæ©ãå®çŸ©ããããšã®éèŠæ§ãããããã¬ãã«ã®ç ç©¶æ©é¢ã瀺ããŠãã匷åãªãšããã³ã¹ã§ããè«æã§ã¯ããã®ã¢ãããŒãã®ç®çã以äžã®ããã«è¿°ã¹ãŠããŸãã
"The aim is for the AI to learn to answer questions helpfully and harmlessly without relying on human feedback [...] and for its principles for doing so to be transparent."
ïŒãã®ç®çã¯ãAIã人éã®ãã£ãŒãããã¯ã«é Œãããšãªã圹ç«ã€åœ¢ã§ç¡å®³ã«å¿çããããšãåŠç¿ãããŸãããã®ããã®ååãéæã§ããããšã§ããïŒ
- è«æå: "Structure Guided Prompt: Instructing Large Language Model in Multi-Step Reasoning by Exploring Graph Structure of the Text"
- è«æURL: https://arxiv.org/abs/2402.13415
ãã®ç ç©¶ã¯ãè€éãªæšè«ã¿ã¹ã¯ã«ãããŠãããã³ããã«æç¢ºãªè«çæ§é ãäžããããšã®æå¹æ§ãçŽæ¥çã«ç€ºããŠããŸããææ¡ãããŠãããæ§é åèªå°ããã³ãããã¯ãææ§ãªèªç¶èšèªã®ããã¹ãããé¢ä¿æ§ãæç€ºãããã°ã©ãæ§é ã«äžåºŠãããã³ã°ããããã®æ§é ã«æ²¿ã£ãŠæèãé²ããããææ³ã§ãã
ããã¯ããã³ã°ã-ãã£ãã»ãã¶ã€ã³ãã«ããããã¬ã³ãºãã®åœ¹å²ãããªãã¡æèã®ããã®æ çµã¿ïŒç¶æ³ãç®çãå¶çŽïŒãäžãããšããã¢ãããŒããšå®å
šã«äžèŽããŸããè«æã§ã¯ããã®ææ³ã®å¹æã次ã®ããã«çµè«ä»ããŠããŸãã
"it enables LLMs to provide more accurate and context-aware responses."
ïŒããã«ãããLLMã¯ããæ£ç¢ºã§ãæèãèªèããå¿çãæäŸã§ããããã«ãªã£ãïŒ
- è«æå: "When "A Helpful Assistant" Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Models"
- è«æURL: https://arxiv.org/abs/2311.10054
- å ¬éæ¥: 2023幎11æ
ãåœ¹å²æŒæïŒãã«ãœãïŒããã³ããã®éçããåŠè¡çã«æ€èšŒããç ç©¶ã§ããããã®å°éå®¶ãšããŠæ¯ãèã£ãŠãã ããããšãã£ãæç€ºããå¿
ãããLLMã®æ§èœãåäžãããããã§ã¯ãªãããšã瀺ããŠããŸãã
ããã¯ã衚局çãªãã«ãœãèšå®ãããããæ¬è³ªçãªè¡åååã®å®çŸ©ïŒïŒæ²æ³ïŒãæ§é åãããæèã®æ çµã¿ïŒïŒã¬ã³ãºïŒãžãšç§»è¡ããå¿
èŠãããããšããæèšã®æ£åœæ§ãè£åŒ·ãããšããã³ã¹ã§ããè«æã®çµè«éšã§ã¯ã以äžã®ããã«è¿°ã¹ãããŠããŸãã
"Contrary to popular belief, adding personas to system prompts does not necessarily improve the performance of LLMs and, in some cases, can even be detrimental."
ïŒäžè¬çãªä¿¡å¿µã«åããŠãã·ã¹ãã ããã³ããã«ãã«ãœãã远å ããããšã¯ãå¿ ãããLLMã®æ§èœãåäžãããããã§ã¯ãªããå Žåã«ãã£ãŠã¯æå®³ã§ããããïŒ