倧åãªã®ã¯ãå§çž®ããªã®ã§ãã
ã飯ãæã¡éã³ãããã°ããã«ããã«ãããæ
è¡ã«è¡ããªããããã³ã°ããã
èšèãè³ã§è¡ãããæŠå¿µã®å§çž®ã§ããã°ã©ããäºè±¡ã®å§çž®ã§ãããMPEGãMP3ãæ åãé³é¿ã®å§çž®æè¡ã§ãã
åŸè
ãã飯ãšéãã®ã¯å¯åºŠã®æ¹åã§ããã飯ã¯å矩éãã®å§çž®ãªã®ã«å¯ŸããŠãèšèãã°ã©ãã¯çž®çŽã§ãããã¹ã«ã¹ã«åãšãèšãããã ããäžæã人ãäžæãªäººããããããã§ãæ¥åžžã§ã¯ã人ã®èœåãæãã°æããã§çµ¶åŠãªå¹çåãšèšããã§ãããã
ããŠç©ºéçãªãã®ã¯å§çž®ã§ããŠããæéæ¹åã®æå³ãæèã®å§çž®ã¯é£ããã人ã®è©±ãããšã°ãæžãããšã°ã®å§çž®ã®ããšã§ãã
æ¥ææ¥ã®æãåã©ããèµ·ããŠããããæŽããŠããïŒããšèšãã°ããã¯éåå°ã«è¡ããããšããæå³ã ããåãæã§ã劻ãç®ãåãããã°ããã¯ãå®¶äºãããŠãã®æå³ãšã¿ãŠééããªãã
ïŒãããå§çž®ã®æ¥µåãç®ç·ããããã«ããæ
å ±äŒéã«åããã®ã¯ãªããæå³ãç¶æ³ããäžåã®ç¡é§ãªãå§çž®ããäžãå§è¿«ãŸã§å ãããšã¯ãïŒ
é話äŒé¡ããããªã²ãšã®ãããªå¯Ÿè©±ãæ©æ¢°ãåºæ¥ãããã«ãªããšã¯æã£ãŠãã¿ãŸããã§ããã
ããããGPTãã¯ãããšããLLMã§ã»ãŒå®çŸããŠããŸããŸãããAttentionïŒæ³šææ©æ§ïŒã«ãã£ãŠé·ãæèãèŠããããããã«ãªã£ãã
ããã§ã¯ããŸãè¡åæŒç®ãèšå€§ã«èµ°ããããã«æ£®çŸ
äžè±¡ã®æç« ãæŸã蟌ãããšã§ããšãã»ã³ã¹ãå§çž®ããŠæœåºããæ¬¡ã®åèªããæç« ãŸã§ããããç·šã¿åºããŸã§ã§ããããã«ãªã£ãã
å
çæ©é¢ã®ããã«å§çž®ã¯ççºçãªãã¯ãŒãç§ããã®ã§ããã
ãŸãã¯ç¥èã¢ãã«ãšããŠããã¯èµ·ãããŸãããGPT3.5ã4ããçµã¿èŸŒãã ãã£ããGPTãšããŠã
ãããŠãã®å幎ããããã®äžã¶æãæšè«ã¢ãã«ãäžæ°ã«é²åããŸãããæšè«ãšããããã«ã¯è«çã®é åãŠããGPT o1ão3ç³»åãç»å Žããã³ã¹ã1/1000ãšããDeepSeek R1ãçºæããã人é¡ã¯çŽããããªã次ã®ã¹ããŒãžã«ç«ã¡ãŸããã
æšè«èœåãé«ããããã人ãéãããã®ããã«AIãéãããããã«AIå士ã§é«ãåããšãããŸã§ãå²ç¢ã®ã¢ã«ãã¡ç¢ZEROãšåãæ¹æ³è«ãAIå士ãªã®ã§ç²ããç¥ãããã¯ããã®7.5æéç¡ç ãäœã®ãã®ã人ã®å幎åã®å¯Ÿå±ãæ°æ¥ã§çµããçµæã人ã®äžçãã£ã³ããªã³ã§ãããããããã®äººã«åå©ããAIã§ããåãŠãªãæåŒ·AIã宿ããŸããã
ãããšåãããšããããšã°ã®é åã§æ¥é²è¡ããŠããŸãã
ããããLLMã¯åºå®åãåé¡ã§ããããããæåŒ·ãšã¯èšããå€åããªãçš®ã¯æ» ã³ãã
ãã®äžã«æã§ãã€ãã«ãªã¢ã«ã¿ã€ã èªå·±é©å¿åŠç¿ã®ä»çµã¿ãçºæãããããã§ããïŒååãäžç·ã«ç掻ããã ãã§ã䞻人å人ã®èŠæ¹ã«è§ŠããŠåŠãã§ãããããããŸãããïŒãã®ãããªLLM / AI Agent ãç»å Žããã§ããããïŒããšæžããŸãããããã®äžæ©ç®ã¯ããç»å ŽããŠããŸããŸãããïŒ
æããäžæåæé²è¡ã§ãããããã§ã¯ãµã«ãAIã® Transformers-Squared ã«è§ŠããŸãããã

ããã§ã®èããŸããå§çž®ããªã®ã§ããSVDïŒSingularValueDecompositionïŒãšãããè¡ååè§£ã»å§çž®ã®çŸããæ°åŠææ³ãã³ã¢ã¢ã€ãã¢ãšããŠäœ¿ãããŸããïŒç§ã以åãã³ã³ãã¯ã¹ããã¬ã³ã¡ã³ããŒã«çµã¿èŸŒãç ç©¶ã§é©çšããææ³ã§ãã1ïŒ
SVDããæšè«æã«ã¿ã¹ã¯ã«å¿ããŠè¡åæŒç®ã«é©çšãèã®éã¿ã ã調æŽãããšãããèšãããŠã¿ãã°èª°ããæãã€ãã¹ãææ³ã§ãã
ã«ã®ã¯ãã¿ã¹ã¯ããšã«åŠç¿ããã zãã¯ãã«ã匷ååŠç¿ã«ããäœã£ãŠããããšãæšè«æã«ã¯SVD㮠Σ ïŒå¯Ÿè§è¡åïŒãã¿ã¹ã¯ã«å¿ããŠãäŸãã° æ°åŠå°çšzãã¯ãã«ã§èª¿æŽããã¡ã«ããºã ã§ãããããèè ãã¯ç¹ç°å€åŸ®èª¿æŽ (SVF)ãšåŒãã§ããŸãã

ã¢ãã«ãå ¥åãããã¿ã¹ã¯ããŸãåæãïŒç¬¬1段éïŒããã®ã¿ã¹ã¯ã«é©ããäžèšéã¿èª¿æŽã¡ã«ããºã ãçµãŠå¿çãçæããïŒç¬¬2段éïŒãâ
ããã¯ã²ãã£ãšãããšãæ±çšçã§æè»ãªé©å¿æ§ãæãããããšããç¹ã§ãé©åœçãªããšãèµ·ããã®ãããããŸããã
ææ³ã¯ãšãããã
èªå·±é©å¿åŠç¿ãã§ãããšããããšã¯å人åLLMãã§ãããšããããšãããªãã¡èªåã ãã®ã¢ã·ã¹ã¿ã³ããæé©ãªäžèœæåž«ã決ããŠé£œããããªããããã¹ãçžæãã¡ãã£ãšå¿ãç²ããæã«ã¯ãã°ãã¡ããã«ã ã£ãŠãªã£ãŠãããããšããããšã
ãã®ç¶ãã¯æ¬¡åã
- 以åãã³ã³ãã¯ã¹ããã¬ã³ã¡ã³ããŒã«çµã¿èŸŒãç ç©¶ã§é©çšããææ³ã§ãããããã¯ã20幎åãšã¯ïŒhttps://patents.google.com/patent/JP2006048286A/ja â©ïž
















