2013ǯ¤Ë¥ª¥Ð¥ÞÁ°ÂçÅýÎΤ¬Ç¾¸¦µæµðÂç¥×¥í¥¸¥§¥¯¥È
¡ÖBRAIN Initiative¡×*¹¤òȯɽ¡£
ÊƹñΩ±ÒÀ¸¸¦µæ½ê(NIH)¤¬¸øɽ¤·¤Æ¤¤¤ë¡ÖBRAIN2025¡×¤È¤¤¤¦¸¦µæÇò½ñ¤ò¥Ù¡¼¥¹¤Ë¡¢
2025ǯ¤òÌÜɸ¤È¤·¤ÆǾ¤ÎÁ´ÍƲòÌÀ¤ò¤¹¤ë¤È¤¤¤¦¥×¥í¥°¥é¥à¤Ç¤¢¤ë¡£
Æ°²è
BRAIN Initiative¤Ë¤ÏGoogle¤ò´Þ¤àÊ£¿ô¤Î´ë¶È¤¬»²²Ã¤·¤Æ¤ª¤ê¡¢¤³¤Î¸¦µæ¤ÇÇݤä¿¿À·Ð²Ê³ØŪÃ諤¬ÈÆÍÑAI³«È¯¤Ë¥Õ¥£¡¼¥É¥Ð¥Ã¥¯¤µ¤ì¤ë¡£
Ʊǯ¤ËGoogle¤¬¡¢
¥¸¥§¥Õ¥ê¡¼¡¦¥Ò¥ó¥È¥ó»áΨ¤¤¤ë
DNN Research¼Ò¤òÇã¼ý¡£
Íâǯ2014ǯ¤Ë¤Ï¡¢
DeepMind¤òÇã¼ý¤¹¤ë¡£
¤½¤ì¤ËÊ»¤»¤Æ¡¢Ç§ÃοÀ·Ð²Ê³Ø¤ÎÇî»Î¹æµÚ¤Ó¥²¡¼¥à¥×¥í¥°¥é¥Þ¡¼¤Î¸ª½ñ¤¤ò»ý¤Ä
¥Ç¥ß¥¹¡¦¥Ï¥µ¥Ó¥¹»á¤ò¸Û¤¤Æþ¤ì¤ë¡£
̤Íè³Ø¼Ô·óȯÌÀ²È¤Ç¤¢¤ë
¥ì¥¤¡¦¥«¡¼¥Ä¥ï¥¤¥ë»á¤Ï¡¢2012ǯ¤ËGoogle¤«¤é¥Ø¥Ã¥É¥Ï¥ó¥È¤µ¤ì¤Æ¤¤¤ë¡£
Èà¤Ï¡ÖThe Singularity Is Near¡×¤ÎÃø¼Ô¤Ç¤¢¤ë¡£
Google¤ÎAI¸¦µæ½ê¤Ï¡¢ÊÆ¥Þ¥¦¥ó¥Æ¥ó¥Ó¥å¡¼ËܼҤÈÀ¤³¦¼çÍ×ÅԻԤ˵òÅÀ¤òÃÖ¤¯
¥¸¥§¥Õ¡¦¥Ç¥£¡¼¥ó»áΨ¤¤¤ë
Google Brain¤È¡¢¥¤¥®¥ê¥¹¤ËËܼҤò¹½¤¨¤ë
DeepMind¤Ç¤¢¤ë¡£
GAN(ŨÂÐŪÀ¸À®¥Í¥Ã¥È¥ï¡¼¥¯)¤Îȯ°Æ¼Ô¤Ç¤¢¤ë
¥¤¥¢¥ó¡¦¥°¥Ã¥É¥Õ¥§¥í¡¼»á¤â2022ǯ¤«¤éDeepMind¥Á¡¼¥à¤Ë½ê°¤¹¤ë¡£
Google Brain¤Ï¡¢2012ǯ¤ËƱ¼Ò¤¬»ý¤Ä¥³¥ó¥Ô¥å¡¼¥Æ¥£¥ó¥°¥ê¥½¡¼¥¹¤Ç"ǤȤ¤¤¦³µÇ°¤Î³ÍÆÀ"¤ËÀ®¸ù¤·¤¿¤ê¡¢
TensorFlow¤È¤¤¤Ã¤¿¿¼Áسؽ¬ÍÑʬ»¶½èÍý¥Õ¥ì¡¼¥à¥ï¡¼¥¯¡¢
JAX¤Ê¤É¤Î»¼º´Ø¿ô¤Î¼«Æ°Èùʬ¥Õ¥ì¡¼¥à¥ï¡¼¥¯¤ò¸ø³«¤·¤¿¤ê¤È¡¢AI¥Ö¡¼¥à¤Î¶È³¦¤ÇÀè¿Ø¤òÀڤäƤ¤¤ë¡£TensorFlow¤Ï³Ø½¬·¸¿ô¤ÎºÇŬ²½·×»»(³ÎΨŪ¸ûÇ۹߲¼Ë¡)¤ä¸ûÇۤμ«Æ°Èùʬ¤È¤¤¤Ã¤¿¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È¤Î·×»»²áÄø¤ò¹â®¤Ë¼Â¹Ô¤¹¤ë¡£¤Þ¤¿¥Ç¡¼¥¿¤ÎÆɹþ¤ß¤«¤é¥â¥Ç¥ë·×»»¤Þ¤Ç¡¢ÊÂÎó·×»»¤Ë¤è¤ë¹â®²½¤ò¼Â¸½¤¹¤ë¹ü»Ò¤òÈ÷¤¨¤ë¡£
JAX¤ÏTensorflow¤ÈƱÍͤËXLA(Accelerated Linear Algebra)¤È¸Æ¤Ð¤ì¤ëÀþ·ÁÂå¿ô¤Î±é»»¤ËÆò½¤·¤¿¥³¥ó¥Ñ¥¤¥é¤ËÂбþ¤·¤Æ¤ª¤ê¡¢@jit¥Ç¥³¥ì¡¼¥¿¤ò»ØÄꤵ¤ì¤¿¥Õ¥©¡¼¥Þ¥Ã¥È¤Î´Ø¿ô¤Ë¤Ä¤±¤ë¤À¤±¤Ç¼Â¹Ô»þ¤Ë¼«Æ°Åª¤Ë¥³¥ó¥Ñ¥¤¥ë¤µ¤ì¡¢Â絬ÌϤʹÔÎó·×»»¤äforʸ¤Ë¤è¤ë·«¤êÊÖ¤·¤Ê¤É¤ò¹â®²½¤¹¤ë¤³¤È¤¬¤Ç¤¤ë¡£
¿¤¯¤Î¥Õ¥ì¡¼¥à¥ï¡¼¥¯¤Ï¡¢¡É
·×»»¥°¥é¥Õ¡É¤Ë¤è¤ê¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È¥ï¡¼¥¯¤ò¹½ÃÛ¤·¤Æ¤¤¤ë¡£·×»»¥°¥é¥Õ¤Ï·×»»¤Îή¤ì¤ò¥°¥é¥Õ¹½Â¤¤Ë¤è¤êµ½Ò¤·¤¿¤â¤Î¤Ç¡¢Ê£»¨¤Ê½èÍý¤Ç¤â»ë³ÐŪ¤Ë½èÍýÆâÍƤòÍý²ò¤¹¤ë¤³¤È¤¬¤Ç¤¤ë¡£
¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È¥ï¡¼¥¯¤Î³Ø½¬¤Ç¤Ï»¼º´Ø¿ô¤ò·×»»¥°¥é¥Õ¤È¤·¤Æɽ¸½¤·¡¢¼«Æ°Èùʬ¤ÇÊÐÈùʬ¤òµá¤á¤ë¤Î¤¬ÄêÀФȤʤäƤ¤¤ë¡£
TensorFlow¤Ï¡¢¡ÉDefine and Run¡É¤È¸Æ¤Ð¤ì¤ë¡Ö·×»»¥°¥é¥Õ¤ò¹½ÃÛ¤·¤¿¸å¤Ë¥Ç¡¼¥¿¤òή¤·½èÍý¤ò¼Â¹Ô¤¹¤ë¡×Êý¼°¤ò¼è¤Ã¤Æ¤¤¤¿¤¬¡¢¸å¤ËFacebook¼Ò¤¬ºÎÍѤ¹¤ë¡É
Define-by-run¡É¤Ç¤Ï¡¢¡Ö·×»»¥°¥é¥Õ¤Î¹½ÃۤȽçÅÁÇŽèÍý¤Î¼Â¹Ô¤¬Æ±»þ¤Ë¹Ô¤ï¤ì¤ë¡×Êý¼°¤¬¹Í¤¨¤é¤ì¡¢Google¼Ò¤â¤½¤ÎÊý¼°¤ËÂбþ¤¹¤ë¤è¤¦²þÎɤµ¤ì¤Æ¤¤¤ë¡£¼«Á³¸À¸ì½èÍý¤Ë¤Ï¸å¼Ô¤ÎÊý¼°¤¬¸þ¤¤¤Æ¤¤¤ë¤È¤µ¤ì¤ë¡£
2017ǯ¤ËRNN¤äLSTM¤ËÂå¤ï¤Ã¤ÆŤ¤Ê¸¾Ï¤Î½èÍý¤ò²Äǽ¤Ë¤·¤¿¼«Á³¸À¸ì½èÍý¥¢¡¼¥¥Æ¥¯¥Á¥ã¤Ç¤¢¤ë¡Ö
Transformer¡×¤ò³«È¯¤·¤¿¤Î¤âGoogle¤Ç¤¢¤ë¡£
Transformer¤Î´Êñ¤ÊÀâÌÀ
¡ÖTransformer¡×¤Î»ÅÁȤß
¤¹¤Ê¤ï¤Á¡¢Ê¸¾Ï¤ä²èÁü¤Î¥Ô¥¯¥»¥ë¤Ê¤É¡¢¥Ç¡¼¥¿¤Îή¤ìÊý¼«ÂΤò³Ø½¬¤·¡¢¼¡¤ËÍè¤ë¤â¤Î¤ò³ÎΨŪ¤Ë¿äÄê¡¢¤Þ¤¿¤Ïͽ¬¤¹¤ë¼êË¡¤Ç¤¢¤ë
ʸ¾Ï¤ä²èÁü¤Ê¤É¤Î¥Ç¡¼¥¿¤½¤Î¤â¤Î¤ò¥Ù¥¯¥È¥ë¤Î·Á¼°¤Çɽ¸½¤·¡¢°ÕÌ£¤òɽ¤¹Àøºß¶õ´Ö¤Ç¤Î¥Ù¥¯¥È¥ë¤ËÊÑ´¹¤¹¤ë¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È(encoder)¤ò¹½ÃÛ¤·¡¢¤µ¤é¤Ë¤½¤ì¤òµÕÊÑ´¹¤¹¤ë¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È(decoder)¤ò¹½ÃÛ¤¹¤ë¤³¤È¤Ç¡¢°ÕÌ£¤ò¼è¤ê°·¤¨¤ë¤è¤¦¤Ë¤·¤Æ¤¤¤ë¡£
Transformer¤Ï¡¢µ¡³£ËÝÌõ¤Ê¤É¤Î·ÏÎóÊÑ´¹¥¿¥¹¥¯¤Ç¹â¤¤Àǽ¤òȯ´ø¤·¡¢ÆþÎÏ·ÏÎó¤È½ÐÎÏ·ÏÎó¤Î´Ö¤Î°Í¸´Ø·¸¤ò³Ø½¬¤¹¤ë´ðÈץ˥塼¥é¥ë¥Í¥Ã¥È¥ï¡¼¥¯¥â¥Ç¥ë¤È¤Ê¤Ã¤Æ¤¤¤ë¡£
TransformerÆâÉô¤Î»ÅÁȤߤò¤¶¤Ã¤¯¤ê¤È°Ê²¼¤Î2¤Ä¤ÎÂ礤ÊÆÃħ¤Ëʬ¤±¤ë
¢£¼«¸ÊÃí°Õµ¡¹½
¼«¸ÊÃí°Õµ¡¹½¤Ï¡¢ÆþÎϤγÆÍ×ÁǤ¬Â¾¤ÎÍ×ÁǤȤɤÎÄøÅÙ´ØÏ¢¤·¤Æ¤¤¤ë¤«¤ò·×»»¤¹¤ë¤â¤Î¤Ç¤¢¤ë¡£¤³¤Î·×»»¤Ë¤è¤ê¡¢ÆþÎϤνç½ø¤Ë´Ø·¸¤Ê¤¯¡¢½ÅÍפʾðÊó¤òÃê½Ð¤¹¤ë¤³¤È¤¬¤Ç¤¤ë
¥Þ¥ë¥Á¥Ø¥Ã¥ÉÃí°Õµ¡¹½¤Î·×»»ÊýË¡¤Ï¡¢°Ê²¼¤Îή¤ì
1)ÆþÎϤγÆÍ×ÁǤò¡¢¥¯¥¨¥ê¡ÊQuery¡Ë¡¢¥¡¼¡ÊKey¡Ë¡¢ÃÍ¡ÊValue¡Ë¤Î3¤Ä¤Î¥Ù¥¯¥È¥ë¤Ëʬ²ò¤¹¤ë
2)¥¯¥¨¥ê¤È¥¡¼¤Î¥Ù¥¯¥È¥ë´Ö¤ÎÎà»÷ÅÙ¤ò·×»»¤·¤Æ¥¢¥Æ¥ó¥·¥ç¥ó¥¹¥³¥¢¤ò»»½Ð¤¹¤ë
3)Îà»÷ÅÙ¤¬¹â¤¤¥¡¼¤Î¥Ù¥¯¥È¥ë¤ÈÃͤΥ٥¯¥È¥ë¤ò³Ý¤±¹ç¤ï¤»¤ë
¢£°ÌÃÖ¥¨¥ó¥³¡¼¥Ç¥£¥ó¥°
Transformer¤Ç¤Ï¡¢ÆþÎϤγÆÍ×ÁǤ˰ÌÃÖ¾ðÊó¤òÍ¿¤¨¤ë¡£¤³¤ì¤Ï¡¢Ã±¸ì¤Î½ç½ø¤ä¡¢Ê¸¤Î¹½Â¤¤Ê¤É¤Î¾ðÊó¤ò¹Íθ¤¹¤ë¤¿¤á¤Ç¤¢¤ë¡£
ñ½ã¤ËÆþÎϤνçÈÖ¤ËÈÖ¹æ¤ò³ä¤ê¿¶¤ë
Á´ÂΤΥ¢¡¼¥¥Æ¥¯¥Á¥ã¤È¤·¤Æ¡¢Â礤¯Ê¬¤±¤Æ¥¨¥ó¥³¡¼¥À¤È¥Ç¥³¡¼¥À¤Î2¤Ä¤«¤é¹½À®¤µ¤ì¤Æ¤¤¤ë
¢£¥¨¥ó¥³¡¼¥À
¥¨¥ó¥³¡¼¥À¤Ï¡¢ÆþÎϤò¼«¸ÊÃí°Õµ¡¹½¤Ç½èÍý¤·¤Æ¡¢¤½¤ÎÆÃħ¤òÃê½Ð¤¹¤ë
1)ÆþÎϤγÆÍ×ÁǤ˰ÌÃÖ¥¨¥ó¥³¡¼¥Ç¥£¥ó¥°¤òŬÍѤ¹¤ë
2)¼«¸ÊÃí°Õµ¡¹½¤òÊ£¿ô²óŬÍѤ·¤Æ¡¢ÆÃħ¤òÃê½Ð¤¹¤ë
¢£¥Ç¥³¡¼¥À
1)¥¨¥ó¥³¡¼¥À¤¬½ÐÎϤ·¤¿ÆÃħ¥Ù¥¯¥È¥ë¤òÆþÎϤȤ·¤Æ¼õ¤±¼è¤ë
2)¼«¸ÊÃí°Õµ¡¹½¤òÊ£¿ô²óŬÍѤ·¤Æ¡¢½ÐÎϤËɬÍפʾðÊó¤òÃê½Ð¤¹¤ë
3)¥Ç¥³¡¼¥À¤Î½ÐÎÏ¥Ù¥¯¥È¥ë¤Ï¡¢½ÐÎÏ·ÏÎó¤Î³ÆÍ×ÁǤγÎΨʬÉÛ¤ËÊÑ´¹¤µ¤ì¡¢³ÎΨʬÉۤ˴ð¤Å¤¤¤Æʸ¤¬À¸À®¤µ¤ì¤ë
2020ǯ¡¢¥è¥Ï¥Í¥¹¡¦¥±¥×¥é¡¼Âç³Øµ¡³£³Ø½¬¸¦µæ½ê¤Î¸¦µæ¼Ô¤ÏTransformer¤Î¼«¸ÊÃí°Õµ¡¹½¤¬¡Ö
¥Û¥Ã¥×¥Õ¥£¡¼¥ë¥É¥Í¥Ã¥È¥ï¡¼¥¯¡×¤È¤¤¤¦Ï¢ÁÛµ²±¥â¥Ç¥ë¤È»÷¤Æ¤¤¤ë¤È¤¤¤¦»ØŦ¤¬È¯É½¤µ¤ì¤ë¡£
https://arxiv.org/abs/2008.02217
2022ǯ¤ËǧÃοÀ·Ð²Ê³Ø¼Ô¤Î¥¸¥§¡¼¥à¥º¡¦¥¦¥£¥Ã¥Æ¥£¥ó¥È¥ó»á¤Ï¡¢¡Öµ²±¤Ë½ÅÍפÊÌò³ä¤ò²Ì¤¿¤¹³¤ÇϤΥâ¥Ç¥ë¤Ï¡¢Transformer¤Ë¤è¤Ã¤Æ¿À·Ðȯ²Ð¥Ñ¥¿¡¼¥ó¤òºÆ¸½¤¹¤ë¤³¤È¤¬¤Ç¤¤ë¡×¤È¼çÄ¥¤·¤¿¡£
²Æì²Ê³Øµ»½ÑÂç³Ø±¡Âç³Ø¤Ï¡¢
¥Û¥Ã¥×¥Õ¥£¡¼¥ë¥É¥Í¥Ã¥È¥ï¡¼¥¯¤Î²þÎɤËÀ®¸ù¤·¤¿¤È¤¤¤¦È¯É½¤ò¹Ô¤¤¸À¸ì½èÍý¥â¥Ç¥ë¤Î²þÁ±¤Ë¹×¸¥¤¹¤ë¤È»×¤ï¤ì¤ë¡£
2021ǯ10·î¡¢GoogleBrain¤Ï»ë³Ð¡¢Ä°³Ð¡¢¸À¸ìÍý²òÎϤòÅý¹ç¤·Æ±»þ¤Ë½èÍý¤¹¤ë¥Þ¥ë¥Á¥â¡¼¥À¥ëAI¥â¥Ç¥ë¡Ö
Pathways¡×¤ò³«È¯Ãæ¤Ç¤¢¤ë¤Èȯɽ¤·¤¿¡£
https://blog.google/technology/ai/introducing-path...
1¤Ä¤Î¥â¥Ç¥ë¤Ç¿ôÀé¡¢¤Þ¤¿¤Ï¿ôÉ´Ëü¤â¤Î¥¿¥¹¥¯¤ò¼Â¹Ô¤Ç¤¤ë¤È¥Ç¥£¡¼¥ó»á¤Ï¼çÄ¥¤¹¤ë¡£°ìÈ̤ο¼Áسؽ¬¥â¥Ç¥ë¤Ï¡¢¤¢¤ë¥¿¥¹¥¯¤ÇÍ¥¤ì¤Æ¤¤¤ë¾ì¹ç¤Ç¤â¡¢¸Ä¡¹¤Î¥¿¥¹¥¯¤ËÆò½¤·¤¹¤®¤Æ¤¤¤ë·¹¸þ¤¬¤¢¤ê½ÀÆðÀ¤¬¤Ê¤¤¡£¥Þ¥ë¥Á¥â¡¼¥À¥ëAI¤Ï¡¢°Û¤Ê¤ë¼ïÎà¤Î¥Ç¡¼¥¿¤ò²£ÃÇŪ¤ËÍý²ò¤·¡¢°ì¤Ä¤ÎÆþÎϤǰۤʤë¼ïÎà¤Î¥Ç¡¼¥¿¤ò½ÐÎϤǤ¤ë¤È¤¤¤¦¡£¤³¤ÎPathways¤ò»È¤¤¡¢PaLM¤È¤¤¤¦¼«Á³¸À¸ì½èÍý¥â¥Ç¥ë¤ò¸½ºß³«È¯Ãæ¤Ç¤¢¤ë¡£
Google¤Ï¡¢Pathways¤ò¥Ù¡¼¥¹¤Ë¤·¤¿¼«Á³¸À¸ì½èÍý¤ÈDiffusion Model¤òÏ¢·È¤·¡¢²èÁüÀ¸À®¥â¥Ç¥ë
Parti¤òȯɽ¤·¤¿¡£Dalle2¤äimagen¤ÈÈæ¤Ù¤Æ¡¢Ä¹¤¤Ê¸¾Ï¤ò½èÍý¤Ç¤¤ë¤È¤¤¤¦¡£
¤Þ¤¿¡¢Æ°²èÀ¸À®AI¥â¥Ç¥ë
Imagen Video¤ò2022ǯ10·î¤Ëȯɽ¤·¤¿¡£
https://parti.research.google/
https://imagen.research.google/video/
Google¤Ï¡¢¼«Á³¸À¸ì½èÍý¤È¤·¤ÆPathways¤ò¥Ù¡¼¥¹¤Ë¤·¤¿¿ô³Ø¤ÎÌäÂê¤ò²ò¤±¤ë¥â¥Ç¥ë
Minerva¤ò³«È¯¤·¤¿¡£
¹â¹»¤äÂç³Ø¥ì¥Ù¥ë¡¢¿ô³Ø¥ª¥ê¥ó¥Ô¥Ã¥¯¥ì¥Ù¥ë¤ÎÌäÂê¤ò²ò¤¯¤³¤È¤¬¤Ç¤¤ë¤¬¡¢Åú¤¨¤¬Ê£¿ô½Ð¤Æ¤¯¤ë¤¿¤á¡¢Â¿¿ô·è¤ÇºÇ¤â¤é¤·¤¤¤â¤Î¤òÁªÂòŪ¤ËÀ¸À®¤¹¤ë¡£ÌäÂê¤ò¹ñ¸ìŪ¤Ë²ò¤¯¤¿¤á¡¢´Êñ¤ÊÊ¿Êýº¬¤ÎÌäÂê¤ò²ò¤±¤Ê¤«¤Ã¤¿¤ê¤¹¤ë¾ì¹ç¤â¤¢¤ë¡£
https://ai.googleblog.com/2022/06/minerva-solving-...
¤µ¤é¤ËGoogle¤Ï¡¢PaLM¤ä¿¼Áسؽ¬¤Ë¤è¤ëʪÂÎǧ¼±¤òÅý¹ç¤·¤Æ¡¢¥í¥Ü¥Ã¥È¤Ë¼ÂÁõ¤¹¤ë¤È¤¤¤¦¸¦µæ¤ò¹Ô¤Ã¤Æ¤¤¤ë¡£¸À¸ìǧ¼±¡¢¹ÔÆ°·×²è¡¢²èÁüǧ¼±¡¢ÍÍ¡¹¤Ê¥¿¥¹¥¯¤¬¼Â¸½¤Ç¤¤ë¤è¤¦¤Ë¤Ê¤Ã¤Æ¤¤¤ë¡£
¶áǯ¤Î²èÁüÀ¸À®¥â¥Ç¥ë¤Ï¡¢¸À¸ì¥â¥Ç¥ë¤ÈÏ¢·È¤·¤Æ¾ðÊó¤òÀ¸À®¤¹¤ë¤³¤È¤¬¤Ç¤¤ë¡£¤½¤ì¤ÈƱÍͤˡ¢¹ÔÆ°·×²è¤â²èÁü¤Î¤è¤¦¤ËÀ¸À®¤¹¤ë¤³¤È¤¬¤Ç¤¤ë¡£
Google¤Î¥í¥Ü¥Æ¥£¥¯¥¹ÉôÌç¤Ï¡¢
Robotics Transformer 1(RT-1)¤È¸Æ¤Ð¤ì¤ë¥í¥Ü¥Ã¥È¤ÎÆþÎϤȽÐÎϹÔÆ°(¥«¥á¥é²èÁü¡¢¥¿¥¹¥¯»Ø¼¨¡¢¥â¡¼¥¿Ì¿Îá¤Ê¤É)¤ò¥È¡¼¥¯¥ó²½¤·¤Æ³Ø½¬¤·¡¢¼Â¹Ô»þ¤Ë¥ê¥¢¥ë¥¿¥¤¥à¿äÏÀ¤ò²Äǽ¤Ë¤¹¤ë¥Þ¥ë¥Á¥¿¥¹¥¯¥â¥Ç¥ë¤ò³«È¯¤·¤¿¡£
¤¢¤é¤«¤¸¤á13Âæ¤Î¥í¥Ü¥Ã¥È¤òÍѤ¤¤Æ17¥ö·î´Ö¤Ë¼ý½¸¤µ¤ì¤¿¡¢700°Ê¾å¤Î¥¿¥¹¥¯¤ò¥«¥Ð¡¼¤¹¤ë13Ëü¥¨¥Ô¥½¡¼¥É¤«¤é¤Ê¤ëÂ絬ÌϤʼÂÀ¤³¦¤Î¥í¥Ü¥Æ¥£¥¯¥¹¥Ç¡¼¥¿¥»¥Ã¥È¤Ç·±Îý¤µ¤ì¤Æ¤¤¤ë¡£
Æ°²è
2022ǯ12·î¡¢Google¤Ïʸ¾Ï¤ò²èÁü¤È¤·¤ÆTransformer¤Ë³Ø½¬¤µ¤»¤ë¤³¤È¤¬²Äǽ¤È¤Ê¤ë¡¢¿·¤·¤¤²èÁüʬÎà¥â¥Ç¥ëCLIPPO¤òÄó°Æ¤·¤¿¡£
https://arxiv.org/abs/2212.08045
Google¤Ï¡¢¡Ö
Flan-PaLM¡×¤È¸Æ¤Ð¤ì¤ëµðÂç¸À¸ì¥â¥Ç¥ë¤ò³«È¯¤·¤¿¡£Êƹñ°å»ÕÌȵö»î¸³(USMLE)·Á¼°¤Î¥¿¥¹¥¯¡ÖMedQA¡×¤ÇÀµÅúΨ67.6%¤òµÏ¿¤·¡¢PubMedQA¤Ç79.0%¤òãÀ®¤·¤¿¡£
57¥¸¥ã¥ó¥ë¤ÎÁªÂòÌäÂ꥿¥¹¥¯¡ÖMMLU¡×¤Î°åÎťȥԥ寤ǤâFlan-PaLM¤ÎÀ®ÀӤϾ¤ÎµðÂç¥â¥Ç¥ë¤òο²ï¤·¤¿¡£Î×¾²Ã챤Ç80.4%¡¢ÀìÌç°å³Ø¤Ç83.8%¡¢Âç³ØÀ¸Êª³Ø¤Ç88.9%¡¢°äÅÁ°åÎųؤÇ75.0%¤ÎÀµÅúΨ¤Ç¤¢¤ë¡£
https://arxiv.org/abs/2212.13138
2022ǯ9·î¡¢Google¤Ï¥Æ¥¥¹¥È¤«¤é3D¥â¥Ç¥ë¤òÀ¸À®¤Ç¤¤ë¡ÖDreamFusion¡×¤ò³«È¯¤·¤¿¡£Ê£¿ô¤ÎÀŻ߲褫¤é3D¥â¥Ç¥ë¤òÀ¸À®¤¹¤ëNeRF¤ä¡¢Diffusion Model¤ò»ÈÍѤ·¤Æ¤¤¤ë¡£
https://dreamfusion3d.github.io/
*¹¥«¥Ö¥êºâÃĤ¬È¯°Æ¡¢ÊƹñÀ¯Éܤ¬È¯Â¤·¤¿¹ñ²È·×²è
¤³¤ì¤Þ¤Ç¤ËGoogle¤¬Çã¼ý¤·¤¿AI¥¹¥¿¡¼¥È¥¢¥Ã¥×°ìÍ÷
¤½¤Î¾¥ª¥Ã¥¯¥¹¥Õ¥©¡¼¥ÉÂç³Ø¤«¤é¥¹¥Ô¥ó¥ª¥Õ¤µ¤ì¤¿2¤Ä¤ÎAI¥Ù¥ó¥Á¥ã¡¼*²¤¬DeepMind¤ËÇã¼ýÅý¹ç¤µ¤ì¤Æ¤¤¤ë
¡¦*²Dark Blue Labs,Vision Factory
(¼«Á³¸À¸ì½èÍý),(²èÁüǧ¼±)
¡¦Clever Sense
(°ÌÃÖ¾ðÊó¥Ù¡¼¥¹¥æ¡¼¥¶¡¼¿äÁ¦°ÆÆ⥵¡¼¥Ó¥¹)
¡¦Tinker Square
(¥â¥Ð¥¤¥ë¥á¥Ã¥»¡¼¥¸¥ó¥°¥¢¥×¥ê)
¡¦Jetpac
(²èÁü¥Ù¡¼¥¹°ÌÃÖ¾ðÊ󸡺÷)
¡¦Granata Decision Systems
(¥Þ¡¼¥±¥Æ¥£¥ó¥°¤ÈÁÈ¿¥¤Î°Õ»×·èÄê¤ËÂФ¹¤ë¥·¥Ê¥ê¥ªÊ¬ÀÏ¥µ¡¼¥Ó¥¹)
¡¦Timeful
(¼«Æ°¥¹¥±¥¸¥å¡¼¥ê¥ó¥°¥¢¥×¥ê)
¡¦Moodstocks
(²èÁü²òÀÏ)
¡¦API.AI
(¼«Á³¸À¸ìÂÐÏÃ¥·¥¹¥Æ¥àºîÀ®¥Ä¡¼¥ë)
¡¦Kaggle
(µ¡³£³Ø½¬&¥Ç¡¼¥¿¥µ¥¤¥¨¥ó¥Æ¥£¥¹¥È¤Î¥³¥ß¥å¥Ë¥Æ¥£¥×¥é¥Ã¥È¥Õ¥©¡¼¥à)
¡¦Halli Labs
(µ¡³£³Ø½¬&¿Í¹©ÃÎǽ)
¡¦AIMATTER
(¼«»£¤ê²Ã¹©¥¢¥×¥ê)
¡¦Banter
(²ñÏÃ¥³¥Þ¡¼¥¹¥×¥é¥Ã¥È¥Õ¥©¡¼¥à)
¡¦Wabii
(Siri¸þ¤±µ»ö¸«½Ð¤·orÍ×Ìóʸ¾ÏÆɤ߾夲µ¡Ç½)
¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡
¥Ï¥µ¥Ó¥¹»á¤Ï
¡ÖǾ¤ÎƯ¤¤ÏÈó¾ï¤ËÊ£»¨¤À¤¬¥³¥ó¥Ô¥å¡¼¥¿¡¼¤ÇºÆ¸½¤Ç¤¤Ê¤¤¤â¤Î¤Ï¤Ê¤¤¤È¤¤¤¦¤Î¤¬²æ¡¹¤Î¸½»þÅÀ¤Î¸«Êý¤À¡×
¤È¸ÀµÚ¤·¤Æ¤ª¤ê¡¢700¿ÍÂÎÀ©(¼Ò°÷)¤ÇÈÆÍÑAI³«È¯¤Ë¼è¤êÁȤó¤Ç¤¤¤ë¡£*Æü·Ðµ»ö¤Î¥¤¥ó¥¿¥Ó¥å¡¼
¥Ï¥µ¥Ó¥¹»á¤¬Á϶Ȥ·¤¿DeepMind¤Ï¡¢
¿¼Áض¯²½³Ø½¬¤Î¸¦µæ¤Ë½ÅÅÀ¤òÃÖ¤¤¤Æ¤ª¤ê¡¢Q³Ø½¬¤òŬÍѤ·¤¿¤³¤È¤ÇÍ̾¤ÊDeep Q-Networks¤òÂåɽ¤È¤·¤¿¥²¡¼¥àAI¤Î³«È¯¤Ë¶¯¤ß¤¬¤¢¤ë¡£
ºÇ¶á¤Ç¤Ï¡¢¤è¤êǾ¤Î°ìÉôµ¡Ç½¤òÌÏÊ路¤¿
Generative Query Network(GQN)¤Î³«È¯¤ËÀ®¸ù¤·¤Æ¤¤¤ë¡£
GQN¤Ï¡¢¤¢¤ëÀ¤³¦¤Ë¤ª¤¤¤Æ°Û¤Ê¤ëÍÍ¡¹¤Ê»ëÅÀ¤«¤é¤Î¥·¡¼¥ó(±ÇÁü)¤òÆâÉôÀ¸À®¤·¡¢¤½¤Î¸åÊ̤λëÅÀ¤«¤é¤Î¥·¡¼¥ó(±ÇÁü)¤òͽ¬¤¹¤ë¤È¤¤¤¦¡¢À¤³¦¥â¥Ç¥ë(³°³¦¤«¤é¤Î»É·ã¤ò¸µ¤Ë³°³¦À¤³¦¤òÆâÉô¥·¥ß¥å¥ì¡¼¥È)¹½Â¤¤Ë¶á¤¤¥¢¥ë¥´¥ê¥º¥à¤Ç¤¢¤ë¤È¤¤¤¦¡£
¤³¤ì¤Ë¤è¤ê¡¢¡Ö¿Í´Ö¤¬¼êÆ°¤Ç¥é¥Ù¥ëÉÕ¤±¤¹¤ë¤³¤È¤Ê¤¯¡¢À¤³¦¤ò³Ø½¬¤¹¤ë¤³¤È¤¬²Äǽ¤Ë¤Ê¤ë¡×¤ÈDeepMind¤Î¸¦µæ¼Ô¤Ï¼çÄ¥¤¹¤ë¡£
¥Ï¥µ¥Ó¥¹»á¤òÂåɽ¤È¤¹¤ëÁ϶ȼԤé¤Ï¡¢¿À·Ð²Ê³Ø¤Ë¤ª¤±¤ëºÇ¿·¤ÎÃ諤òAI¸¦µæ¤Ë¼è¤êÆþ¤ì¤ë¤¿¤á¡¢University College London(¥®¥ã¥Ä¥Ó¡¼·×»»¿À·Ð²Ê³Ø¥æ¥Ë¥Ã¥È)¤ËÎÙÀܤ¹¤ë·Á¤ÇËܼҤòÃÖ¤¤¤¿¡£
±ÑUCL¤Î¸¦µæ¼Ô,³ØÀ¸¤é¤ò¤¤¤ÁÁ᤯°Ï¤¤¹þ¤àÌÜŪ¤â¤¢¤ë¤È¸«¤é¤ì¤ë¡£
DeepMind¤Ï¡¢
¶¯²½³Ø½¬¤È¹¥´ñ¿´¤³¤½¤¬ÃÎǽ(ÌäÂê²ò·è)¤Î¸»Àô¤À¤È¹Í¤¨¤Æ¤ª¤ê¡¢¤½¤ì¤éDQN¤Î¤è¤¦¤Ê¥×¥í¥°¥é¥à¤Ë°Û¼ïÊ£¿ô¤Îµ¡³£³Ø½¬¤ò¿ô¿¤¯ÁȤ߹ç¤ï¤»¡¢¿Í´Ö¤Î¤è¤¦¤Ê½ÀÆðÀ¤¢¤ëAI¥·¥¹¥Æ¥à¤ò³«È¯¤·¤Æ¤¤¤¯Êý¿Ë¤È¤Ê¤Ã¤Æ¤¤¤ë¡£
Ǿ¤ò¤½¤Î¤Þ¤ÞºÆ¸½¤¹¤ë¤È¤¤¤¦¼êË¡¤Ç¤Ï¤Ê¤¯¡¢Ç¾¤ò»²¹Í¤Ë¤·¤Æ½ÅÍפÊÉôÉʤò¥½¥Õ¥È¹©³ØŪ¤Ë¼Â¸½¤·¤Æ¤¤¤¯¡£
¶ñÂÎŪ¤Ë¤Ï¡¢ÆâȯŪưµ¡¤ä¥¨¥Ô¥½¡¼¥Éµ²±¡¢±¿Æ°½èÍý¡¢ÁÛÁüÎÏ¡¢¸À¸ì¤Ê¤É¤Ç¤¢¤ë¡£
AGI¤ÎºÇÄãÍ×·ï
- ¸«¤¿¤â¤Î¤òǧ¼±¤·È½Ê̤¹¤ë
- ³°³¦¤«¤éÆþÎϤµ¤ì¤ë¾ðÊó¤òÁªÊ̤·¡¢°ì»þŪ¤Ëµ²±¤òÊݤÁ¤Ê¤¬¤é¡¢À¤³¦¤Î´Ø·¸À¤ÈÃÏ¿Þ¤òÇÄ°®¤¹¤ë
- ¼«Æ°Åª¤Ë·×²è¤òΩ¤Æ¡¢¹ÔÆ°¤Î·ë²Ì¤òÁÛÁü¤·¤Ê¤¬¤é¡¢¥â¥Î¤òÁàºî¤¹¤ë
- ¤³¤ì¤é¤Îºî¶È¤ò¸À¸ì½èÍý¤ÈÏ¢·È¤·¤Ê¤¬¤é¡¢ÌäÂê¤ò¥ê¥¢¥ë¥¿¥¤¥à¤Ç¿äÏÀ¤·¤Æ¤¤¤¯
- ¤¦¤Þ¤¯¤¤¤Ã¤¿ÊýË¡¤äµ»Ë¡¤ò·«¤êÊÖ¤¹¤è¤¦³Ø½¬¤¹¤ë
¡ÒÄɲÃÍ×·ï¡Ó
- Ã챤¬¤Ê¤¯¤Æ¤â¡¢Ì¤·Ð¸³¤Î¥¿¥¹¥¯¤äÊ£»¨¤Ê¥¿¥¹¥¯¤Ê¤É¤ËÂФ·¤Æ²¾Àâ¤òΩ¤Æ¤Æ¡¢¤¹¤Ð¤ä¤¯¼«ÎϤDzò·è¤Ç¤¤ë
- ´û¤ËÆÀ¤¿Ãηäò¡¢Â¾¤ÎÎΰè¤Þ¤ÇžÍѤǤ¤ë
- ɬÍפ˱þ¤¸¤Æ¡¢²Ê³Ø¤Ë´Ø¤¹¤ëÂçÎ̤ÎÃμ±¤È¥Ç¡¼¥¿¤ò³èÍѤ¹¤ë
- ´Ö°ã¤Ã¤Æ¤¤¤ë¾ðÊó¤òÇË´þ¤·¡¢¤É¤¦¤Ç¤â¤¤¤¤¥¿¥¹¥¯¤«¤éƨ¤²¤ë
- ²ò¤¯¤Ù¤ÌäÂê¤ò¼«Ê¬¤Çõ¤·¡¢¼Â¸³·×²è¤Î¹©Äøɽ¤òΩ¤Æ¤ë¤Þ¤Ç¤Î¼«Î§À¤È¹¥´ñ¿´¤òÈ÷¤¨¤ë
- ¹â¹»¡¢Âç³Ø°Ê¾å¤Î¿ô³Ø´ðÁ䬤¢¤ê¡¢¾®³Ø¹»¥ì¥Ù¥ë¤Îľ´ÑʪÍý³Ø¤È»»¿ô±þÍÑÎϤ¬¤¢¤ë
2023ǯ1·î11Æü¡¢DeepMind¤Ï¡¢²èÁü¤«¤éÀ¤³¦¥â¥Ç¥ë¤ò³Ø½¬¤·¡¢¤½¤ì¤ò»ÈÍѤ·¤ÆĹ´ü»ëÅÀ¤«¤é¹Í¤¨¤ÆºÇŬ¤Ê¹ÔÆ°¤ò³Ø½¬¤¹¤ë»ö¤¬½ÐÍè¤ë¡Ö
DreamerV3¡×¤òȯɽ¤·¤¿¡£
https://arxiv.org/pdf/2301.04104v1.pdf
¤³¤ì¤Ï2020ǯ¤Ëȯɽ¤µ¤ì¤¿¡Ö
À¤³¦¥â¥Ç¥ë¥Ù¡¼¥¹¶¯²½³Ø½¬¡×¤È¸Æ¤Ð¤ì¤ëµ»½Ñ¤ò¤è¤ê¿Ê²½¤µ¤»¤¿¤â¤Î¤Ç¤¢¤ë¡£
¡ÖÀ¤³¦¥â¥Ç¥ë¥Ù¡¼¥¹¶¯²½³Ø½¬¡×¤È¤Ï¡¢¡É¿Í´Ö¤Î¹âÅ٤ʳؽ¬Ç½ÎϤò»Ù¤¨¤Æ¤¤¤ë¤Î¤ÏǾÆ⥷¥ß¥å¥ì¡¼¥¿¡½¤Ë´ð¤Å¤¯Ì¤Íèͽ¬¤È¹ÔÆ°·×²è¤Ç¤¢¤ë¡É¤È¤¤¤¦²¾Àâ¤Î¤â¤È¡¢Ç¾Æ⥷¥ß¥å¥ì¡¼¥¿¤òÈ÷¤¨¤Æ¶¯²½³Ø½¬¥¨¡¼¥¸¥§¥ó¥È¤ò·±Îý¤·¤è¤¦¤È¤¤¤¦¥³¥ó¥»¥×¥È¤Ç¤¢¤ë¡£
ʪÂΤμïÎࡢʪÂΤΰÌÃÖ¡¢ÊªÂΤȤ½¤Î¼þÊմĶ¤È¤ÎÁê¸ßºîÍѤʤɡ¢¾Íè¤Î·ë²Ì¤òͽ¬¤¹¤ë¤Î¤ËÌòΩ¤Ä³µÇ°¤ò¼èÆÀ¤·¡¢À¤³¦¥â¥Ç¥ë¤ò»È¤Ã¤Æ¹Ô¤ï¤ì¤¿Í½Â¬¤«¤é¹ÔÆ°¤ò³Ø½¬¤·¡¢³Ø½¬¤·¤¿¹ÔÆ°¤ò¼Â¹Ô´Ä¶¤Ç¼Â¹Ô¤·¤Æ¿·¤·¤¤·Ð¸³¤ò¼ý½¸¤¹¤ë¡£
¤½¤·¤Æ¼Â¹Ô»þ¤Ë¤Ï¡¢¹½ÃÛ¤µ¤ì¤¿À¤³¦¥â¥Ç¥ë¤ò»ÈÍѤ·¤Ê¤¬¤éÊó½·¤òͽ¬¤·¡¢¹ÔÆ°¤òÀ¸À®¤¹¤ë¡£
2021ǯ8·î¡¢DeepMind¤Ï¤µ¤Þ¤¶¤Þ¤Ê¼ïÎà¤ÎÆþÎϤȽÐÎϤò½èÍý¤Ç¤¤ëÈÆÍѤο¼Áسؽ¬¥â¥Ç¥ë¡Ö
Perceiver¡×¤ò³«È¯¤·¤¿¡£
https://arxiv.org/abs/2107.14795
2¼¡·×»»¤ä¥á¥â¥ê¤Î¥³¥¹¥È¤ò¤«¤±¤º¤Ë¡¢¤è¤êŤ¤ÆþÎÏ¥·¡¼¥±¥ó¥¹¤ò½èÍý¤Ç¤¤ë¤È¤¤¤¦¡£¤³¤Î¥â¥Ç¥ë¤Ï¡¢¥Æ¥¥¹¥È,²èÁü,²»À¼¤Ê¤ÉÊ£¿ô¤Î¥Ç¡¼¥¿¥¿¥¤¥×¤ÎƱ»þÆþÎϤò¼õ¤±Æþ¤ì¤ë¤³¤È¤¬¤Ç¤¤ë¡£
Perceiver¤Ï²»³Ú¤òÀ¸À®¤¹¤ë¤³¤È¤¬¤Ç¤¤ë¡£
²»³Ú¤ÎÎã
2022ǯ4·î28Æü¡¢DeepMind¤Ï²èÁü¤È¥Æ¥¥¹¥È½èÍý¤ò·ë¤ÓÉÕ¤±¤¿¸À¸ì¥â¥Ç¥ë¡Ö
Flamingo¡×¤òȯɽ¤·¤¿¡£
²èÁü¤ÎÆâÍƤˤĤ¤¤Æʸ¾Ï¤òÍѤ¤¤ÆÀâÌÀ¤¹¤ë¤³¤È¤¬¤Ç¤¡¢¤½¤Î²èÁü¤òÏÃÂê¤Ë¥Á¥ã¥Ã¥È¤ò¤¹¤ë¤³¤È¤â¤Ç¤¤ë¡£
https://storage.googleapis.com/deepmind-media/Deep...
2022ǯ5·î12Æü¡¢DeepMind¤ÏÍÍ¡¹¤Ê¥¿¥¹¥¯¤ò°ì¤Ä¤Î¥â¥Ç¥ë¤Ç¼Â¹Ô¤¹¤ë¤³¤È¤¬¤Ç¤¤ëÅý¹ç¥â¥Ç¥ë¡Ö
Gato¡×¤òȯɽ¤·¤¿¡£
¥Á¥ã¥Ã¥È¡¢²èÁü¤ÎÀ¸À®¤ÈÀâÌÀ¡¢»Í§±é»»¡¢ÊªÂΤòÄϤà¥í¥Ü¥Ã¥È¤ÎÆ°ºî¡¢¥²¡¼¥à¤Î¹¶Î¬Åù¡¹¡¢600¤Ë¤âµÚ¤Ö¿ô¡¹¤Î¥¿¥¹¥¯¤ò¤³¤Î°ì¤Ä¤Î¥â¥Ç¥ë¤Ç¼Â¹Ô¤¹¤ë¤³¤È¤¬¤Ç¤¤ë¤È¤¤¤¦¡£
https://arxiv.org/pdf/2205.06175.pdf
¤³¤Î¾¤Ë¤â¡¢DeepMind¤ÏºÇÀèü¤ÎËüǽ¤ÊAI¸¦µæ¤À¤±¤Ç¤Ê¤¯¡¢¼«Á³²Ê³Ø¤Ë¤¹¤°±þÍѲÄǽ¤ÊÆò½·¿AI¤â³«È¯¤·¸ø³«¤·¤Æ¤¤¤ë¡£Transformer¤È¶¯²½³Ø½¬¤òÍ»¹ç¤µ¤»¤¿¡Ö
AlphaFold¡×¤È¤¤¤¦¥¿¥ó¥Ñ¥¯¼ÁÀÞ¤ê¾ö¤ßÌäÂê¤ò¹â¤¤ÀºÅÙ¤Çͽ¬¤¹¤ëAI¤ò̵½þ¸ø³«¤·¤Æ¤¤¤ë¡£
¤³¤ì¤Þ¤Ç¤ËDeepMind¤¬³«È¯¤·¤¿²Ê³Ø¸¦µæÆò½·¿AI
- ¥¿¥ó¥Ñ¥¯¼Á¤ÎÀÞ¤ê¾ö¤ßͽ¬
- ºàÎÁʪÀ²½³Ø¤Î¤¿¤á¤Îʬ»ÒÆ°Îϳط׻»¤Î¸úΨ²½
- ³ËÍ»¹ç±¿Å¾¤Î¾ò·ïºÇŬ²½
- °äÅÁ»Ò°Û¾ï¤Îͽ¬
- µ¤¾Ýͽ¬¤Î¸úΨ²½
2022ǯ02·î¡¢DeepMind¤Ï¼«Æ°¤Ç¥×¥í¥°¥é¥à¤Î¥³¡¼¥Ç¥£¥ó¥°¤¬²Äǽ¤ÊAI¡Ö
AlphaCode¡×¤òȯɽ¤·¤¿¡£
https://www.deepmind.com/blog/competitive-programm...
¼«Á³¸À¸ì¤ÇÆþÎϤ·¤¿Ã±½ã¤Ê¥×¥í¥ó¥×¥È¤«¤é¥³¡¼¥É¤òÀ¸À®¤Ç¤¤ë¡£¤½¤ÎǽÎϤϡ¢¶¥µ»¥×¥í¥°¥é¥ß¥ó¥°¥³¥ó¥Æ¥¹¥ÈŽ¢CodeforcesŽ£¤Ç²áµî¤Ë½ÐÂꤵ¤ì¤¿¥×¥í¥°¥é¥ß¥ó¥°²ÝÂê¤ò²ò¤¯¥¿¥¹¥¯¤Ç¡¢Ê¿¶Ñ¥é¥ó¥¥ó¥°¾å°Ì54.3%¤ËÆþ¤ë¼ÂÎϤǤ¢¤ë¡£
AlphaCode¤ÏC++¡¢C#¡¢Go¡¢Java¡¢JavaScript¡¢Lua¡¢PHP¡¢Python¡¢Ruby¡¢Rust¡¢Scala¡¢TypeScript¤È¤¤¤Ã¤¿¥×¥í¥°¥é¥ß¥ó¥°¸À¸ì¤ËÂбþ¤·¤Æ¤¤¤ë¡£
¤½¤ì¤Þ¤Ç¤Ë¸«¤¿¤³¤È¤Î¤Ê¤¤ÌäÂê¤ò²ò¤¯¤³¤È¤¬¤Ç¤¡¢¥³¥¢¤È¤Ê¤ë¥í¥¸¥Ã¥¯¤ò¥È¥ì¡¼¥Ë¥ó¥°¥Ç¡¼¥¿(³Ø½¬¸µ)¤«¤é¥³¥Ô¡¼¤¹¤ë¤À¤±¤È¤¤¤¦Æ°ºî¤Ï¤·¤Ê¤¤¡£AlphaCode¤Ï¡¢414²¯¸Ä¤Î¥Ñ¥é¥á¡¼¥¿¤«¤é¤Ê¤ëTransformer¥Ù¡¼¥¹¤Î¸À¸ì¥â¥Ç¥ë¤Ç¤¢¤ë¡£
AlphaCode¤ÏÌäÂꤴ¤È¤ËÂçÎ̤ÎC++¤ÈPython¤Î¥×¥í¥°¥é¥à¤òºîÀ®¤·¡¢¥Õ¥£¥ë¥¿¥ê¥ó¥°¡¦
¥¯¥é¥¹¥¿¥ê¥ó¥°(kÊ¿¶Ñ)¡¦¥é¥ó¥¯ÉÕ¤±¤È¤¤¤¦¥×¥í¥»¥¹¤ò·Ð¤ÆºÇ½ªÅª¤Ë10¸Ä¤Î¸õÊä¤ò»Ä¤¹¤³¤È¤Ç¡¢¹Ê¤ê¹þ¤ó¤Ç¤¤¤¯¡£
2022ǯ10·î¡¢DeepMind¤Ï¹ÔÎó¤ÎÀѤò¸úΨŪ¤Ë·×»»¤¹¤ë¤¿¤á¤Î̤ȯ¸«¤Î¥¢¥ë¥´¥ê¥º¥à¤òƳ¤½Ð¤¹¡Ö
AlphaTensor¡×¤ò³«È¯¤·¤¿¡£
¶¯²½³Ø½¬¤ò»ÈÍѤ·¡¢¹ÔÎó¤ÎÀѤò·×»»¤¹¤ëºÇŬ¤ÊÊýË¡¤òµá¤á¤ë¤³¤È¼«ÂΤò¥²¡¼¥à¤È¤ß¤Ê¤·¡¢AlphaTensor¤Ë·±Îý¤µ¤»¤¿¡£¤½¤Î·ë²Ì¡¢¡Ö4¡ß5¤Î¹ÔÎó¡×¤È¡Ö5¡ß5¤Î¹ÔÎó¡×¤ÎÀѤòµá¤á¤ëºÝ¤Ë¡¢Ä̾ï¤Î·×»»ÊýË¡¤Ç100²ó¤Î¾è»»¤¬É¬ÍפʤȤ³¤í¤ò¡¢76²ó¤Ë¸º¤é¤¹¤³¤È¤¬¤Ç¤¤¿¡£
AlphaTensor¤Ï¹ÔÎó·×»»¤À¤±¤Ç¤Ê¤¯¡¢¹â®µÕÊ¿Êýº¬·×»»¥¢¥ë¥´¥ê¥º¥à¤ä¥À¥¤¥¯¥¹¥È¥éË¡¡¢¥Ï¥Õ¥Þ¥óÉä¹æ¡¢¥«¥é¥Ä¥ÐË¡Åù¤Î¸Å¤¯¤«¤é¤¢¤ë·×»»¥¢¥ë¥´¥ê¥º¥à¤òÂ礤¯²þÁ±¤Ç¤¤ë²ÄǽÀ¤¬¤¢¤ë¡£HTTPÄÌ¿®¥×¥í¥È¥³¥ë¤Î¥Ñ¥±¥Ã¥È½èÍý¤Ê¤É¡¢¥Í¥Ã¥È¥ï¡¼¥¯¤ÎÄÌ¿®¤½¤Î¤â¤Î¤â¹â®²½¤Ç¤¤ë²ÄǽÀ¤¬¤¢¤ë¡£¤Þ¤¿²èÁü°µ½Ì¤äÆ°²è°µ½Ì¤Ê¤É¡¢·×»»ÆâÍƤò°µ½Ì¤¹¤ëɬÍפ¬¤¢¤ë¤è¤¦¤Ê¼êË¡¤â²þÎɤǤ¤ë¤È´üÂÔ¤µ¤ì¤ë¡£
2020ǯ2·î¡¢DeepMind¤Ï
¥°¥é¥Õ¥Í¥Ã¥È¥ï¡¼¥¯¤È¤¤¤¦¼êË¡¤òÍøÍѤ·¤Æ¡¢ÊªÍý¥·¥ß¥å¥ì¡¼¥·¥ç¥ó¤ò»È¤ï¤º¤Ë¸ÇÂΤäήÂΤÎʪÍýɽ¸½¤òÌÏÊï¤Ç¤¤ëµ»½Ñ¤òȯɽ¤·¤¿¡£
https://github.com/deepmind/deepmind-research/tree...
Î㤨¤Ð¡¢Î®ÂΤΥ·¥ß¥å¥ì¡¼¥·¥ç¥ó¤ò¹Ô¤¦¾ì¹ç¡¢Î®ÂÎÎϳؤδðÁäǤ¢¤ë¥Ê¥Ó¥¨¡¦¥¹¥È¡¼¥¯¥¹ÊýÄø¼°¤ò¥³¡¼¥É¤ËÁȤ߹þ¤àɬÍפ¬¤¢¤ë¡£¤·¤«¤·¤³¤Î¼êË¡¤Ç¤Ïºî¤ê¤³¤ó¤ÀÊýÄø¼°¤òÍøÍѤ·¤¿¥·¥ß¥å¥ì¡¼¥·¥ç¥ó¤ò¹Ô¤¦É¬Íפ¬¤Ê¤¤¡£É¬ÍפʤΤϴѬ¥Ç¡¼¥¿¤Î³Ø½¬¤Ç¤¢¤ë¡£
Áê¸ßºîÍѤ¹¤ëήÂΡ¢ ¹äÂΡ¢ ÊÑ·Á²Äǽ¤ÊʪÂΤʤɹ¤¤ÈϰϤΥ·¥ß¥å¥ì¡¼¥·¥ç¥ó¤Ïγ»Ò¥Ù¡¼¥¹¤Ç¶á˵Ʊ»Î¤ò¤Ä¤Ê¤¤¤À¥°¥é¥ÕNN¤ò»È¤Ã¤ÆÀµ³Î¤ËÌÏÊï¤Ç¤¤ë¡£³Æγ»Ò¤Ï¼þÊÕ¾ðÊó¤ò½¸ÀÑ¡¢ÊÑ´¹¤·²Ã®ÅÙ¤Îͽ¬¤ò¶µ»Õ¤¢¤ê³Ø½¬¤¹¤ë¡£
¤³¤Î¼êË¡¤Ï¥Ñ¥é¥á¡¼¥¿¤¬¤ï¤«¤é¤Ê¤¤Ì¤ÃΤÎʪÍý¸½¾Ý¤ËÂФ·¤Æ¡¢Í½Â¬¥â¥Ç¥ë¤òºîÀ®¤¹¤ëºÝ¤Ë͸ú¤Ç¤¢¤ë¤È¹Í¤¨¤é¤ì¤ë¡£
2023ǯ12·î¡¢GoogleBrain¤ÈDeepMind¤Ï¡Ö
Gemini 1.0¡×¤ÈÂꤷ¤¿¥Þ¥ë¥Á¥â¡¼¥À¥ëÂ絬ÌϸÀ¸ì¥â¥Ç¥ë¤òȯɽ¤·¤¿¡£
https://deepmind.google/technologies/gemini/
¤³¤Î¥â¥Ç¥ë¤Ï¡¢ºÇ½é¤«¤é¥Þ¥ë¥Á¥â¡¼¥À¥ë¤Ê¥Ç¡¼¥¿¥»¥Ã¥È¤ÇƱ»þ³Ø½¬¤µ¤»¤é¤ì¤Æ¤ª¤ê¡¢DeepMind¤¬ÆÀ°Õ¤È¤¹¤ë¶¯²½³Ø½¬¤Îµ»½Ñ¤Ç¡¢¿Í´Ö¤«¤é¤Î¥Õ¥£¡¼¥É¥Ð¥Ã¥¯¤ò´ð¤Ë·±Îý¤µ¤ì¤Æ¤¤¤ë¡£
Ã챤ÈÌäÂê²ò·èǽÎϤò¥Æ¥¹¥È¤¹¤ë»Øɸ¤Î1¤Ä¤Ç¤¢¤ë MMLU(Massive Multitask Language Understanding)¤Ë¤ª¤¤¤Æ¡¢¿Í´Ö¤ÎÀìÌç²È¤ò¾å²ó¤ë¥Ñ¥Õ¥©¡¼¥Þ¥ó¥¹¤ò¼¨¤·¤¿¡£
¤Þ¤¿Æ±»þ¤Ë¡¢Gemini¥Ù¡¼¥¹¤Î¥×¥í¥°¥é¥ß¥ó¥°¤ËÆò½¤·¤¿AI¡Ö
AlphaCode 2¡×¤¬È¯É½¤µ¤ì¤Æ¤¤¤ë¡£
2024ǯ02·î16Æü¡¢
Gemini Pro 1.5 ¤òȯɽ¤·¤¿¡£
ºÇÂç100Ëü¥È¡¼¥¯¥ó¤ò½èÍý¤Ç¤¡¢1»þ´Ö¤Î¥à¡¼¥Ó¡¼¤ä70Ëü¸ì¤Î¥Æ¥¥¹¥È¤ò°·¤¦¤³¤È¤¬²Äǽ¤È¤Ê¤Ã¤Æ¤¤¤ë¡£
¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡
¥«¡¼¥Ä¥ï¥¤¥ë»á¤Ï¡¢ÂçǾ¿·Èé¼Á¤ò¥·¥ß¥å¥ì¡¼¥·¥ç¥ó¤µ¤»¤ë¡Ö
Neocortex Simulator¡×¤Î³«È¯¤Ë¼è¤êÁȤó¤Ç¤¤¤ë¡£
Èà¤Ï¡¢¿·Èé¼Á¤òºÆ¸½¤¹¤ë¥¢¥ë¥´¥ê¥º¥à¤Ë¡Ö
HMMÍýÏÀ(±£¤ì¥Þ¥ë¥³¥Õ¥â¥Ç¥ë)¡×¤ò±þÍѤ¹¤ë¹Í¤¨¤Ç¤¢¤ë¤³¤È¤òɽÌÀ¤·¤Æ¤¤¤ë¡£ÂçǾ¿·Èé¼Á¤Î²óÏ©¤Ï°ìÍͤʵ¡¹½¤ò»ý¤Á¤Ä¤Ä¤âÆþ½ÐÎϤËÍ¿¤¨¤é¤ì¤ë¾ðÊó¤Ë±þ¤¸¤Æ¿Íͤʵ¡Ç½¤òȯ´ø¤Ç¤¤ë¤È¤µ¤ì¤ë¡£
ÂçǾ¿·Èé¼Á¤¬»ý¤Ã¤Æ¤¤¤ëǽÎÏ
- ¶µ»Õ¿®¹æ¤â¤·¤¯¤ÏÊó½·¿®¹æ¤òÍѤ¤¤º¤Ë¾õÂ֤ηÏÎ󤫤éÆâÉô¥Ñ¥é¥á¡¼¥¿¤òÊѹ¹¤¹¤ëǽÎÏ
- ¹â¼¡¸µ¤Î¾õÂÖ¶õ´Ö¤ò¤è¤êÄ㼡¸µ¤Î¾õÂÖ¶õ´Ö¤Ç¤Ç¤¤ë¤À¤±¾ðÊó¤ò¼º¤ï¤Ê¤¤¤è¤¦¤Ë¶á»÷Ū¤Ëɽ¸½¤¹¤ëµ¡Ç½
- Áàºî²Äǽ¤Ê·Á¤Ç²¿¤é¤«¤Î(Î¥»¶Åª¤Ê)¾ðÊó¤ò°ì»þŪ¤ËÊÝ»ý¤¹¤ëºî¶Èµ²±
- »þ·ÏÎó¤òÆþÎϤȤ·¡¤¼¡¤ÎÆþÎϤòͽ¬¤·¤¿¤ê»þ·ÏÎó¤ÎÇظå¤Ë¤¢¤ë±£¤ì¾õÂÖ¤ò¿äÄꤷ¤¿¤ê¤¹¤ëµ¡Ç½
¤Þ¤¿¡¢Èà¤Î³¬ÁØÍýÏÀ¤ò¸µ¤Ë¤·¤¿¼«Á³¸À¸ì½èÍý¥½¥Õ¥È¤ò³«È¯¤¹¤ë¡ÖKona¥×¥í¥¸¥§¥¯¥È¡×¤ò¿ä¤·¿Ê¤á¤Æ¤¤¤ë¡£¸À¸ì¥â¥Ç¥ëLaMDA¤Î³«È¯¤Ë¤â´Ø¤ï¤Ã¤Æ¤¤¤ë¡£
2018ǯ¸½ºß¡¢35̾Äø¤Î³«È¯¥Á¡¼¥à¤òÅýΨ¤¹¤ëΩ¾ì¤Ë¤¢¤ë
(Gmail¥¹¥Þ¡¼¥È¥ê¥×¥é¥¤¤ÎÀß·×)
¥Ò¥ó¥È¥ó»á¤Ï¡¢2012ǯ10·î¤ËCNN¤ò¼è¤êÆþ¤ì¤¿¡ÖAlexNet¡×¤òȯɽ¤·¤Æ¤«¤é¤È¤¤¤¦¤â¤Î¡¢Íâǯ°Ê¹ß¤ÏGoogle Brain(¥«¥Ê¥À¥È¥í¥ó¥È»Ù¼Ò)¤Ë½ê°¤·¡¢Æ±¼Ò¤Î²»À¼Ç§¼±¤ä²èÁü¸¡º÷¤Ë²þÁ±¤ò»Ü¤·¤Æ¤¤¤ë¡£
¥È¥í¥ó¥ÈÂç³Ø¶µ¼ø¤â̳¤á¤Ê¤¬¤é¡¢¶áǯ¡Ö
CapsNet(¥«¥×¥»¥ë¥Í¥Ã¥È¥ï¡¼¥¯)¡×¤òȯ°Æ¤·¤¿¡£
CNN¤Ï¡¢²èÁüʬÎà¤ä´é¸¡ÃΡ¢ÊªÂθ¡½Ð¤Ê¤É¤ÇÁÇÀ²¤é¤·¤¤Àǽ¤òȯ´ø¤¹¤ë¤¬¡¢»ÄÇ°¤Ê¤¬¤é»ëÌî³Ñ¤äÇطʤ¬ÊѤï¤ë¤Èǧ¼±ÀºÅÙ¤¬Äã²¼¤·¤¿¤ê¡¢¿Í´Ö¤Ë¤Ï¼±Ê̤Ǥ¤Ê¤¤¥Î¥¤¥º¤ò¾¯¤·¤Ç¤â²èÁü¤Ëº®Æþ¤¹¤ë¤È¸íǧ¤¬È¯À¸¤¹¤ë·çÅÀ¤¬¤¢¤ë¡£¥Ò¥ó¥È¥ó»á¤ÏCNN¤ÇÍѤ¤¤é¤ì¤Æ¤¤¤ë¥×¡¼¥ê¥ó¥°¤È¤¤¤¦Áàºî¤¬Â礤ʲá¤Á¤Ç¤¢¤ë¤È¼çÄ¥¤¹¤ë¡£¥×¡¼¥ê¥ó¥°¤Ë¤è¤ê°ÌÃÖÉÔÊÑÀ¤ò³ÍÆÀ¤¹¤ë¤ÈƱ»þ¤Ë¡¢¶õ´ÖŪ¤Ê¹½Â¤¤Î¾ðÊó¤òÁÓ¼º¤·¤Æ¤·¤Þ¤¦¡£
¤½¤³¤Ç¥Ò¥ó¥È¥ó»á¤¬Äó°Æ¤¹¤ëCapsNet¤Ï¡¢¥×¡¼¥ê¥ó¥°¤Ç¼º¤ï¤ì¤Æ¤¤¤¿¶õ´Ö¾ðÊó¤òÊÝ»ý¤Ç¤¤ë¤è¤¦¤Ë¤¹¤ë¤¿¤á¡¢¶õ´Ö¾ðÊó¤ò¥Ù¥¯¥È¥ë¤È¤·¤Æ½ÐÎϤǤ¤ë¤è¤¦¤Ë¤¹¤ë¡£CapsNet¤Ç¤Ï¡¢¥¹¥«¥é¡¼¤ÎÂå¤ï¤ê¤Ë¥Ù¥¯¥È¥ë¤òÍѤ¤¤ë¡£
¥Ù¥¯¥È¥ë¤Ï¡¢Âбþ¤¹¤ë½Å¤ß¹ÔÎóW¤¬³Ý¤±¤é¤ì¤ë¡£¤³¤ì¤Ï¡¢¶õ´ÖŪ¤Ê¾ðÊó¤È¹â¤¤¥ì¥Ù¥ë¤Î¥«¥×¥»¥ë(´é)¤ÈÄ㤤¥ì¥Ù¥ë¤Î¥«¥×¥»¥ë(ÌÜ¡¢É¡¡¢¸ý)¤Î´Ø·¸¤ò·ë¤Ó¤Ä¤±¤ë¡£
- ÆþÎÏ¥Ù¥¯¥È¥ë¤È¹ÔÎó¤ÎÀÑ
- ÆþÎÏ¥Ù¥¯¥È¥ë¤Ø¥¹¥«¥é¡¼¤Ç½Å¤ßÉÕ¤±
- ½Å¤ßÉÕ¤±¤µ¤ì¤¿ÆþÎÏ¥Ù¥¯¥È¥ë¤ÎÏÂ
- ¥Ù¥¯¥È¥ë¤«¤é¥Ù¥¯¥È¥ë¤Ø¤ÎÈóÀþ·ÁÊÑ´¹
- ³èÀ²½´Ø¿ô¤òsquah´Ø¿ô¤Ë¤¹¤ë
CapsNet¤Î¡É¥«¥×¥»¥ë¡É¤È¤Ï¡¢¥ª¥Ö¥¸¥§¥¯¥È¤Î¾ðÊó¤ò°ÕÌ£¤·¤Æ¤¤¤Æ¡¢¤É¤ó¤Ê·Á¤Ç¤É¤Î°ÌÃ֤˸ºß¤¹¤ë¤Î¤«¤ò¼¨¤¹¤â¤Î¡£»°³Ñ·Á¤ÈĹÊý·Á¤ÎʪÂΤθþ¤¤Ï¡¢¥«¥×¥»¥ëÆâ¤Î¤½¤ì¤¾¤ì2¤Ä¤Î¥Ù¥¯¥È¥ë¤Çɽ¤µ¤ì¤ë¡£
¶õ´Ö¾ðÊó¤òÊÝ»ý¤·¤Æ¤¤¤ë¤¿¤á¡¢³Æ¥ª¥Ö¥¸¥§¥¯¥È´Ö¤ÎÁêÂаÌÃÖ¡¢ÁêÂÐÊý¸þ¤¬Æ±¤¸¤Ç¤¢¤ì¤Ð¡¢¡É°ã¤¦³ÑÅ٤ǤâƱ¤¸ÆÃħ¤Î²èÁü¤ÏƱ¤¸¤â¤Î¡É¤Èǧ¼±¤Ç¤¤ë
¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡
¤½¤Î¾¡¢
Vicarious,
Numenta¤È¤¤¤Ã¤¿¸¦µæµ¡´Ø¤¬Â¸ºß¤¹¤ë¡£
Èà¤é¤Ï¥«¡¼¥Ä¥ï¥¤¥ë»á¤é¤Î¥Á¡¼¥à¤ÈƱ¤¸¤¯¡¢¡ÖÂçǾ¿·Èé¼Á¡×¤Ë¸¦µæÂоݤò¹Ê¤Ã¤ÆÈÆÍÑAI¤ò³«È¯¤·¤è¤¦¤È¤·¤Æ¤¤¤ëÁÈ¿¥¤Î¤è¤¦¤Ç¤¢¤ë¡£
Vicarious¤Ï¥Ç¥£¥ì¥Ã¥×¡¦¥¸¥ç¡¼¥¸»á¤òÂåɽ¤È¤·¤Æ¡¢À®²Ì¤òÌÀ¤«¤µ¤ºÊĺ¿Åª¤Ë¸¦µæ¤ò¿Ê¤á¤Æ¤¤¤ë¡£
Numenta¤Ï¡¢¥¸¥§¥Õ¡¦¥Û¡¼¥¥ó¥¹»á¤òÂåɽ¤È¤·¤Æ¡¢¿·Èé¼Á¤Î¹½Â¤¤«¤é¥¤¥ó¥¹¥Ñ¥¤¥¢¤·¤¿¡Ö
HTMÍýÏÀ(³¬ÁØ·¿»þ´Ö¥á¥â¥ê)¡×¤Î¸¦µæ¤Ë¥ê¥½¡¼¥¹¤òÃí¤¤¤Ç¤¤¤ë¡£
¤Þ¤¿Numenta¤Ï¡¢IBM Reserch¤È¶¦Æ±¤ÇÂçǾ¿·Èé¼Á¤Î¸¶Íý¤È¤½¤ì¤ò±þÍѤ·¤¿¥·¥¹¥Æ¥à¤Î¸¦µæ¤ò¤¹¤ë¤¿¤á¡ÖIBM Cortical Learning Center¡×¤òÀßÃÖ¤·¤¿¡£
¥¸¥ç¡¼¥¸»áΨ¤¤¤ëVicarious¤Ï¡¢HTMÍýÏÀ¤Î½é´ü¤ËÄó°Æ¤µ¤ì¤¿Zeta1¥¢¥ë¥´¥ê¥º¥à¤òȯŸ¤µ¤»¡¢¡Ö
Recursive Cortical NetworkÍýÏÀ¡×¤ò¹Í°Æ¡£
¤³¤ÎÍýÏÀ¤ò¼ÂÁõ¤·¤¿¥×¥í¥°¥é¥à¤Ç¡¢CAPTCHA¤ÎÆÍÇˤËÀ®¸ù¤·¤Æ¤¤¤ë¡£
2019ǯ1·î¡¢Numenta¤ÏÀµ¼°¤Ë¿·Èé¼Á¤Î¥°¥ê¥Ã¥ÉºÙ˦¤Ë´ð¤Å¤¯¿·¤·¤¤ÃÎÀ¥Õ¥ì¡¼¥à¥ï¡¼¥¯²¾Àâ¡Ö
Thousand Brains Theory¡×¤òȯɽ¤·¤¿¡£
https://numenta.com/blog/2019/01/16/the-thousand-b...
https://www.frontiersin.org/articles/10.3389/fncir...
ÂçǾ¿·Èé¼Á¤Î¤¤¤¿¤ë¤È¤³¤í¤Ë¡¢¥°¥ê¥Ã¥É¥»¥ë(¾ì½êºÙ˦)¤¬Â¸ºß¤¹¤ë¤³¤È¤ò¡¢¤³¤Î²¾Àâ¤ÏÄó°Æ¤¹¤ë¡£
¼«Ê¬¤Î°ÌÃÖ¤ò¿äÄꤹ¤ë¤¿¤á¤Ë¤¢¤ë¤È¹Í¤¨¤é¤ì¤Æ¤¤¤ë¥°¥ê¥Ã¥É¥»¥ë¤¬¡¢¤¢¤é¤æ¤ë¥ª¥Ö¥¸¥§¥¯¥È¤Î¹½Â¤¤ò³Ø½¬¤¹¤ë¤Î¤Ë»ÈÍѤµ¤ì¤Æ¤¤¤ë¤È¤¤¤¦¡£
2022ǯ4·î¡¢Google¿Æ²ñ¼Ò¤ÎAlphabet¤ÏVicarious¤òÇã¼ý¤·¡¢CTO¤Î¥Ç¥£¥ì¥Ã¥×¡¦¥¸¥ç¡¼¥¸»á¤ò¸¦µæ¼Ô¤È¤·¤ÆDeepMind¤Ë¥Ø¥Ã¥É¥Ï¥ó¥È¤·¤¿¡£
https://www.intrinsic.ai/blog/posts/mission-moment...
¹¹¤Ë¡¢Êƹñ¥¨¥Í¥ë¥®¡¼¾Ê´É³í²¼¤Î¥Ñ¥·¥Õ¥£¥Ã¥¯ËÌÀ¾¹ñΩ¸¦µæ½ê¤È¥µ¥ó¥Ç¥£¥¢¹ñΩ¸¦µæ½ê¡¢¥¸¥ç¡¼¥¸¥¢¹©²ÊÂç³Ø¤Î»°µ¡´Ø¤¬Ï¢·È¤·¡¢¿Í¹©ÃÎǽ¸¦µæ¥»¥ó¥¿¡¼(ARIAA)¤òΩ¤Á¾å¤²¤Æ¤¤¤ë¡£
¼ç¤Ë¥µ¥ó¥Ç¥£¥¢¹ñΩ¸¦µæ½ê¤¬AGI¤Î³«È¯¤ò¼è¤ê»ÅÀڤäƤ¤¤ë¤È¸«¤é¤ì¤ë¡£
IBM Reserch¤Ï¡¢¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È¤Î¶¯¤ß¤È¡¢½¾Íè·¿¤Î¥·¥ó¥Ü¥ê¥Ã¥¯¡Êµ¹æŪÃμ±¿äÏÀ¡ËAI¤Î¶¯¤ß¤òÊ»¤»»ý¤Ã¤¿¥·¥¹¥Æ¥à¤ò³«È¯Ãæ¤Ç¤¢¤ë¡£
IBM Research¤«¤éȯɽ¤µ¤ì¤¿
LNN(Logical Neural Networks) ¤Ï¡¢ÏÀÍý¿äÏÀ¤ÈÂ絬ÌÏÃμ±¡¢Ãµº÷¥¨¥ó¥¸¥ó¡¢¿¼Áسؽ¬¤òÏ¢·È¤µ¤»¡¢¸·Ì©¤Ê½èÍý¤òɬÍפȤ¹¤ë¶È̳¢¨¤Ë¸þ¤¤¤¿AI¥·¥¹¥Æ¥à¤Ë·Ò¤¬¤ë¤ÈͽÁÛ¤µ¤ì¤ë¡£¤³¤ì¤é¤Îµ»½Ñ¤òIBM WatsonX¤ËÁȤ߹þ¤à¤«¤É¤¦¤«¤ÏÉÔÌÀ¤Ç¤¢¤ë¡£
¢¨Ë¡Ì³¡¢ÊÛ¸î»Î¡¢°åÎÅ¿ÇÃÇ¡¢´ÉÀ©¤Ê¤É
¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡
ºÇ¸å¤Ë¡¢¥¤¡¼¥í¥ó¥Þ¥¹¥¯»á¤ä
¥µ¥à¥¢¥ë¥È¥Þ¥ó»á¤é¤¬¶¦Æ±¤ÇÀßΩ¤·¤¿
OpenAI¤È¤¤¤¦ÁÈ¿¥¤¬¤¢¤ë¡£
Èà¤é¤âAGI¤Î³«È¯¤òÌÜŪ¤Ë¤³¤ÎÁÈ¿¥¤òΩ¤Á¾å¤²¤¿¤¬¡¢AGI¤òºîÀ®¤¹¤ëºÝ¤Ëɬ¤º¤·¤âǾ¤Î¹½Â¤¤òÌÏÊ魯¤ëɬÍפϤʤ¤¤È¤¤¤¦¥¹¥¿¥ó¥¹¤Î¤â¤È¡¢Èæ³ÓŪ¼«Í³¤ÊÊý¸þÀ¤Ç³«È¯¤ò¿Ê¤á¤Æ¤¤¤ë¤è¤¦¤Ç¤¢¤ë¡£(½ã¿è¤ËÆò½·¿AI¤Î²ÄǽÀ¤òÄɵ᤹¤ë)
2019ǯ7·î¡¢OpenAI LP¤ËMicrosoft¤Ï10²¯¥É¥ë°Ê¾å¤ò½Ð»ñ¤¹¤ë¤Èȯɽ¤·¤¿¡£¥µ¥à¥¢¥ë¥È¥Þ¥ó»á¤È¥µ¥Æ¥£¥¢¥Ê¥Ç¥é»á¤Î¶¦Æ±È¯É½¤Ç¤¢¤ë¡£
Microsoft¼Ò¤ÎAzure¥¯¥é¥¦¥É¤ò·×»»»ñ¸»¤È¤·¤ÆÍøÍѤ¹¤ë¤È¤¤¤¦»Ý¤ÇÄó·È¤ò¤·¤¿¡£MSR AI¤ÎºÇ¹âµ»½ÑÀÕǤ¼Ô¤Ç¤¢¤ë¥¨¥ê¥Ã¥¯¥Û¡¼¥Ó¥Ã¥Ä»á¤â¤³¤ÎÄó·È¤Ë´Ø¤ï¤Ã¤Æ¤¤¤ë¡£
https://www.itmedia.co.jp/news/articles/1907/23/ne...
OpenAI¤Ï2018ǯ6·î¤«¤é¥ê¥ê¡¼¥¹¤·¤Æ¤¤¤ë¡¢Transformer¥Ù¡¼¥¹¤Î¼«Á³¸À¸ì½èÍý¥×¥í¥°¥é¥à¡ÖGPT¥·¥ê¡¼¥º¡×¤ÎÂè»°À¤Âå¥â¥Ç¥ë¡Ö
GPT-3¡×¤ò2020ǯ5·î¤Ëȯɽ¤·¤¿¡£
¤³¤Î¥â¥Ç¥ë¤Ï¡¢2017ǯ¤ËGoogle¤¬¹½ÃÛ¤·¤¿
¼«¸ÊÃí°Õµ¡¹½¤òºÎÍѤ¹¤ë¡ÖTransformer¡×¤ò¥Ù¡¼¥¹¤Ë¹½ÃÛ¤µ¤ì¤¿Â絬ÌÏÈÆÍѸÀ¸ì¥â¥Ç¥ë¤Ç¤¢¤ë¡£¥Ñ¥é¥á¡¼¥¿¿ô¤Ï1750²¯¤Ç¤¢¤ë¡£
OpenAI¤Ï¡¢¥Í¥Ã¥È¾åÆäËReddit¤ÎÎɼÁ¤ÊµÄÏÀ¤Î½ñ¤¹þ¤ß¤ä¥Ä¥¤¥Ã¥¿¡¼¤Îʸ¾Ï¡¢±Ñ¸ìÈÇ¥¦¥£¥¥Ú¥Ç¥£¥¢ÅùÂçÎ̤Îʸ¾Ï¤ò³Ø½¬¤µ¤»¤¿¡£¤½¤Î·ë²Ì¡¢¿Í´Ö¤¬½ñ¤¤¤¿Ê¸¾Ï¤È¸«Ê¬¤±¤¬¤Ä¤«¤Ê¤¤¹âÉʼÁ¤Êʸ¾Ï¤ò¡¢ÆþÎϤ˴ð¤Å¤¤¤ÆÀ¸À®¤Ç¤¤ë¤è¤¦¤Ë¤Ê¤Ã¤¿¡£
GPT-3¤Ïʸ¾Ï¤ÎÍý²ò,À¸À®¤À¤±¤Ç¤Ê¤¯¡¢JavaScript¥³¡¼¥É¤ÎÀ¸À®¡¢Python¥³¡¼¥É¤ÎÀ¸À®¡¢¥Á¥ã¥Ã¥È¡¢´Êñ¤Ê»Í§±é»»¤ò¹Ô¤¦¤³¤È¤¬¤Ç¤¤ë¡£Ã±¤Ê¤ëµðÂç¤Ê¥Ñ¥é¥á¡¼¥¿¤òÈ÷¤¨¤¿NLP¥â¥Ç¥ë¤Ç¤¢¤ë¤Ë¤â´Ø¤ï¤é¤º¡¢¶Ë¤á¤ÆÈÆÍÑŪ¤Ê¥·¥¹¥Æ¥à¤Î¤è¤¦¤Ë¸«¤¨¤ë¡£
¤µ¤é¤Ë¡¢GPT-3¤Ë²èÁüʬÎà¥â¥Ç¥ë¤ä
³È»¶¥â¥Ç¥ë¤È¤¤¤Ã¤¿ºÇ¿·¤Î²èÁüÀ¸À®¥¢¥ë¥´¥ê¥º¥à¤òÁȤ߹ç¤ï¤»¤ë¤³¤È¤Ç¡¢Ê¸¾Ï¤Ë´ð¤Å¤¯²èÁüÀ¸À®¤ò¼Â¹Ô¤¹¤ë¤³¤È¤¬¤Ç¤¤ë¡£
²èÁüÀ¸À®¤ÎÎã
OpenAI¤Ï¡¢¥Ç¡¼¥¿¤ÎÆâÍƤȥ¢¥ë¥´¥ê¥º¥à¤Î¹½Â¤¤òÈùÄ´À°¤·¤ÆºÆ³Ø½¬¤µ¤»¤¿¼¡À¤Âå¥â¥Ç¥ë¡ÖGPT-4¡×¤ò¿ôǯ°ÊÆâ¤Ë¥ê¥ê¡¼¥¹¤¹¤ëͽÄê¤Ç¤¢¤ë¡£¢¨¥Ñ¥é¥á¡¼¥¿¿ô¤ÎÁý¶¯¤Ï¸«Á÷¤ë
OpenAI¤Ï2021ǯ7·î¡¢Python¤ò¥Ù¡¼¥¹¤È¤·¤¿¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È¥ï¡¼¥¯¸þ¤±
¥×¥í¥°¥é¥ß¥ó¥°¸À¸ì¡ÖTriton¡×¤ò̵½þ¸ø³«¤·¤¿¡£
NVIDIA¤ÎCUDA¤òÍѤ¤¤ë¾ì¹ç¡¢GPUÍѤΥͥ¤¥Æ¥£¥Ö¥«¡¼¥Í¥ë¤ä´Ø¿ô¤òºîÀ®¤¹¤ë²áÄø¤Ç¡¢¥Þ¥ë¥Á¥³¥¢GPU¤Î¥á¥â¥ê³¬ÁØÁ´ÂΤdzä¤êÅö¤Æ¥Ç¡¼¥¿¤ÈÌ¿Îá¤ò°ÜÆ°¤·¤Ê¤±¤ì¤Ð¤Ê¤é¤º¡¢¥×¥í¥°¥é¥ß¥ó¥°¤¬Èó¾ï¤ËÊ£»¨¤Ë¤Ê¤ë¡£
Triton¤ò»ÈÍѤ¹¤ë¤È¡¢25¹Ô̤Ëþ¤Î¥³¡¼¥É¤ÇcuBLAS¥é¥¤¥Ö¥é¥ê¤Î¥Ñ¥Õ¥©¡¼¥Þ¥ó¥¹¤ËɤŨ¤¹¤ëFP16¾è»»¥«¡¼¥Í¥ë¤òºîÀ®¤¹¤ë¤³¤È¤¬²Äǽ¤È¤Ê¤ë¡£
2022ǯÅߤˤϡ¢
GPT-3.5¤¬¥ê¥ê¡¼¥¹¤µ¤ì¤¿¡£¥Á¥ã¥Ã¥È·Á¼°¤Ç°ìÈ̸ø³«¤µ¤ì¤Æ¤¤¤ë¡£
´ðËÜŪ¤Ë¤Ï¡¢GPT-3¤Èµ¡Ç½¤Ï¤µ¤Û¤ÉÊѤï¤é¤Ê¤¤¤¬¡¢¥Ð¥é¥Ð¥é¤À¤Ã¤¿±þÅúÀǽ¤¬¤è¤êÅý¹ç¤µ¤ì¤Æ¤¤¤ë¡£Excelɽ¤«¤é¸ÜµÒID¤ò¸¡º÷¤·¤Æ¾ðÊó¤ò¼èÆÀ¤¹¤ëVBA¥³¡¼¥É¤ò¡¢ChatGPT¤¬À¸À®¤·¤Æ¤¯¤ì¤ë¤³¤È¤â¤¢¤ë¡£¤Þ¤¿¡¢¥Ö¥é¥¦¥¶¾å¤ÎGUIÁàºî¤ò¼«Æ°²½¤·¤Æ¤¯¤ì¤ë¥ï¡¼¥¯¥Õ¥í¡¼¼«Æ°²½¤Ë¶á¤¤Æ°ºî¤â¼Â¸½¤Ç¤¤ë¡£
¤Þ¤¿¡¢Unreal EngineÆâ¤ÇOpenAI API¤Ë¥¢¥¯¥»¥¹¤¹¤ë¤³¤È¤¬¤Ç¤¤ë¥×¥é¥°¥¤¥ó¤¬Í»Ö¤Ë¤è¤Ã¤Æ³«È¯¤µ¤ì¡¢¥²¡¼¥à¤ÎÆ°ºî¥×¥í¥°¥é¥à¤ä¥¥ã¥é¥¯¥¿¡¼¤Î²ñÏá¢3D¥Æ¥¯¥¹¥Á¥ãÀ¸À®¤Ë¤âÂ礤¯³èÍѤǤ¤ë¤³¤È¤¬´üÂÔ¤µ¤ì¤ë¡£
2023ǯ°Ê¹ß¡¢Microsoft¤Ï¼«¼Ò¤ÎÀ½ÉÊ·²¤ËOpenAI¤¬³«È¯¤·¤¿
GPT-4¤òÅý¹ç¤·¤Æ¤¤¤¯¤³¤È¤òȯɽ¤·¤¿¡£
¶ñÂÎŪ¤Ë¤ÏBing¸¡º÷¥¨¥ó¥¸¥ó¡¢Microsoft 365¤Ë¤ª¤±¤ëExcel¤äWord¡¢
Microsoft Power Automate¡¢Azure¤Ë¤ª¤±¤ë
Azure Data Lake¤Ê¤É¤ÎË¡¿Í¸þ¤±¥Ç¡¼¥¿Ê¬ÀÏ´ÉÍý¥µ¡¼¥Ó¥¹¤ÈÏ¢·È¤µ¤»¤ë¡£
Visual studio¤ÏOpenAI Codex Model¤ò»ÈÍѤ·¤¿Github Copilot¥µ¡¼¥Ó¥¹¤òÍøÍѤ·¤Æ¡¢¥³¡¼¥Ç¥£¥ó¥°ºî¶È¤ÎÊä½õ¤ò¹Ô¤¨¤ë¤è¤¦¤Ë¤¹¤ë¡£
Microsoft Research AI¤Ï¡¢²èÁü¤òÆɤ߹þ¤ó¤Ç¤½¤ì¤ËÂФ·¤Æ¤Îǧ¼±¤È²ñÏ䬤Ǥ¤ë¡¢¥Þ¥ë¥Á¥â¡¼¥À¥ë¥Ñ¥¤¥×¥é¥¤¥óÂ絬ÌϸÀ¸ì¥â¥Ç¥ë¡Ö
LLaVA¡×¤òȯɽ¤·¤¿¡£
https://llava-vl.github.io/
¤½¤Î¸å¡¢¥ì¥ó¥È¥²¥ó¼Ì¿¿¤äMRI²èÁü¤Ê¤É¤Î°å³Ø¥Ç¡¼¥¿¤ËÂбþ¤·¤¿°åÎÅÍÑ»ë³Ð¸À¸ì¥â¥Ç¥ë¡ÖLLaVA-Med¡×¤òȯɽ¤·¤Æ¤¤¤ë¡£
https://github.com/microsoft/LLaVA-Med
¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡¨¡
2018ǯ¡¢¥Ï¡¼¥Ð¡¼¥ÉÂç³Ø¤Ï¾ö¤ß¹þ¤ß¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È¤Î¹½Â¤¤ò¤½¤Î¤Þ¤Þ¤Ë¡¢¤½¤³¤ËÎ̻ҲóÏ©¤Î»ÅÁȤߤòƳÆþ¤·¤¿¡Ö
Î̻Ҿö¤ß¹þ¤ß¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È(QCNN)¡×¤òÄó°Æ¤·¤¿¡£
https://arxiv.org/abs/1810.03787
Æ°²è
¸¦µæ¼Ô¤Ï¡¢ÊªÍý³Ø¤Ë¤ª¤±¤ë·«¤ê¹þ¤ß¥×¥í¥»¥¹¤¬¥Ñ¥¿¡¼¥óǧ¼±²áÄø¡¢ÆäËCNN¤ò»ÈÍѤ·¤Æ²èÁüÆâ¤Î¥ª¥Ö¥¸¥§¥¯¥È¤ò¼±Ê̤¹¤ë¾ö¤ß¹þ¤ßÁؤȤ¤¤¯¤Ä¤«¤ÎÎà»÷ÅÀ¤ò¶¦Í¤·¤Æ¤¤¤ë¤³¤È¤òȯ¸«¡£
CNN¤¬¾®¤µ¤ÊÊ£¿ô¤Î¶É½ê¥æ¥Ë¥Ã¥È¤«¤éºî¤é¤ì¤Æ¤¤¤ë¤È¤¤¤¦»ö¼Â¡£¤½¤·¤Æ¡¢ÆþÎϥǡ¼¥¿¤ò³¬ÁØŪ¤Ë½èÍý¤¹¤ëǽÎÏ¡¢¤³¤ì¤é¤¬ÎÌ»ÒʪÍý³Ø¤Ë¤ª¤±¤ë¤¯¤ê¤³¤ßµ»½Ñ¤ÈÁêÀ¤¬¤è¤¤¤³¤È¤ò¼¨º¶¤·¤¿¡£
¸¦µæ¼Ô¤Ï¡¢µ¿»÷¥Þ¥ë¥Á¥¹¥±¡¼¥ë¥¨¥ó¥¿¥ó¥°¥ë¥á¥ó¥È·«¤ê¹þ¤ß¤ÈÎ̻Ҹí¤êÄûÀµ¤òÁȤ߹ç¤ï¤»¤¿¡£¤³¤³¤Ç¤ÏÎ̻Ҽ«ÂΤλÅÁȤߤ¬¤«¤Ê¤êÆñ¤·¤¯Æñ²ò¤Ê¤¿¤á¡¢ÀâÌÀ¤ò¾Ê¤¯¡£
MITǾÀº¿Àµ¡³£¸¦µæ½ê¤Ï¡¢ÀþÃî¤Î¿À·Ð·Ï¤ò¥Ù¡¼¥¹¤Ë¤·¤¿¡Ö
¥ê¥¥Ã¥É¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È¡×¤ò¹Í°Æ¤·¤¿
https://cbmm.mit.edu/video/liquid-neural-networks