ÀÏ×ÓÓÐÇ®lzyq88¹ÙÍø

À´Ô´£ºUÅÌ×°»ú¾Þ½³ £¬×÷Õߣº ÓÎÓ¾ £¬£º

ÚÀ £¬Ù¯ÏþµÃ·¥£¿ë¡ÄÜÖÐɽʯáªÏï×ÓŶ £¬×î½üÀ϶àÈËÀ´ÎÊÎÒ¡£ÎÒÐÄÀïÒ»Ïë £¬Ã´Ï뵽롸öµØ·½»¹ÂùÓеãÃûÆøÁËŶ~½²Õæ £¬×¡ÎÒ°¢Àï´îÖÜΧ¸öÀÏÁÚ¾Ó £¬¿ÉÄÜ»¹ß¼Ã»ÏþµÃ롾¿¾¹ÔÚÄÄ£¡Ù¯½²Ææ¹Ö·¥£¿

ÎÒ¸úÙ¯½²Å¶ £¬ë¡ÆäÖÐɽʯáªÏï×Óѽ £¬ÒÁÆäʵ¾ÍÀÕÖÐɽÄÏ·ËÄÖÜ £¬¿¿½üʯáªÂ·±ßÉÏ¡£ÌýÆðÀ´ËƺõÊǸö²»ÆðÑÛ¸öµØ·½¶Ô·¥£¿¿ÉÊÇŶ £¬ë¡¸öÏï×ÓÀïÏá¿ÉÊÇÓеãÃŵÀ¸ö¡£ÎÒÀÏÔçÌýÎÒÒ¯Êå½² £¬ë¡Ïï×ÓÀïÏáÒÔǰÓÐЩÀÏ»ù´¡¸öСÆÌÍ· £¬ÏñɶÎïÏÌ»õµêÀ² £¬ÐÞЬ̯À² £¬ÁíÓÐЩС²Í¹Ý £¬¿ªµ½ÀÏÍí¸ö¡£ë¡¸öµØ·½Å¶ £¬Éú»îÆøÏ¢ÀÏŨ¸ö¡£ë¡¸ö¾ÍÊÇÀÏÉϺ£¸öζµÀ¶Ô·¥£¿

Ïï×ÓͷβÓн²¾¿ £¬Ù¯Òª¿´Çå³þ

Ù¯ÒªÎÊÎÒ롸öÏï×Ó¾¿¾¹ÓÐɶÔÃĿŶ£¿ÎÒ¸úÙ¯½²Å¶ £¬ë¡¸öÏï×ÓÀïÏáÓÐÁ½Í·¸ö½²¾¿Å¶¡£Í·Ò»Í·Å¶ £¬Ïï×Ó¿Ú±ßÉÏÀÕ×ÅÒ»¼ÒÀÏ×ֺŸöÉÕ¿¾Ì¯¡£ÉÕ¿¾Ì¯¸öÀϰå £¬ÊǸöÀϰ¢²® £¬ÊÖÒÕÀϽá¹÷¸ö £¬Ù¯È¥³Ô¹ýÒ»´Î¾ÍÏþµÃÁË¡£ÒÁ¼Ò¸ö¿¾ÑòÈ⴮Ŷ £¬ë¡¸öζµÀÀÏÏã¸ö £¬¿¾µÃ½ð»Æ½ð»Æ¸ö £¬³ÔÆðÀ´ÁíÓÐÒ»µãµã½¹ÌÇζ¡£Ù¯ÏþµÃ·¥£¿ÎÒÉÏÌË´ø°¢À­ÅóÓÑÈ¥³Ô £¬ÒÁ½²ë¡¸öÉÕ¿¾´®±ÈÄϾ©Â·ÉϸöÍøºìµê»¹ºÃ³ÔŶ¡£

Ïï×ÓÁíÍâһͷŶ £¬ß¼Ã»É¶Îﻨͷ £¬¿´ÆðÀ´¾ÍÊÇÒ»ÌõÆÕͨ¸öŪÌöԷ¥£¿¿ÉÊÇŶ £¬Ù¯×Ðϸ¿´ £¬Ç½½ÇÓÐÒ»¿éÀÏÅÆ×Ó £¬Ð´×Å¡°Ê¯áªÏ¡£ë¡¿éÅÆ×ÓŶ £¬Ô¤¼Æ¶¼¹ÒÁ˼¸Ê®ÄêÁË £¬ÀÏ»ù´¡¸öζµÀÆËÃæ¶øÀ´¡£Ù¯Õ¾µ½ë¡¸öµØ·½ £¬»á¸ÐÊÜÏñÊÇʱ¹âµ¹Á÷ÁË £¬ÀÏÉϺ£¸öÓ°×Ӿ͸¡³öÀ´ÁË¡£

Ïà¹ØÍ¼Æ¬ ͵͵¸æËßٯŶ £¬ë¡Ïï×ÓÀïÏáÓÐÒ»¼ÒÂôÉú¼åÂøÍ·¸öС̯ͷ £¬Ù¯ÒªÊÇÔçÉÏ7µãµ½8µãÈ¥ £¬¾ÍÄܳԵ½¸Õ³ö¯¸ö¹øÌùÉú¼å¡£ë¡¸ö̯ͷÀϰåÄïŶ £¬ÊǸöËíµÀÉϺ£ÈË £¬ÒÁ×ö¸öÉú¼åƤ±¡ÏÚ¶à £¬Ö­Ë®ÀÏ×ã¸ö¡£Ù¯ÒªÊÇÈ¥ÍíÁË £¬¿ÉÄܾÍ߼ûÁËŶ¡£ Ïà¹ØÍ¼Æ¬

Ïï×ÓÀïÍ·¸ö¹ÊÊ £¬Ù¯ÏþµÃ·¥£¿

½²µ½ÖÐɽʯáªÏï×ÓŶ £¬ë¡ÀïÏáÆäʵÁíÓеãС¹Êʸö¡£ÎÒÄêÇá³½¹âë¡ÐªÅ¶ £¬ÌýÎÒÒ¯Êå½²ë¡Ïï×ÓÀïÏáÒÔǰס×ÅÒ»¸öÀÏľ½³¡£ÒÁ¸öÊÖÒÕŶ £¬ÀÏÒ»Á÷¸ö £¬ë¡¸ö³½¹â £¬ÖÜΧÁÚ¾Ó¼ÒÀïÏá¸ö¼Ò¾ß»µÍÑÁË £¬ÇëÒÁÐÞһϠ£¬ÐÞÍê¸öµÊ×ÓÒÎ×Ó¸úÐÂÂò¸öһģһÑù¡£ØÊºóŶ £¬ÒÁ´ø×ÅͽµÜ¿ªÁ˸öСÆÌÍ· £¬¾ÍÀÕÏï×ÓÀïÏá¡£¿ÉϧŶ £¬ë¡ØÊºó £¬ÒÁ¸öͽµÜ°á×ßÁË £¬Ð¡ÆÌÍ·Ò²¹ØµôÁË £¬ë¡¸ö¹ÊʾÍÂýÂý±»ÈËÍü¼ÇÁË¡£


Ù¯ÎÊÎÒ £¬ÖÐɽʯáªÏï×ÓÁíÓÐɶÎﻨͷ·¥£¿

ÕÕÎÒ¿´À´Å¶ £¬ë¡¸öÏï×ÓÀïÏá¸ö»¨Í·¾ÍÊÇÁ½Ñù£ºÒ»¸öÊÇë¡ÖÖÀÏζµÀ¸öС̯ͷ £¬ÁíÒ»¸öÊÇ롸öŨŨ¸öŪÌÃζµÀ¡£Ù¯È¥ë¡´î £¬²»Òª¹â¿´Íâò £¬Òª×ÐϸȥÐáÐáÀÏÉϺ£¸öÆøÏ¢Å¶~

±êÇ©£º

  • ÖÐɽʯáªÏï×Ó
  • ÉϺ£ÅªÌÃ
  • ÀÏζµÀ
  • Ïï×ÓÀïµÄ¹ÊÊÂ
  • Éú»îÆøÏ¢

¡¶ÖêÖÞÈýÈýÒ»¼¦ÎѾßÌåλÖá·

¹É¼Û´óÕÇ֮Ϡ£¬ÆóÒµ¶ËÒ²ÔÚСÐÄÒíÒí¡£¡°¹«Ë¾¹É¼ÛÓÖÕÇÍ£ÁË £¬¶¼Î·¾å¼à¹Ü·¢º¯À´ÎÊ¡£²»¹ý £¬¹«Ë¾ÒѾ­Ðû²¼Í¨¸æÌáʾΣº¦ÁË¡£¡±2ÔÂ9ÈÕ £¬ÔÚÓë±±¾©É̱¨¼ÇÕß½»Á÷ʱ £¬Ä³¹â·üÆóÒµÂôÁ¦ÈËÈçÊÇ˵¡£

¡¶ÉϺ£Ñóæ¤¿ì²ÍµØµã¡·

ÖÇÄÜÊÖ»ú¡¢Ìõ¼Ç±¾µçÄÔËùʹÓÃµÄ¹Å°å´æ´¢¼¼ÊõΪDRAM£¨¶¯Ì¬Ëæ»ú´æÈ¡´æ´¢Æ÷£© £¬µ«ÕâÀàÔªÆ÷¼þÕý±»´ó×ÚÓÃÓÚÖ§³ÖÊý¾ÝÖÐÐĵĸüÏȽø´æ´¢Ð¾Æ¬ ¡ª¡ªHBM£¨¸ß´ø¿í´æ´¢Æ÷£©¡£

¡¶ÀÈ·»ÊÐ×ãÁƱ£½¡Ò»Ìõ½ÖµØµã¡·

ͼע£ºÊµÑéÊý¾ÝÏÔʾ £¬ERNIE 5.0 ͨ¹ýµ¯ÐÔÏ¡Êè¶È£¨Top-k ½µÖÁ 25%£©ºÍµ¯ÐÔ¿í¶È¼¼Êõ £¬ÔÚÑéÖ¤¼¯Ëðʧ£¨Validation Loss£©ÏÕЩÎÞËðµÄÇé¿öÏ £¬ÊµÏÖÁËÄ£ÐÍËãÁ¦µÄ¼«ÖÂѹËõ¡£±¨¸æÕýÎĽøÒ»²½Ö¸³ö £¬ÕâÖּܹ¹ÓÅ»¯´øÀ´ÁËÁè¼Ý 15% µÄÍÆÀíËÙ¶ÈÌáÉý¡£

ÍøÕ¾µØÍ¼