OpenAIÔÚ×îеĿªÔ´Ä£×Ógpt-ossÉÏÑ¡ÓõÄMXFP4Êý¾ÝÀàÐÍ£¬£¬£¬Ö±½ÓÈÃÍÆÀí×ÊÔ´±©½µ75%£¡
¸ü¾ªÈ˵ÄÊÇ£¬£¬£¬MXFP4ÔÚ°ÑÄÚ´æÕ¼ÓýµÎªÍ¬ÍýÏëBF16Ä£×ÓµÄËÄ·ÖÖ®Ò»µÄÒ»Æð£¬£¬£¬»¹°ÑÌìÉútokenµÄËÙÂÊǰ½øÁËÕûÕû4±¶¡£¡£¡£
»»¾ä»°Ëµ£¬£¬£¬ÕâÒ»²Ù×÷Ö±½Ó°Ñ1200ÒÚ²ÎÊýµÄ´óÄ£×ÓÈû½ø80GBÏÔ´æµÄÏÔ¿¨£¬£¬£¬ÄÄÅÂÊÇÖ»Òª16GBÏÔ´æµÄÏÔ¿¨Ò²ÄÜÅÜ200ÒÚ²ÎÊýµÄ°æ±ð¡£¡£¡£

£¨×¢£ºÏÔ´æÈÝÁ¿Í¨³£»£»£»£»£»£»á´óÓÚCheckpoint Size£©
½ÏÁ¿ÒÔÍùµÄÊý¾ÝÀàÐÍ£¬£¬£¬MXFP4¹©Ó¦Á˼«¸ßµÄÐԼ۱ȣ¬£¬£¬Ä£×ÓÔËתËùÐèµÄÓ²¼þ×ÊÔ´½öΪ֮ǰµÄËÄ·ÖÖ®Ò»¡£¡£¡£
MXFP4ÓÐʲô·¨Á¦£¿£¿£¿
ÔÚgpt-ossÖУ¬£¬£¬OpenAI½«MXFP4Á¿»¯Ê¹ÓÃÓÚԼĪ90%µÄÈ¨ÖØ£¬£¬£¬ÕâÒ»²Ù×÷µÄÖ±½ÓÄîÍ·£¨ÊÕÒæ£©¼´ÊÇÈÃÄ£×ÓÔËת×ÊÔ´±äµÃÓú¼ÓÁ®¼Û¡£¡£¡£
½«gpt-ossÄ£×ÓÁ¿»¯ÎªMXFP4 ºó£¬£¬£¬¿ñÑÔÓïÄ£×ÓµÄÕ¼ÓÃÄÚ´æ½öΪµÈÍýÏëBF16Ä£×ÓµÄ1/4£¬£¬£¬²¢ÇÒÌìÉútokenµÄËÙÂÊ×î¸ß¿Éǰ½ø4±¶¡£¡£¡£

ÔõÑù¾Óɸ͝Êý¾ÝÀàÐÍϽµÄ£×ÓÔËת×ÊÔ´£¿£¿£¿Õâ¶ùµÄÂß¼ÊÇÕâÑùµÄ£º
Ä£×ÓµÄÔËת×Ê±ÊÆ÷ÒªÓÉÈ¨ÖØ´æ´¢ºÍÄÚ´æ´ø¿íÁ½¸ö²¿·Ö×é³É¡£¡£¡£
ǰÕßÊÇÄ£×Ó²ÎÊý¼Ä´æºÍÕ¼ÓõĿռ䣬£¬£¬Ò²¼´ÊÇ´æ´¢ËüÃÇËùÐèÇóµÄ×Ö½ÚÊý¡£¡£¡£
ºóÕßÔòÊÇÄ£×ÓÔÚÍÆÀíʱ£¬£¬£¬Êý¾Ý¶ÁдËÙÂʺÍÈÝÁ¿µÄÔ¼Êø¡£¡£¡£
Êý¾ÝÀàÐ͵ĸ͝½«Ö±½ÓÓ°ÏìÈ¨ÖØ´æ´¢ºÍÄÚ´æ´ø¿íµÄÕ¼Óᣡ£¡£
ÀýÈ磬£¬£¬¹Å°åÄ£×ÓÈ¨ÖØÍ¨³£ÓÃFP32£¨32λ¸¡µãÊý£©´æ´¢£¬£¬£¬Ã¿¸ö²ÎÊýÕ¼ÓÃ4×Ö½ÚÄÚ´æ¡£¡£¡£
ÈôÊÇÓÃMXFP4£¬£¬£¬ÄÇôÿ¸öÈ¨ÖØÖ»Òª°ë×Ö½Ú£¬£¬£¬È¨ÖØ´æ´¢¾ÞϸÊÇFP32µÄ1/8£¬£¬£¬Õâ¾Í¼«´óµØËõ¶ÌÁËÈ¨ÖØÊý¾ÝÁ¿µÄ¾Þϸ¡£¡£¡£
ÕâÒ»Ëõ¶Ì²»µ«Ï½µÁËÄ£×ӵĴ洢¿Õ¼ä£¬£¬£¬»¹ÄÜÈÃÄ£×ÓÔÚÏàͬµÄ´ø¿íÏÂÍê½á¸ü¿ìµØÊý¾Ý¶ÁÈ¡ºÍдÈ룬£¬£¬È»ºóǰ½øÍÆÀíËÙÂÊ¡£¡£¡£
ÓÉ´Ë£¬£¬£¬¾Óɸ͝Êý¾ÝÀàÐ;ÍÄÜÍê³ÉÍÆÀí×ÊÔ´µÄ½µ±¾ÔöЧ¡£¡£¡£
ÄÇô£¬£¬£¬MXFP4ÊÇÔõÑùÍê³ÉÕâÒ»µãµÄ£¿£¿£¿
MXFP4
MXFP4µÄÈ«³ÆÊÇ΢Ëõ·Å4λ¸¡µãÊý£¨Micro-scaling Floating Point 4-bit£©£¬£¬£¬ÊÇÓÉOpen Compute Project (OCP) ½ç˵µÄ4λ¸¡µãÊý¾ÝÀàÐÍ¡£¡£¡£
£¨×¢£ºOCPÊÇFacebookÓÚ2011Ä꽨ÒéµÄ³¬´óÍýÏëÊý¾ÝÖÐÐÄÐ×÷°²ÅÅ£¬£¬£¬Ö¼ÔÚϽµÊý¾ÝÖÐÐÄ×é¼þ×ÊÔ´²¢Ç°½ø¿É»ñÈ¡ÐÔ¡£¡£¡££©
ÔÚÉî¶ÈѧϰÁìÓòÖУ¬£¬£¬Êý¾ÝÀàÐ͵ľ«¶ÈºÍ¹¦ÂÊÒ»Ö±ÊÇ×êÑÐÕßÈ¡ÉáµÄÒªµã¡£¡£¡£
ÀýÈ磬£¬£¬¹Å°åµÄFP4Ö»ÒªËÄ룬£¬£¬1λ·ûºÅ涉嫌强奸罪请什么律师好루±êÃ÷Õý¸º£©£¬£¬£¬今日说法强奸犯案件富阳2λָÊý루¾öÒéÊýÖµµÄÁ¿¼¶£©£¬£¬£¬1λβÊý루±êÃ÷СÊý²¿·Ö£©¡£¡£¡£
ÕâÖÖ±êÃ÷²½·¥Ö»¹ÜËõ¶ÌÁËÊý¾ÝÁ¿£¬£¬£¬µ«Ò²µ¼ÖÂÁËÊ®·ÖÓÐÏ޵ĿɱêÃ÷µÄÊýÖµ¹æÄ££¬£¬£¬ËüÖ»ÄܱêÃ÷8¸öÕýÊýºÍ8¸ö¸ºÊý¡£¡£¡£
Ïà½Ï֮ϣ¬£¬£¬BF16£¨1λ·ûºÅ룬£¬£¬8λָÊýλºÍ7 λβÊý룩ÔòÄܱêÃ÷ 65,536¸öÊýÖµ£¬£¬£¬²»¹ý±êÃ÷¹æÄ£µÄÌí¼ÓÒ²´øÀ´Á˺ËËã×ÊÔ´µÄÉÏÉý¡£¡£¡£
ÈôÊÇΪÁËǰ½øºËË㹦ÂÊ£¬£¬£¬Ö±½Ó°ÑÕâ4¸öBF16ÊýÖµ£º0.0625¡¢0.375¡¢0.078125¡¢0.25Ö±½Óת»»³ÉFP4£¬£¬£¬ÄÇôËüÃÇ»áÄð³É 0¡¢0.5¡¢0¡¢0.5¡£¡£¡£
²»ÄÑ¿´³ö£¬£¬£¬ÕâÑùµÄ¹ýʧÏÔÈ»ÊÇÎÞ·¨ÔâÊܵġ£¡£¡£
ÒÔÊÇ£¬£¬£¬ÎªÁËÔÚÏ÷¼õÊý¾ÝÁ¿µÄÒ»Æð°ü¹Ü¿Ï¶¨µÄ¾«¶È£¬£¬£¬MXFP4¾Óɽ«Ò»×é¸ß¾«¶ÈÊýÖµ£¨Ä¬Ðí32¸ö£©³ËÒÔÒ»¸ö¹«¹²Ëõ·ÅÒò×Ó£¨Õâ¸öËõ·ÅÒò×ÓÊÇÒ»¸ö8λ¶þ½øÖÆÖ¸Êý£©¡£¡£¡£ÕâÑù£¬£¬£¬ÔÛÃÇÇ°ÃæÄÇ4¸öBF16ÊýÖµ¾Í»áÄð³É 1¡¢6¡¢1.5¡¢4¡£¡£¡£

ÕâÑù¾Í¼ÈÍê³ÉÁ˼«ÖµÄÊý¾Ý¾Þϸ£¬£¬£¬ÓÖ¼á³ÖÁËÊýÖµ¼ä¾ÞϸÁªÏµµÄ¾«¶È¡£¡£¡£
±ðµÄ£¬£¬£¬ÕâÒ»Àú³ÌµÄÍê³É»¹ÓëºËËãÓ²¼þÏà¹Ø¡£¡£¡£
Ò»Ñùƽ³£¹æÔòÊÇ£¬£¬£¬Ã¿½«¸¡µã¾«¶ÈÕ۰룬£¬£¬Ð¾Æ¬µÄ¸¡µãÍÌÍÂÁ¿¾ÍÄÜ·±¶¡£¡£¡£
ÀýÈ磬£¬£¬Ò»¸öB200SXMÄ£¿£¿£¿éµÄŨÃÜBF16ÔËË㹦ЧԼΪ2.2 petaFLOPS£¬£¬£¬½µµ½FP4£¨Nvidia Blackwell оƬ¹©Ó¦Ó²¼þ¼ÓËÙ£©ºó£¬£¬£¬¾ÍÄÜǰ½øµ½9petaFLOPS¡£¡£¡£
Ö»¹ÜÕâ»áÔÚÍÌÍÂÁ¿ÉÏ´øÀ´Ò»Ð©Ç°½ø£¬£¬£¬µ«ÔÚÍÆÀí½×¶Î£¬£¬£¬¸ü¶àFLOPSµÄ¼ÄÒåÖ÷ÒªÊÇÏ÷¼õÄ£×ÓÆðÔ´ÌìÉúÃÕµ×µÄÆÚ´ýʱ¼ä¡£¡£¡£
ÖµµÃ×¢ÖØµÄÊÇ£¬£¬£¬ÔËתMXFP4Ä£×Ó今日说法强奸犯案件富阳1;嫌强奸罪请什么律师好trong>²¢²»ÒªÇóÓ²¼þÓÐÐëÒªÔÉúÖ§³ÖFP4¡£¡£¡£
ÓÃÓÚѵÁ·gpt-ossµÄNvidia H100¾Í²»Ö§³ÖÔÉúFP4£¬£¬£¬²»¹ýËüÈÔÈ»Äܹ»ÔËת£¬£¬£¬½ö½öÎÞ·¨ÏíÓøÃÊý¾ÝÀàÐ͵ÄϤÊýÓÅÊÆ¡£¡£¡£
µÍ¾«¶ÈÓëºËËãÁ¿µÄÈ¡Éá
ÊÂʵÉÏ£¬£¬£¬MXFP4²¢²»ÊÇп´·¨¡£¡£¡£ÔçÔÚ2023ÄêµÄ³ÂÊöÖУ¬£¬£¬OCP¾ÍÔÚ³ÂÊö¡¶OCP Microscaling Formats (MX) Specification Version 1.0¡·ÖÐÏêϸ½éÉܹýÕâÒ»Êý¾ÝÀàÐÍ¡£¡£¡£

¿ÉÊÇ£¬£¬£¬ÕâÖֵ;«¶ÈµÄÊý¾ÝÀàÐÍͨ³£±»ÒÔΪÊǶÔÐԼ۱ȵÄÍËÈ㬣¬£¬ÓÉÓÚ¾«¶ÈϽµ»áµ¼ÖÂÖÊÁ¿É¥Ê§¡£¡£¡£É¥Ê§µÄˮƽȡ¾öÓÚÏêϸµÄÁ¿»¯²½·¥¡£¡£¡£
²»¹ý£¬£¬£¬ÏÖÒÑÓÐÖª×ã¶àµÄ×êÑбêÃ÷£¬£¬£¬½«Êý¾Ý¾«¶È´Ó16λ½µµ½8룬£¬£¬ÔÚ¿ñÑÔÓïÄ£×Ó³¡¾°Ï¼òֱûÓÐÖÊÁ¿É¥Ê§£¬£¬£¬ÕâÖÖ¾«¶ÈÏÖÒÑÖª×ãÖ§³ÖÄ£×ÓµÄÕý³£×÷Òµ¡£¡£¡£
ÊÂʵÉÏ£¬£¬£¬Ò»Ð©Ä£×Ó¿ª·¢Õߣ¬£¬£¬ÀýÈçDeepSeekÏÖÒÑÆðÔ´Ö±½ÓÓÃFP8¾ÙÐÐѵÁ·¡£¡£¡£
±ðµÄ£¬£¬£¬Ö»¹ÜMXFP4±È¹æ·¶FP4ºÃµÃ¶à£¬£¬£¬µ«ËüÒ²ÓÐÈõµã¡£¡£¡£
ÀýÈ磬£¬£¬Ó¢Î°´ï¾ÍÒÔΪÕâÖÖÊý¾ÝÀàÐͽÏÁ¿FP8ÈÔ»òÐí·ºÆðÖÊÁ¿Ï½µ£¬£¬£¬²¿·ÖÔµ¹ÊÔÓÉÊÇÆäËõ·Å¿é¾Þϸ£¨Scaling Block Size£©Îª32£¬£¬£¬²»¿ÉϸÁ£»£»£»£»£»£»¯¡£¡£¡£
Ϊ´Ë£¬£¬£¬Ó¢Î°´ïÍÆ³öÁË×Ô¼ºµÄ΢Ëõ·ÅÊý¾ÝÀàÐÍNVFP4£¬£¬£¬¾Óɽ«Ëõ·Å¿é¾Þϸ½µÖÁ16ºÍÔËÓÃFP8Ëõ·ÅÒò×ÓÀ´Ç°½øÖÊÁ¿¡£¡£¡£
Õâ¼òÖ±µÈͬÓÚFP8µÄ×÷Òµ·½·¨¡£¡£¡£Ö»²»¹ýMXFP4ÊÇÔÚÕÅÁ¿ÄÚ²¿µÄС¿éÉÏʹÓÃËõ·ÅÒò×Ó£¬£¬£¬¶ø²»ÊÇ×÷ÓÃÓÚÕû¸öÕÅÁ¿£¬£¬£¬È»ºóÔÚÊýÖµÖ®¼äÍê³É¸üϸµÄÁ£¶È¡£¡£¡£
×îÖÕ£¬£¬£¬ÔÚgpt-ossÉÏ£¬£¬£¬OpenAIÖ»ÔËÓÃÁËMXFP4¡£¡£¡£
¼øÓÚOpenAIÔÚAIÁìÓòÉϵÄÓ°ÏìÁ¦£¬£¬£¬Õâ»ù±¾ÉϾͼ´ÊÇÔÚ˵£º
ÈôÊÇMXFP4¶ÔÔÛÃǹ»Ó㬣¬£¬ÄǶÔÄãÒ²Ó¦¸Ã¹»Óᣡ£¡£
²ÎÔÄÁ´½Ó
[1]https://www.theregister.com/2025/08/10/openai_mxfp4/
[2]https://cdn.openai.com/pdf/419b6906-9da6-406c-a19d-1bb078ac7637/oai_gpt-oss_model_card.pdf
[3]https://www.opencompute.org/documents/ocp-microscaling-formats-mx-v1-0-spec-final-pdf
±¾ÎÄÀ´×Ô΢ÐŹ«¹²ºÅ¡°Á¿×Óλ¡±£¬£¬£¬36ë´¾ÊÚȨÐû²¼¡£¡£¡£