{"id":6155,"date":"2024-07-11T14:55:13","date_gmt":"2024-07-11T05:55:13","guid":{"rendered":"https:\/\/kakaoenterprise.com\/?post_type=press&p=6155"},"modified":"2024-07-11T15:00:57","modified_gmt":"2024-07-11T06:00:57","slug":"kakaoenterprise-nvidia-bootcamp","status":"publish","type":"press","link":"https:\/\/kakaoenterprise.com\/press\/kakaoenterprise-nvidia-bootcamp\/","title":{"rendered":"\uce74\uce74\uc624\uc5d4\ud130\ud504\ub77c\uc774\uc988, NVIDIA\uc640 \uce74\uce74\uc624\ud074\ub77c\uc6b0\ub4dc \uae30\ubc18 AI \uac1c\ubc1c\uc790 \ubd80\ud2b8\ucea0\ud504 \uc131\ud669\ub9ac \uac1c\ucd5c"},"content":{"rendered":"\n
[2024-7-11] \uce74\uce74\uc624\uc5d4\ud130\ud504\ub77c\uc774\uc988(\ub300\ud45c \uc774\uacbd\uc9c4)\ub294 11\uc77c \uc0bc\uc131\ub3d9\uc5d0 \uc704\uce58\ud55c \uce74\uce74\uc624 \uac15\ub0a8\uc624\ud53c\uc2a4\uc5d0\uc11c \u2018NVIDIA X \uce74\uce74\uc624\ud074\ub77c\uc6b0\ub4dc \uc6d0\ub370\uc774 AI \uac1c\ubc1c\uc790 \ubd80\ud2b8\ucea0\ud504\u2019\ub97c \uc131\ud669\ub9ac\uc5d0 \uac1c\ucd5c\ud588\ub2e4\uace0 \ubc1d\ud614\ub2e4.<\/p>\n\n\n\n
\ubcf8 \ud589\uc0ac\ub294 \uce74\uce74\uc624\ud074\ub77c\uc6b0\ub4dc\uc758 NVIDIA GPU \uc778\uc2a4\ud134\uc2a4\ub97c \ud65c\uc6a9\ud55c \uc628\u00b7\uc624\ud504\ub77c\uc778 \ud589\uc0ac\ub85c, \u2018AI\uc640 \ud074\ub77c\uc6b0\ub4dc \uae30\uc220\uc138\ubbf8\ub098\u2019 \ubc0f \u2018\uce74\uce74\uc624\ud074\ub77c\uc6b0\ub4dc\uc640 NVIDIA AI\ub97c \ud65c\uc6a9\ud55c AI\uc778\ud37c\ub7f0\uc2a4 \ubd80\ud2b8\ucea0\ud504\u2019\ub85c \ub098\ub204\uc5b4 \uc9c4\ud589\ub410\ub2e4. <\/p>\n\n\n\n 1\ubd80 \ud589\uc0ac\uc778 \u2018AI\uc640 \ud074\ub77c\uc6b0\ub4dc \uae30\uc220\uc138\ubbf8\ub098’\uc5d0\uc11c\ub294 \uc5d4\ube44\ub514\uc544\uc758 AI \uc194\ub8e8\uc158 \uc18c\uac1c \ubc0f \uce74\uce74\uc624\ud074\ub77c\uc6b0\ub4dc\uc758 \uae30\uc220\uacfc \uc11c\ube44\uc2a4\ub97c \uc8fc\uc81c\ub85c \ud55c \uc138\uc158\uc774 \uc9c4\ud589\ub418\uc5c8\ub2e4. \uc628\ub77c\uc778\uc73c\ub85c \uc9c4\ud589\ub41c 1\ubd80 \ud589\uc0ac\ub294 200\uba85 \ubaa8\uc9d1\uc5d0 400\uc5ec \uba85\uc774 \ub118\uac8c \uc2e0\uccad\ud574 \uc2e0\uccad\uc790 \uc804\uc6d0 \ucc38\uc5ec\ub85c \ud655\ub300 \uc2e4\uc2dc\ud560 \ub9cc\ud07c AI\uc640 \ud074\ub77c\uc6b0\ub4dc\ub97c \ud5a5\ud55c \ub192\uc740 \uad00\uc2ec\ub3c4\ub97c \ubcf4\uc600\ub2e4.<\/p>\n\n\n\n 2\ubd80 \ud589\uc0ac\ub294 \uce74\uce74\uc624\ud074\ub77c\uc6b0\ub4dc \uae30\ubc18 NVIDIA GPU\ub97c \ud65c\uc6a9\ud574 \uac70\ub300 \uc5b8\uc5b4 \ubaa8\ub378 \ub77c\ub9c83(LLaMa3)\uc758 \uc778\ud37c\ub7f0\uc2a4 \ucd5c\uc801\ud654 \ubc0f \ubc30\ud3ec \uad00\ub828 \ucd5c\uc2e0 \uae30\uc220\uc744 \uc2e4\uc2b5\ud588\ub2e4. \uc624\ud504\ub77c\uc778\uc73c\ub85c \uc9c4\ud589\ub41c 2\ubd80 \ud589\uc0ac\ub294 \uae4a\uc774 \uc788\ub294 \uc591\uc9c8\uc758 \uad50\uc721\uc744 \uc704\ud574 30\uba85\uc73c\ub85c \uc81c\ud55c\ud574 \uc9c4\ud589\ub418\uc5c8\ub294\ub370, \ub2e4\uc591\ud55c \uc0b0\uc5c5\uad70\uc758 \uac1c\ubc1c\uc790\ub4e4\uc774 \ucc38\uc11d\ud574 \ub192\uc740 \ub9cc\uc871\ub3c4\ub97c \ub098\ud0c0\ub0c8\ub2e4.<\/p>\n\n\n\n \ud2b9\ud788, 2\ubd80 \ud589\uc0ac\uc778 \ubd80\ud2b8\ucea0\ud504\uc5d0\uc11c\ub294 NVIDIA \uc758 \uc194\ub8e8\uc158 \uc544\ud0a4\ud14d\ud2b8\uac00 \uc9c1\uc811 \uce74\uce74\uc624\ud074\ub77c\uc6b0\ub4dc \uae30\ubc18 \ud658\uacbd\ubd80\ud130 \uc778\ud37c\ub7f0\uc2a4 \uc2e4\uc2b5\uae4c\uc9c0 \uc9c4\ud589, \ucc38\uc11d\uc790\ub4e4\uc774 \ub2e8\uc2dc\uac04\uc5d0 AI\u30fb\ud074\ub77c\uc6b0\ub4dc\uc5d0 \uae4a\uc774 \uc788\ub294 \uc774\ud574\ub97c \ub3c4\uc654\ub2e4. \uad6c\uccb4\uc801\uc73c\ub85c\ub294 \u25b2KakaoCloud \uc2e4\uc2b5 \ud658\uacbd \uc14b\uc5c5 \u25b2TensorRT-LLM \ubc0f Triton Inference Server \uc18c\uac1c \u25b2TensorRT-LLM \uc2e4\uc2b5 \u25b2\ucd5c\uc801\ud654\ub41c \uc5d4\uc9c4 \ubc30\ud3ec \uc2e4\uc2b5 in Triton Inference Server \u25b2NIM \uc18c\uac1c(\uac15\uc758) \u25b2NIM \uc2e4\uc2b5(\ub7a9)\uc744 \uc9c4\ud589\ud558\uba70 \ucc38\uc11d\uc790\ub4e4\uc758 \ub192\uc740 \ud638\uc751\uc744 \ubc1b\uc558\ub2e4.<\/p>\n\n\n\n \uce74\uce74\uc624\ud074\ub77c\uc6b0\ub4dc\uc640 NVIDIA \uac04 \uacf5\ub3d9 \ud589\uc0ac \uac1c\ucd5c\ub294 \ucc98\uc74c\uc774\uc9c0\ub9cc \ud611\ub825 \uad00\uacc4\ub294 \uc624\ub798\uc804\ubd80\ud130 \uc9c0\uc18d\ub418\uace0 \uc788\ub2e4. \uc9c0\ub09c 5\uc6d4 \uae00\ub85c\ubc8c \uc288\ud37c\ucef4\ud4e8\ud130 TOP500\uc5d0\uc11c 44\uc704 70\uc704\uc5d0 \ub7ad\ud06c\ub418\uba70 \uae00\ub85c\ubc8c \uae30\uc220\ub825\uc744 \uc778\uc815\ubc1b\uc740 \uce74\uce74\uc624\ud074\ub77c\uc6b0\ub4dc\ub294 \uace0\uc131\ub2a5 \ud074\ub77c\uc6b0\ub4dc \ucef4\ud4e8\ud305\uc744 \uad6c\uc131\ud558\ub294\ub370, NVIDIA GPU\ub97c \uc801\uadf9 \ud65c\uc6a9\ud558\uace0 \uc788\ub2e4. \uc774\ucc98\ub7fc \uc0dd\uc131\ud615AI\uc5d0 \ud544\uc694\ud55c \uace0\uc131\ub2a5 \ud074\ub77c\uc6b0\ub4dc \ucef4\ud4e8\ud305 \uae30\uc220 \ubc0f \uc2dc\uc7a5 \uc131\uc7a5\uc744 \uc704\ud574 \ud611\ub825\uc744 \uc774\uc5b4 \ub098\uac08 \uc608\uc815\uc774\ub2e4.<\/p>\n\n\n\n \uc774\uc9c0\ud61c \uce74\uce74\uc624\uc5d4\ud130\ud504\ub77c\uc774\uc988 CGO(\ucd5c\uace0\uc131\uc7a5\ucc45\uc784\uc790)\ub294 \u201cNVIDIA\uc640 \uacf5\ub3d9\uc73c\ub85c \uac1c\ucd5c\ud55c \ubd80\ud2b8\ucea0\ud504\uac00 \ucc38\uc5ec\uc790\ub4e4\uc758 \ub192\uc740 \uad00\uc2ec\uacfc \ub9cc\uc871\ub3c4\ub97c \ubcf4\uc5ec \uc900\ube44\ud55c \ubcf4\ub78c\uc744 \ub290\ub080\ub2e4\u201d\uba70 \u201c\uce74\uce74\uc624\ud074\ub77c\uc6b0\ub4dc \uae30\ubc18\uc758 NVIDIA GPU\ub97c \ud65c\uc6a9\ud55c \uad50\uc721\uc5d0 \ub354\ud574, \uace0\uc131\ub2a5 \ud074\ub77c\uc6b0\ub4dc \ucef4\ud4e8\ud305 \uc2dc\uc7a5\uc5d0\uc11c \ucc28\ubcc4\ud654\ub41c \uae30\uc220\ub825\uc73c\ub85c \uc131\uc7a5\ud574 \uac08 \uc218 \uc788\ub3c4\ub85d \uc591\uc0ac\uc758 \ud611\ub825 \uad00\uacc4\ub97c \uacf5\uace0\ud788 \ud560 \uac83\u201d\uc774\ub77c\uace0 \ub9d0\ud588\ub2e4. <\/p>\n\n\n\n \ud55c\ud3b8, \ucd5c\uadfc \uc2a4\ud0c0\ud2b8\uc5c5 \uae30\uc5c5\uc758 AI\u30fb\ud074\ub77c\uc6b0\ub4dc \uac1c\ubc1c \ud658\uacbd\uc744 \uc9c0\uc6d0\ud558\uae30 \uc704\ud574 \uce74\uce74\uc624\ud074\ub77c\uc6b0\ub4dc \uae30\ubc18 \uc2a4\ud0c0\ud2b8\uc5c5 \uc0c1\uc0dd \ud504\ub85c\uadf8\ub7a8 \u2018\ub85c\ucf13\ub7f0\ucc98’\ub97c \uacf5\uac1c\ud558\uace0 AI\u30fb\ub85c\ubcf4\ud2f1\uc2a4\u30fb\uac8c\uc784 \ub4f1 \ub2e4\uc591\ud55c \uae30\uc220 \ubd84\uc57c\uc758 \uc2a4\ud0c0\ud2b8\uc5c5\uc744 \ubaa8\uc9d1 \uc911\uc774\ub2e4. \uc2e0\uccad\ud55c \ubaa8\ub4e0 \uae30\uc5c5\uc5d0 \uce74\uce74\uc624\ud074\ub77c\uc6b0\ub4dc \ud06c\ub808\ub527 \ubc0f \uae30\uc220\uc9c0\uc6d0, \uce74\uce74\uc624\uc6cc\ud06c \ub4f1 \ub2e4\uc591\ud55c \ud61c\ud0dd\uc744 \ubb34\uc0c1 \uc81c\uacf5\ud55c\ub2e4.<\/p>\n\n\n\n [\ub05d]<\/p>\n\n\n\n<\/figure>\n\n\n\n