µ»½Ñ¥³¥é¥à

¡ÖJetson¤ÈKubernetes¤ÇÆ°¤«¤¹Edge AI¥×¥é¥Ã¥È¥Õ¥©¡¼¥à¹ÖºÂ¡×
Âè1²ó¡§Jetson¤È¥³¥ó¥Æ¥Ê

Stylez¡Ê¥¹¥¿¥¤¥ë¥º¡Ë

Ëܵ­»ö¤Ï¤³¤ó¤Ê²ÝÂê¤ä¤ªº¤¤ê¤´¤È¤ò¤ª»ý¤Á¤Î¤ªµÒÍͤËÀ§Èó¤´Í÷夭¤¿¤¤ÆâÍƤǤ¹¡£
¡¦¹©¾ì¤ò¤â¤ÄÀ½Â¤¶È¤Î¤ªµÒÍͤÇAI¥·¥¹¥Æ¥à¤òÍøÍѤ·¤Æ¤¤¤ë
¡¦À½Â¤¸½¾ì¤ÎÀ¸»ºÀ­¤ò¤¢¤²¤¿¤¤¡¢±¿ÍѤοͼêÉÔ­¤Çº¤¤Ã¤Æ¤¤¤ë
¡¦¥¹¥Þ¡¼¥È¥Õ¥¡¥¯¥È¥ê¡¼¤ä¥³¥ó¥Æ¥Êµ»½Ñ¤Ë¶½Ì£¤Ï¤¢¤ë¤¬¡¢°ìÂβ¿¤Ê¤Î¤«¤ï¤«¤ê¤Å¤é¤¤¡Ä

NVIDIA® Jetson™ ¥·¥ê¡¼¥º¤ò»È¤Ã¤¿Edge AI¥×¥é¥Ã¥È¥Õ¥©¡¼¥à¤Ë¤Ä¤¤¤Æ¤Î¤¢¤ì¤³¤ì¤ò¾®¥Í¥¿¤«¤éºÇ¿·¾ðÊó¤Þ¤ÇÉý¹­¤¯¼è¤ê°·¤¤¤Þ¤¹¡£
¤Ç¤­¤ë¤À¤±ÆɼԤγ§Íͤε¿Ìä¤ËÅú¤¨¤Æ¤Þ¤¤¤ê¤Þ¤¹¤Î¤Ç¡¢¡Ö¤³¤ó¤Ê¤³¤È¤¬Ê¬¤«¤é¤Ê¤¤¡×¡Ö¤³¤³¤Ë¤Ä¤¤¤Æ¾Ü¤·¤¯¡×¤Ê¤É¥ê¥¯¥¨¥¹¥È¤¬¤´¤¶¤¤¤Þ¤·¤¿¤é¡¢À§ÈóËÜ¥µ¥¤¥È²¼Éô¤Î¡Ö¤ª¿½¹þ¤ß¥Õ¥©¡¼¥à¡×¤Þ¤Ç¤ª´ê¤¤¤¤¤¿¤·¤Þ¤¹¡£

Âè°ì²óÌܤÏJetson¤Ë¤Þ¤Ä¤ï¤ë¥³¥ó¥Æ¥Ê¤ÎÏäǤ¹¡£

1.1¡¡AI³«È¯¤È¥³¥ó¥Æ¥Ê

¥³¥ó¥Æ¥Ê¤Ï¡¢º£¤äAI³«È¯¤Ë·ç¤«¤»¤Ê¤¤¤â¤Î¤È¤Ê¤Ã¤Æ¤­¤Þ¤·¤¿¡£¤½¤Î°ìÊý¤Ç¡¢AI³«È¯¤Ï³«È¯¸À¸ì¤È¥Õ¥ì¡¼¥à¥ï¡¼¥¯¤ÈÌ©Àܤ˴ط¸¤·¤Æ¤¤¤Æ¡¢¤µ¤é¤Ë¤½¤Î¥Õ¥ì¡¼¥à¥ï¡¼¥¯¤¬ÍøÍѤ¹¤ëCUDA¥é¥¤¥Ö¥é¥ê¡¼(CUDA Toolkit)¤â¤Þ¤¿ÀڤäƤâÀÚ¤ì¤Ê¤¤´Ø·¸¤Ë¤¢¤ê¤Þ¤¹¡£
¤½¤·¤Æ¡¢¤½¤ì¤é¤Î³«È¯¸À¸ì¡¢¥Õ¥ì¡¼¥à¥ï¡¼¥¯¡¢CUDA¥é¥¤¥Ö¥é¥ê¡¼(CUDA Toolkit)¤ÏÊÌ¡¹¤Ë³«È¯¡¢´ÉÍý¡¢¥Ð¡¼¥¸¥ç¥ó¥¢¥Ã¥×¤µ¤ì¤Æ¤¤¤¯¤È¤¤¤¦¡É¿É¤ß¡Ê¥Ä¥é¥ß¡Ë¡É¤¬¤¢¤ê¤Þ¤¹¡£

¢¨²¼µ­URL¤Î»ñÎÁP.10¤è¤ê
https://www.slideshare.net/takanoriogata1121/190410-mlloft
¤³¤³¤Ç¤¤¤¦¡¢¡Ö¤ª¤ì¤Î¤«¤ó¤­¤ç¤¦¤Ç¤Ï¤¦¤´¤¯ÌäÂê¡×¤Ç¤¹¡£

¤½¤³¤ÇµÓ¸÷¤òÍá¤Ó¤¿¤Î¤¬¡¢¥¢¥×¥ê¥±¡¼¥·¥ç¥ó¤òOS´Ä¶­Æâ¤Çʬ³ä¤¹¤ëµ¡Ç½¤ò¤â¤Ä¥³¥ó¥Æ¥Ê¤Ç¡¢¤³¤Î¥³¥ó¥Æ¥Ê¤ò»È¤¤¤ä¤¹¤¯¼ÂÁõ¤·¤¿¤Î¤¬Docker¤Ç¤¹¡£

Docker¤Ï¡¢¥³¥ó¥Æ¥Ê¤òÆ°¤«¤¹¤¿¤á¤ËɬÍפʤâ¤Î¤ò1¤Ä¤Î¤«¤¿¤Þ¤ê¤È¤·¤Æ°·¤¨¤ë¤è¤¦¤Ë¤·¤Þ¤·¤¿¡£

¤³¤ì¤Ë¤è¤ê²¿¤«¤ò¥³¥ó¥Æ¥Ê¤È¤·¤Æ¼Â¹Ô¤¹¤ë¾ì¹ç¤Ë¤Ï¡¢¤³¤Î¤«¤¿¤Þ¤ê¤ò¥À¥¦¥ó¥í¡¼¥É¤·¤Æµ¯Æ°¤¹¤ë¡¢¤È¤¤¤¦Áàºî¤À¤±¤Ç³«È¯¤¬»Ï¤á¤é¤ì¤ë¤è¤¦¤Ë¤Ê¤ê¤Þ¤·¤¿¡£

1.2¡¡¥³¥ó¥Æ¥Ê¤Î²ÄÈÂÀ­

¤³¤ì¤Þ¤Ç¤ÎʪÍý¡Êor ²¾ÁÛ¡Ë¥Þ¥·¥ó¤Ç¤Ï¡¢°Ê²¼¤Î¤è¤¦¤Ê¤Ò¤È¤«¤¿¤Þ¤ê¤Ç¹Í¤¨¤ëɬÍפ¬¤¢¤ê¤Þ¤·¤¿¡£

¤·¤«¤·¡¢Docker¤Î¤ª¤«¤²¤Ç¡¢²¼¤Î¿Þ¤Ç¡Ö¿å¿§¤ÎÉôʬ¤Î¤ß¡×¤ò²ÄÈÂÀ­¤Î¤¢¤ëDocker¥¤¥á¡¼¥¸¤È¤·¤ÆÍøÍѤǤ­¡¢¤³¤Î¥¤¥á¡¼¥¸¤À¤±¤¢¤ì¤Ð¤É¤³¤Î¥µ¡¼¥Ð¡¼¤Ç¤â¼Â¹Ô¤Ç¤­¤ë¤è¤¦¤Ë¤Ê¤ê¤Þ¤·¤¿¡£

¤³¤ì¤Ï¡¢¥¢¥×¥ê¥±¡¼¥·¥ç¥ó¤È¥Õ¥ì¡¼¥à¥ï¡¼¥¯¤ò°ì½ï¤Ë¥Ñ¥Ã¥±¡¼¥¸¥ó¥°¤¹¤ë¤È¤¤¤¦Docker¥¤¥á¡¼¥¸¤Îµ¡Ç½¤Ë¤è¤Ã¤Æ¤â¤¿¤é¤µ¤ì¤¿¤â¤Î¤Ç¤¹¡£
¤³¤ì¤ò¡Ö¥³¥ó¥Æ¥Ê¤Î²ÄÈÂÀ­¡×¤È¤¤¤¤¤Þ¤¹¡£

1.3¡¡CUDA¥¢¥×¥ê¥±¡¼¥·¥ç¥ó¤Î¾ì¹ç

¥³¥ó¥Æ¥Ê¤Ë¤è¤ê¥¢¥×¥ê¥±¡¼¥·¥ç¥ó¤Î²ÄÈÂÀ­¤¬¸þ¾å¤·¡¢³«È¯¤Î¸½¾ì¤ÏÍÍÊѤï¤ê¤·¤Þ¤·¤¿¤¬¡¢CUDA¥¢¥×¥ê¥±¡¼¥·¥ç¥ó¤Ç¤Ï¤É¤¦¤Ç¤·¤ç¤¦¤«¡©
CUDA¥¢¥×¥ê¥±¡¼¥·¥ç¥ó¤Î¾ì¹ç¤ÏGPU¤È¤¤¤¦¥Ï¡¼¥É¥¦¥§¥¢¤¬Íí¤ó¤Ç¤¯¤ë¤Î¤ÇÊ£»¨¤Ç¤¹¡£

°ìÈÌŪ¤ÊCUDA¥¢¥×¥ê¥±¡¼¥·¥ç¥ó¤Ë¤Ï¡¢²¼¤Î¿Þ¤Î¥Ô¥ó¥¯Éôʬ¤Ë¤½¤ì¤¾¤ì°Í¸´Ø·¸¤¬¤¢¤ê¤Þ¤¹¡£

Î㤨¤Ð¡¢GPU¤ò»È¤¦¤Ë¤Ï¡¢OS¦¤Ë¥¤¥ó¥¹¥È¡¼¥ë¤µ¤ì¤¿GPU¥É¥é¥¤¥Ð¡¼(NVIDIA Driver)¤¬É¬ÍפǤ¹¡£ ¤³¤ÎGPU¥É¥é¥¤¥Ð¡¼¤Ë°Í¸¤·¤Æ¤¤¤ë¤Î¤¬CUDA¥é¥¤¥Ö¥é¥ê¡¼(CUDA Toolkit)¤Ç¡¢¸Å¤¤GPU¥É¥é¥¤¥Ð¡¼¤Ç¤ÏÆ°¤«¤Ê¤¤¾ì¹ç¤â¤¢¤ê¤Þ¤¹¡£¤½¤·¤Æ¡¢¤½¤ÎCUDA¥é¥¤¥Ö¥é¥ê¤ò¥Õ¥ì¡¼¥à¥ï¡¼¥¯¤¬¡¢¥Õ¥ì¡¼¥à¥ï¡¼¥¯¤òCUDA¥¢¥×¥ê¥±¡¼¥·¥ç¥ó¤¬ÍøÍѤ·¤Æ¤¤¤Þ¤¹¡£

¤³¤ÎÌäÂ꤬¡¢¥³¥ó¥Æ¥Ê¤Ç¤Ï¼¡¤Î¤è¤¦¤Ë²ò·è¤Ç¤­¤Þ¤¹¡£

CUDA Toolkit¤¬¥³¥ó¥Æ¥Ê¦¤ËÆâÊñ¤µ¤ì¤Æ¥Õ¥ì¡¼¥à¥ï¡¼¥¯¤È¤Î°Í¸´Ø·¸¤ò²ò¾Ã¤Ç¤­¤Þ¤¹¡£

¢§¾ÜºÙ¤Ê¿Þ¤Ï°Ê²¼¥ê¥ó¥¯¤Î¡Ö4. NGC Images¡×¤Ë·ÇºÜ¤µ¤ì¤Æ¤¤¤Þ¤¹¡£
¡¡https://docs.nvidia.com/deeplearning/frameworks/user-guide/index.html#nvdocim
¡¡¢¨ÆüËܸìÈǤϳô¼°²ñ¼ÒHPC¥Æ¥Ã¥¯¤¬°Ê²¼¤ÎURL¤Ç¸ø³«¤·¤Æ¤¤¤Þ¤¹¡£
¡¡[¥æ¡¼¥¶¥¬¥¤¥É] NVIDIA ¥Ç¥£¡¼¥×¥é¡¼¥Ë¥ó¥°¥Õ¥ì¡¼¥à¥ï¡¼¥¯¥³¥ó¥Æ¥ÊÆüËܸìÈǹ¹¿·
¡¡https://www.hpctech.co.jp/maker/nvidia_user_guide_2022.html

1.4¡¡JetPack¤È¤Î°Í¸´Ø·¸

NVIDIA Docker¤Ç°Í¸´Ø·¸¤ò²ò¾Ã¤Ç¤­¤Þ¤·¤¿¤¬¡¢Jetson¤Ç¥³¥ó¥Æ¥Ê¤ò¼Â¹Ô¤¹¤ëºÝ¡¢°Ê²¼¤Î¤è¤¦¤Êɽµ­¤ò¸«¤¿¤³¤È¤Ï¤Ê¤¤¤Ç¤·¤ç¤¦¤«¡©
¡ÖYou would need to install Jetpack 4.3 to run this demo on Jetson Xavier NX. ¡×
¤Ä¤Þ¤ê¡¢¡ÖÆÃÄê¤ÎJetPack¤Ç¤Î¤ßÆ°¤¯(¤â¤·¤¯¤ÏÆ°ºî³Îǧ¤µ¤ì¤Æ¤¤¤ë)¡×¤È½ñ¤«¤ì¤Æ¤¤¤Þ¤¹¡£
¸½ºß¤ÎJetson¤Ç¤Ï³Æ¼ïGPU¤Ë´ØÏ¢¤¹¤ë¥½¥Õ¥È¥¦¥§¥¢¤Ë°Ê²¼¤ÎÀ©¸Â¤¬¤¢¤ê¡¢¤³¤³¤ËÂ礭¤ÊÌäÂ꤬¤¢¤ê¤Þ¤¹¡£

²¼µ­¤ÎURL¤Ë°Ê²¼¤Î¤è¤¦¤Êµ­½Ò¤¬¤¢¤ê¤Þ¤¹¡£
https://github.com/NVIDIA/nvidia-docker/wiki/NVIDIA-Container-Runtime-on-Jetson#usrlocalcuda-is-readonly
¡Ö¥Ù¡¼¥¿ÈǤÎÀ©¸Â¤Î1¤Ä¤Ï¡¢¥Û¥¹¥È¤«¤écuda¥Ç¥£¥ì¥¯¥È¥ê¤ò¥Þ¥¦¥ó¥È¤¹¤ë¤³¤È¤Ç¤¹¡£¤³¤ì¤Ï¡¢³«È¯ÍÑCUDA¥³¥ó¥Æ¥Ê¤Î¥µ¥¤¥º¤¬3GB¤Ç¤¢¤ë¤³¤È¤ò¹Íθ¤·¤¿¤â¤Î¤Ç¡¢Nano¤Ç¤Ïɬ¤º¤·¤â¤½¤Î¤è¤¦¤ÊµðÂç¤Ê¥µ¥¤¥º¤Î¥³¥ó¥Æ¥Ê¤òÍøÍѤ¹¤ë¤³¤È¤Ï¤Ç¤­¤Þ¤»¤ó¡£¸½ºß¡¢¤è¤ê¾®¤µ¤ÊCUDA¥³¥ó¥Æ¥Ê¤ÎºîÀ®¤Ë¸þ¤±¤Æºî¶ÈÃæ¤Ç¤¹¡£¡×

Jetson¤Ç¥³¥ó¥Æ¥Ê¤ò¼Â¹Ô¤¹¤ëºÝ¤Ï¡¢²¼¿Þ¤ÎÄ̤ꡢÄ̾ï¤ÎNVIDIA Docker¤È¤Ï°Û¤Ê¤ê¤Þ¤¹¡£

ʬ¤«¤ê¤Ë¤¯¤¤¤Î¤Ç¤¹¤¬¡¢¾åµ­¿Þ¤ÎÀÖÏȤǥ³¥ó¥Æ¥Ê¤ÎÈϰϤËCUDA Toolkit¤¬´Þ¤Þ¤ì¤Æ¤¤¤Þ¤»¤ó¡£¼Â¤ÏCUDA Toolkit¤Ï¥³¥ó¥Æ¥Ê´ðÈצ¤Ë¸ºß¤·¤Æ¤¤¤Æ¡¢¿å¿§¤Î¥³¥ó¥Æ¥ÊÆ⤫¤é¥Þ¥¦¥ó¥È¤¹¤ë»ÅÍͤˤʤäƤ¤¤Þ¤¹¡£
CUDA Toolkit¤Ï3GB¤ÈµðÂç¤Ê¤¿¤á¥³¥ó¥Æ¥Ê¥¤¥á¡¼¥¸Æâ¤Ç¤Ï¤Ê¤¯¥³¥ó¥Æ¥Ê´ðÈצ¤ËÃÖ¤­¡¢¥³¥ó¥Æ¥ÊÆ⤫¤é¥Þ¥¦¥ó¥È¤¹¤ë¤³¤È¤Ë¤è¤Ã¤Æ¡¢¼«Æ°Åª¤Ë¥Þ¥¦¥ó¥È¤·¤Þ¤¹¡£

¥³¥ó¥Æ¥Ê¤Ï¡¢²ÄÈÂÀ­¤È°Í¸´Ø·¸¤Î²ò¾Ã¤ò¼Â¸½¤Ç¤­¤ëÁÇÀ²¤é¤·¤¤¥½¥Õ¥È¥¦¥§¥¢¤Ç¤¹¤¬¡¢CUDA Toolkit¤È¥Õ¥ì¡¼¥à¥ï¡¼¥¯¤Ë°Í¸´Ø·¸¤¬¤¢¤ê¡¢¥³¥ó¥Æ¥Ê¤â¥³¥ó¥Æ¥Ê´ðÈצ¤Ç¤¢¤ëJetPack¤Ë°Í¸¤·¤Æ¤·¤Þ¤¦¤Î¤Ç¤¹¡£JetPack 4.6.1¤Þ¤Ç¤ÎÀ©¸Â¤Ç¡¢JetPack 5.0¤Ç²ò¾Ã¤µ¤ì¤ë¸«¹þ¤ß¤Ç¤¹¡£

1.5¡¡JetPack 5.0¤Ç¤ÎÊѹ¹ÅÀ

JetPack 5.0¤Ç¤Ï¾åµ­¤Î¤è¤¦¤ËÊѹ¹¤µ¤ì¤ëͽÄê¤Ç¤¹¡£

CUDA Toolkit¤¬¥³¥ó¥Æ¥Ê¦¤Ë°Ü¹Ô¤µ¤ì¡¢¥Õ¥ì¡¼¥à¥ï¡¼¥¯¤ÈCUDA Toolkit¤¬¥³¥ó¥Æ¥Ê¦¤Ë¤Ê¤ë¤³¤È¤Ç¡¢JetPack¤È¤Î°Í¸´Ø·¸¤Î¸º¾¯¤¬´üÂԤǤ­¤Þ¤¹¡£°ìÊý¤Ç¡¢¥³¥ó¥Æ¥Ê¦¤Î¥µ¥¤¥º¤¬Áý²Ã¤¹¤ë¡¢¤È¤¤¤¦²ÝÂê¤â¤Ç¤Æ¤­¤Þ¤¹¡£
¢§Jetpack SDK 5.0¤ÎÊѹ¹ÅÀ¤Ë´Ø¤¹¤ë¾ÜºÙ¤Ï¤³¤Á¤é
¡¡JetPack SDK 5.0 Developer Preview | NVIDIA Developer
¡¡https://developer.nvidia.com/jetpack-sdk-50dp


²¼µ­¤Ï¡¢¥Ç¥£¡¼¥×¥é¡¼¥Ë¥ó¥°¤ËɬÍפʥ³¥ó¥Æ¥Ê¥¤¥á¡¼¥¸ÃÖ¤­¾ì¤Ç¤¢¤ëNVIDIA NGC™ ¡ÊNVIDIA GPU Cloud¡Ë¤Î¥³¥ó¥Æ¥Ê¥¤¥á¡¼¥¸¤Î¥µ¥¤¥º¤Ç¤¹¤¬¡¢JetPack 5.0ÍѤÏ6.76GB¤ÈJetPack 4.6.1¤Î1.71GB¤«¤é5GBÁý¤¨¤Æ¤¤¤Þ¤¹¡£
¢§Jetson¤ÈJetPackÍѤε¡³£³Ø½¬ÍÑ¥³¥ó¥Æ¥Ê¥¤¥á¡¼¥¸¤Î¾ÜºÙ¤Ï¤³¤Á¤é
¡¡https://catalog.ngc.nvidia.com/orgs/nvidia/containers/l4t-ml

Jetson¤ÏeMMC¤ÇÆ°¤«¤·¤Æ¤¤¤Æ¡¢ÍÆÎ̤¬¸Â¤é¤ì¤Æ¤¤¤ë¤³¤È¤«¤éÊ̤ÎǺ¤ß¤¬Áý¤¨¤½¤¦¤Ç¤¹¡£

Âè1²ó¤Î¡ÖJetson¤È¥³¥ó¥Æ¥Ê¡×¤¤¤«¤¬¤À¤Ã¤¿¤Ç¤·¤ç¤¦¤«¡£º£¸å¤â¡¢ÉáÃʲ¿µ¤¤Ê¤¯»È¤Ã¤Æ¤¤¤Æ¡¢²¿¤À¤í¤¦¤Ê¡©¤Èµ¿Ìä¤Ë»×¤¦¤è¤¦¤ÊÆâÍƤò¼è¤ê¾å¤²¤Æ¤¤¤­¤¿¤¤¤È»×¤¤¤Þ¤¹¡£

À§Èó¡¢¥Õ¥£¡¼¥É¥Ð¥Ã¥¯¤ò¤¤¤¿¤À¤±¤ì¤Ð¹¬¤¤¤Ç¤¹¡£

¥Ú¡¼¥¸¤ÎÀèƬ¤ØÌá¤ë