Garrett Timmer
12/28/2023, 4:13 PM.-/+oossssoo+/-. ubuntu@node4
`:+ssssssssssssssssss+:` ------------
-+ssssssssssssssssssyyssss+- OS: Ubuntu 22.04.3 LTS aarch64
.ossssssssssssssssssdMMMNysssso. Model: NVIDIA Jetson Orin NX
/ssssssssssshdmmNNmmyNMMMMhssssss/ Mainboard: NVIDIA Jetson Orin NX
+ssssssssshmydMMMMMMMNddddyssssssss+ Bios: 2023-11-30 EDK II Ver:36.2.0-gcid-34956989
/sssssssshNMMMyhhyyyyhmNMMMNhssssssss/ Kernel: 5.15.122-tegra
.ssssssssdMMMNhsssssssssshNMMMdssssssss. Uptime: 5 mins
+sssshhhyNMMNyssssssssssssyNMMMysssssss+ Packages: 2108 (dpkg)
ossyNMMMNyMMhsssssssssssssshmmmhssssssso Shell: bash 5.1.16
ossyNMMMNyMMhsssssssssssssshmmmhssssssso Terminal: /dev/pts/0
+sssshhhyNMMNyssssssssssssyNMMMysssssss+ CPU: (4) @ 1.420GHz
.ssssssssdMMMNhsssssssssshNMMMdssssssss. Memory: 1175MiB / 15656MiB
/sssssssshNMMMyhhyyyyhdNMMMNhssssssss/ CPU Usage: 3%
+sssssssssdmydMMMMMMMMddddyssssssss+ Disk (/): 6.7G / 915G (1%)
/ssssssssssshdmNNNNmyNMMMMhssssss/
.ossssssssssssssssssdMMMNysssso.
-+sssssssssssssssssyyyssss+-
`:+ssssssssssssssssss+:`
.-/+oossssoo+/-.
Garrett Timmer
12/28/2023, 4:14 PMsudo apt update
sudo apt upgrade -y
sudo apt dist-upgrade -y
sudo apt install -y qemu-user-static nano openssh-server openssh-client
sudo reboot
Garrett Timmer
12/28/2023, 4:14 PMmkdir ~/nvidia
cd ~/.nvidia
Download Nvidia BSP Drivers & RootFS:
wget -O bsp.tbz2 -L https://developer.nvidia.com/downloads/embedded/l4t/r36_release_v2.0/release/jetson_linux_r36.2.0_aarch64.tbz2
wget -O rootfs.tbz2 -L https://developer.nvidia.com/downloads/embedded/l4t/r36_release_v2.0/release/tegra_linux_sample-root-filesystem_r36.2.0_aarch64.tbz2
Extract BSP & RootFS:
tar -xvpf bsp.tbz2
sudo tar -xvpf rootfs.tbz2 -C Linux_for_Tegra/rootfs/
Patch Firmware; Disable EEPROM:
Please note that the file location has changed relating to the 35.4.1 release
sed -i 's/cvb_eeprom_read_size = <0x100>/cvb_eeprom_read_size = <0x0>/g' Linux_for_Tegra/bootloader/generic/BCT/tegra234-mb2-bct-misc-p3767-0000.dts
Prepare Firmware:
cd Linux_for_Tegra
sudo ./apply_binaries.sh
sudo ./tools/l4t_flash_prerequisites.sh
Prepare Username, Password, Hostname:
sudo ./tools/l4t_create_default_user.sh --accept-license -u <username> -p <password> -a -n <hostname>
Example:
sudo ./tools/l4t_create_default_user.sh --accept-license -u ubuntu -p turing -a -n node4
Garrett Timmer
12/28/2023, 4:14 PMapply_binaries
and l4t_flash_prerequisites.sh
scripts
Edit `/etc/default/nfs-kernel-server
sudo nano /etc/default/nfs-kernel-server
Add --no-nfs-version 4
to RPCMOUNTDOPTS
Result:
RPCMOUNTDOPTS="--manage-gids --no-nfs-version 4"
Garrett Timmer
12/28/2023, 4:14 PMWaiting for target to boot-up
and the flashing of the module will never succeed.
nano tools/kernel_flash/initrd_flash/nv_enable_remote.sh
Press: CTRL + SHIFT + _
This will give you a menu to go to a line.
Enter: 222
The cursor will now be on a empty line between the following to lines, the |
simulates your cursor.
echo "${cfg_str:1}" > "${cfg}/strings/0x409/configuration"
|
echo "${udc_dev}" > UDC
Now on the empty line insert following:
echo on > /sys/bus/usb/devices/usb2/power/control
Result:
echo "${cfg_str:1}" > "${cfg}/strings/0x409/configuration"
echo on > /sys/bus/usb/devices/usb2/power/control
echo "${udc_dev}" > UDC
Save file:
CTRL + X
Press Y
+ EnterGarrett Timmer
12/28/2023, 4:14 PMtpi power off
tpi usb -n {NODE} flash
tpi power -n {NODE} on
Replace {NODE}
with the ID where your Nvidia is.
Check if the device is in recovery mode for flashing:
lsusb
You should now see a device called NVIDIA Corp. APX
This means that you succesfully put the device into flash mode.
Now flash the node, this command will assume that you are flashing to a NVMe device, you are free to add BEFORE
the jetson-*
text the following option --erase-all
this option will erase the NVMe before flashing the new version, this is very handy if you had an old version running.Garrett Timmer
12/28/2023, 4:15 PMsudo ./tools/kernel_flash/l4t_initrd_flash.sh --external-device nvme0n1p1 \
-c tools/kernel_flash/flash_l4t_external.xml -p "-c bootloader/generic/cfg/flash_t234_qspi.xml" \
--showlogs --network usb0 --erase-all jetson-orin-nano-devkit internal
Wait and sit back until flashing is done. You will see for a bout 10 to 15 seconds a Waiting for target to boot-up
this is normal give the module some time to boot during the flash process.Garrett Timmer
12/28/2023, 4:15 PMSSH
sudo shutdown -h now
Login into the BMC and set the module to normal, and boot it up
tpi power -n {NODE} off
tpi usb -n {NODE} device
tpi power -n {NODE} on
It took me an entire day to figure this out, enjoy your Orin NX with Ubuntu 22.04 and latest Jetpack with all its goodies.
Happy HomeLabbing 😋dethtungue
12/28/2023, 6:44 PMGarrett Timmer
12/28/2023, 6:47 PMGarrett Timmer
12/28/2023, 6:50 PMDhanOS
12/28/2023, 6:51 PMDhanOS
12/28/2023, 6:52 PMDhanOS
12/28/2023, 6:52 PMGarrett Timmer
12/28/2023, 6:53 PMDhanOS
12/28/2023, 6:53 PMDhanOS
12/28/2023, 6:54 PMGarrett Timmer
12/28/2023, 6:54 PMDhanOS
12/28/2023, 6:54 PMDhanOS
12/28/2023, 6:55 PMDhanOS
12/28/2023, 6:55 PMDhanOS
12/28/2023, 6:55 PMGarrett Timmer
12/28/2023, 6:58 PMGarrett Timmer
12/28/2023, 6:58 PMDhanOS
12/28/2023, 6:59 PMGarrett Timmer
12/28/2023, 7:00 PMDhanOS
12/28/2023, 7:00 PMDhanOS
12/28/2023, 7:00 PMGarrett Timmer
12/28/2023, 7:01 PMDhanOS
12/28/2023, 7:01 PMGarrett Timmer
12/28/2023, 7:02 PMdethtungue
12/28/2023, 7:04 PMDhanOS
12/28/2023, 7:05 PMa_v_n_c
01/02/2024, 6:09 PMa_v_n_c
01/02/2024, 6:27 PMCarina Akaia 🦊🪐🚀
01/08/2024, 6:23 AMbucarina@katana:~/nvidia/Linux_for_Tegra$ sudo ./tools/kernel_flash/l4t_initrd_flash.sh --external-device nvme0n1p1 \
-c tools/kernel_flash/flash_l4t_external.xml -p "-c bootloader/generic/cfg/flash_t234_qspi.xml" \
--showlogs --network usb0 --erase-all jetson-orin-nano-devkit internal
[sudo] password for bucarina:
/home/bucarina/nvidia/Linux_for_Tegra/tools/kernel_flash/l4t_initrd_flash_internal.sh --no-flash --external-device nvme0n1p1 -c tools/kernel_flash/flash_l4t_external.xml -p -c bootloader/generic/cfg/flash_t234_qspi.xml --showlogs --network usb0 --erase-all jetson-orin-nano-devkit internal
************************************
* *
* Step 1: Generate flash packages *
* *
************************************
Create folder to store images to flash
Generate image for internal storage devices
Generate images to be flashed
ADDITIONAL_DTB_OVERLAY="" /home/bucarina/nvidia/Linux_for_Tegra/flash.sh --no-flash --sign -c bootloader/generic/cfg/flash_t234_qspi.xml jetson-orin-nano-devkit internal
###############################################################################
# L4T BSP Information:
# R36 , REVISION: 2.0
# User release: 0.0
###############################################################################
ECID is
Board ID() version() sku() revision()
Chip SKU(00:00:00:D3) ramcode() fuselevel(fuselevel_production) board_FAB()
emc_opt_disable_fuse:(0)
Error: Unrecognized module SKU
Error: /home/bucarina/nvidia/Linux_for_Tegra/bootloader/signed/flash.idx is not found
Error: failed to relocate images to /home/bucarina/nvidia/Linux_for_Tegra/tools/kernel_flash/images
Cleaning up...
Ubuntu 22.04, bare metal x86_64 machineCarina Akaia 🦊🪐🚀
01/08/2024, 6:24 AMCarina Akaia 🦊🪐🚀
01/08/2024, 6:25 AMGarrett Timmer
01/08/2024, 9:32 AMx86_64
, VM might be a problem, furthermore, I had this too; I solved this my Powering the Node Off and On again, however what I have read from the Nvidia Developers forum, this happens quite a lot when it involves a Virtual Machine, due to the USB not correctly being passed from Host to Guest. Could you try bare metal? Ol machine with Ubuntu?Carina Akaia 🦊🪐🚀
01/08/2024, 11:05 AMlsusb
, thanks 🤔
I'll make one last try with this in mind and get back with the outcome.
P.S. Also I wonder if buying the official carrier board for flashing might solve the issue...Garrett Timmer
01/08/2024, 11:35 AMrpontual.
01/16/2024, 4:28 PMGarrett Timmer
01/16/2024, 9:25 PMrpontual.
01/17/2024, 3:41 PMGarrett Timmer
01/17/2024, 3:42 PMGarrett Timmer
01/17/2024, 3:42 PMGarrett Timmer
01/17/2024, 3:43 PMSSH
sudo shutdown -h now
Login into the BMC and set the module to normal, and boot it up
tpi power -n {NODE} off
tpi usb -n {NODE} device
tpi power -n {NODE} on
It took me an entire day to figure this out, enjoy your Orin NX with Ubuntu 22.04 and latest Jetpack with all its goodies.
Happy HomeLabbing 😋Garrett Timmer
01/17/2024, 3:44 PMGarrett Timmer
01/17/2024, 3:44 PMrpontual.
01/17/2024, 3:45 PMrpontual.
01/17/2024, 3:45 PMGarrett Timmer
01/17/2024, 3:46 PMGarrett Timmer
01/17/2024, 3:46 PMGarrett Timmer
01/17/2024, 3:47 PMGarrett Timmer
01/17/2024, 3:47 PMrpontual.
01/17/2024, 3:47 PMGarrett Timmer
01/17/2024, 3:49 PMGarrett Timmer
01/17/2024, 3:49 PMrpontual.
01/17/2024, 3:51 PMrpontual.
01/17/2024, 3:53 PMmkdir ~/nvidia
cd ~/.nvidia. <===
Garrett Timmer
01/17/2024, 3:53 PMrpontual.
01/17/2024, 3:54 PMGarrett Timmer
01/17/2024, 3:56 PMGarrett Timmer
01/17/2024, 3:56 PMrpontual.
01/17/2024, 4:02 PMsudo apt install -y qemu-user-static nano openssh-server openssh-client bzip2
@User , thank you for the instructions!rpontual.
01/17/2024, 5:33 PMGarrett Timmer
01/17/2024, 5:37 PMGarrett Timmer
01/17/2024, 5:37 PMGarrett Timmer
01/17/2024, 5:38 PMGarrett Timmer
01/17/2024, 5:38 PMrpontual.
01/17/2024, 7:08 PMrpontual.
01/17/2024, 7:56 PMNAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
loop0 7:0 0 63.4M 1 loop /snap/core20/1974
loop1 7:1 0 111.9M 1 loop /snap/lxd/24322
loop2 7:2 0 53.3M 1 loop /snap/snapd/19457
sda 8:0 1 0B 0 disk
sdb 8:16 1 0B 0 disk
sdc 8:32 1 0B 0 disk
sdd 8:48 1 476.9G 0 disk
├─sdd1 8:49 1 475.5G 0 part
├─sdd2 8:50 1 128M 0 part
├─sdd3 8:51 1 768K 0 part
├─sdd4 8:52 1 31.6M 0 part
├─sdd5 8:53 1 128M 0 part
├─sdd6 8:54 1 768K 0 part
├─sdd7 8:55 1 31.6M 0 part
├─sdd8 8:56 1 80M 0 part
├─sdd9 8:57 1 512K 0 part
├─sdd10 8:58 1 64M 0 part
├─sdd11 8:59 1 80M 0 part
├─sdd12 8:60 1 512K 0 part
├─sdd13 8:61 1 64M 0 part
├─sdd14 8:62 1 400M 0 part
└─sdd15 8:63 1 479.5M 0 part
nvme0n1 259:0 0 476.9G 0 disk
├─nvme0n1p1 259:1 0 1G 0 part /boot/efi
├─nvme0n1p2 259:2 0 2G 0 part /boot
└─nvme0n1p3 259:3 0 473.9G 0 part
└─ubuntu--vg-ubuntu--lv 253:0 0 100G 0 lvm /
I am uploading the log file that is saved at the end of the flashing just in case anyone here can help.
https://cdn.discordapp.com/attachments/1189964405715243160/1197268258580091030/flash_1-1_0_20240117-192225.log?ex=65baa5f5&is=65a830f5&hm=7fbe53a6e6a21fd980ef6d491e70143655c0cce24d2e0e3e0f6f7414c5811d91&Garrett Timmer
01/18/2024, 7:14 AMGarrett Timmer
01/18/2024, 7:14 AMGarrett Timmer
01/18/2024, 7:14 AMGarrett Timmer
01/18/2024, 7:15 AMrpontual.
01/18/2024, 7:28 PMGarrett Timmer
01/19/2024, 4:44 AMGarrett Timmer
01/19/2024, 4:44 AMDhanOS
01/19/2024, 4:46 AMGarrett Timmer
01/19/2024, 4:49 AMDhanOS
01/19/2024, 4:50 AMDhanOS
01/19/2024, 4:50 AMDhanOS
01/19/2024, 4:51 AMrpontual.
01/19/2024, 8:17 PMrpontual.
01/19/2024, 9:42 PMgrep -E -i 'error|warning' initrdlog/flash_1-1_0_20240119-210507.log
and got the lines below. Please let me know if you see a clue to the issue. If not please run a similar filter on the log you got when flashing OrinNX for a comparison. Thank you!
[ 0.2654 ] BL: version 1.4.0.1-t234-54845784-08e631ca last_boot_error: 0
Error: The backup GPT table is corrupt, but the primary appears OK, so that will be used.
Warning: Not all of the space available to /dev/nvme0n1 appears to be used, you can fix the GPT to use all of the space (an extra 880677552 blocks) or continue with the current setting?
Warning: Not all of the space available to /dev/nvme0n1 appears to be used, you can fix the GPT to use all of the space (an extra 880677552 blocks) or continue with the current setting?
[ 10]: l4t_flash_from_kernel: Warning: skip writing A_smm-fw partition as no image is specified
(continues...)rpontual.
01/19/2024, 9:42 PM[ 10]: l4t_flash_from_kernel: Warning: skip writing A_smm-fw partition as no image is specified
[ 12]: l4t_flash_from_kernel: Warning: skip writing A_reserved_on_boot partition as no image is specified
[ 20]: l4t_flash_from_kernel: Warning: skip writing B_smm-fw partition as no image is specified
[ 22]: l4t_flash_from_kernel: Warning: skip writing B_reserved_on_boot partition as no image is specified
[ 22]: l4t_flash_from_kernel: Warning: skip writing uefi_variables partition as no image is specified
[ 22]: l4t_flash_from_kernel: Warning: skip writing uefi_ftw partition as no image is specified
[ 22]: l4t_flash_from_kernel: Warning: skip writing reserved partition as no image is specified
[ 22]: l4t_flash_from_kernel: Warning: skip writing worm partition as no image is specified
[ 22]: l4t_flash_from_kernel: Warning: skip writing reserved_partition partition as no image is specified
[ 25]: l4t_flash_from_kernel: Warning: skip writing A_reserved_on_user partition as no image is specified
[ 26]: l4t_flash_from_kernel: Warning: skip writing B_reserved_on_user partition as no image is specified
[ 32]: l4t_flash_from_kernel: Warning: skip writing recovery_alt partition as no image is specified
[ 32]: l4t_flash_from_kernel: Warning: skip writing recovery-dtb_alt partition as no image is specified
[ 32]: l4t_flash_from_kernel: Warning: skip writing esp_alt partition as no image is specified
[ 32]: l4t_flash_from_kernel: Warning: skip writing UDA partition as no image is specified
[ 32]: l4t_flash_from_kernel: Warning: skip writing reserved partition as no image is specified
tar -xpf /mnt/external/system.img --checkpoint=10000 --warning=no-timestamp --numeric-owner --xattrs --xattrs-include=* -C /tmp/ci-G3bDOQzt8U
Garrett Timmer
01/20/2024, 2:39 AMrpontual.
01/20/2024, 3:34 PMGarrett Timmer
01/20/2024, 4:16 PMGarrett Timmer
01/20/2024, 4:16 PMrpontual.
01/20/2024, 5:14 PMrpontual.
01/20/2024, 9:20 PMdethtungue
01/21/2024, 4:46 AMrpontual.
01/21/2024, 12:25 PMapply_binaries
and l4t_flash_prerequisites.sh
scripts
Edit `/etc/default/nfs-kernel-server
sudo nano /etc/default/nfs-kernel-server
Add --no-nfs-version 4
to RPCMOUNTDOPTS
Result:
RPCMOUNTDOPTS="--manage-gids --no-nfs-version 4"
Garrett Timmer
01/22/2024, 1:45 AMrpontual.
01/26/2024, 7:49 PMGarrett Timmer
01/26/2024, 11:13 PMDudo
02/19/2024, 11:35 PMDudo
02/20/2024, 3:32 AMDudo
02/22/2024, 6:01 AMakissocool.
02/22/2024, 7:03 AMakissocool.
02/22/2024, 7:04 AMakissocool.
02/22/2024, 7:06 AMakissocool.
02/22/2024, 7:07 AMashram56
02/22/2024, 9:47 AMashram56
02/22/2024, 9:48 AMashram56
02/22/2024, 9:48 AMashram56
02/22/2024, 1:19 PMashram56
02/22/2024, 1:21 PMashram56
02/22/2024, 2:20 PMashram56
02/22/2024, 3:09 PMakissocool.
02/24/2024, 7:11 PMDudo
02/25/2024, 6:48 PMDudo
02/25/2024, 11:21 PMsudo apt install build-essential bc libssl-dev libncurses-dev pkg-config
wget -O drivers.tbz2 https://developer.nvidia.com/downloads/embedded/l4t/r36_release_v2.0/release/jetson_linux_r36.2.0_aarch64.tbz2
tar -xvpf drivers.tbz2
cd Linux_for_Tegra/source
./source_sync.sh -k -t jetson_36.2
cd kernel/kernel-jammy-src
make nconfig # Enable CONFIG_NET_CLS_BPF kernel feature as module
make modules
sudo make modules_install
# I can't seem to get the -tegra suffix to take. Any ideas?
sudo cp -r /lib/modules/5.15.122/* /lib/modules/5.15.122-tegra/
sudo depmod
DhanOS
03/01/2024, 4:26 PMDhanOS
03/01/2024, 4:27 PMDhanOS
03/01/2024, 4:28 PMDhanOS
03/01/2024, 4:29 PMdevice
and in the BMC firmware v2.x into flashing
mode - this works the same as the jumper on the Nvidia carrier boardsakissocool.
03/04/2024, 7:06 AMDudo
03/05/2024, 1:48 AMDudo
03/05/2024, 6:53 AMDudo
04/22/2024, 5:20 AMDudo
04/22/2024, 5:22 AMSwedeAndSour
05/05/2024, 7:38 AMDan D.
05/05/2024, 6:30 PMSwedeAndSour
05/05/2024, 6:40 PMSwedeAndSour
05/09/2024, 6:37 AMSwedeAndSour
05/09/2024, 6:38 AMIzadien
07/11/2024, 5:16 AMbingi
07/11/2024, 3:08 PMDan D.
07/11/2024, 3:12 PMKirby
07/16/2024, 6:48 PMKirby
08/04/2024, 12:33 PMGarrett Timmer
03/13/2025, 4:37 PMSwedeAndSour
03/13/2025, 6:15 PM