Giter Club home page Giter Club logo

nanopi-m4-ubuntu-base-minimal's Introduction

nanopi-m4-ubuntu-base-minimal

Ubuntu 18.04 / 20.04 base minimal image for RK3399 with camera support (NanoPi M4 v1 - 2GB / 4 GB)

OS Image for development with the following tidbits:

  • Kernel 4.4.y (with the best of both world, rockchip bsp kernel + kernel.org 4.4.y)
  • Gbps
  • Wifi
  • Bluetooth
  • 3D mali gpu (fbdev / gbm / x11)
  • VPU (GBM / X11 / lxde)
  • camera (WiP)

OS Image

BSP Kernel 4.4

Mainline Kernel 5.x

Ubuntu 19.10 - EOAN Ermine

Status of the Mainline Kernel 5.4.y

Fixing Wifi on Mainline Kernel

Status of the Mainline Kernel 5.7.y

BSP Kernel 4.19

Mainline u-boot

Mainline Kernel 5.9

Mainline Kernel 5.10

Camera experiments with Kernel 4.19

Camera experiments with Kernel 5.10

Screenshot comparison - OV13850 / OV4689

Dual-camera with Kernel 4.19.y

Dual camera with Mainline Kernel 5.11.0

Mainline u-boot

Here we are going to fix the reboot issue i had with my u-boot Android like build. We are going to build the latest u-boot on NanoPi M4 (2GB) running from SD CARD.

  • Install dependencies

      sudo apt-get install device-tree-compiler python3-dev python3-distutils swig
  sudo apt-get install gcc-arm-none-eabi

  • Build u-boot

      mkdir u-boot
  cd u-boot/
  git clone https://github.com/ARM-software/arm-trusted-firmware 
  cd arm-trusted-firmware/
  make PLAT=rk3399 DEBUG=0 bl31
  cd ..
  export BL31=$PWD/arm-trusted-firmware/build/rk3399/release/bl31/bl31.elf
  git clone https://gitlab.denx.de/u-boot/u-boot.git
  make -C u-boot distclean
  make -C u-boot nanopi-m4-2gb-rk3399_defconfig
  make -C u-boot

  • install

      sudo dd if=u-boot/idbloader.img of=/dev/mmcblk1 seek=64
  sudo dd if=u-boot/u-boot.itb of=/dev/mmcblk1 seek=16384

  • reboot

      sync && sudo reboot

Mainline Kernel 5.10

Testing and Benchmarking 5.10 RC (WiP) in Ubuntu 20.04 LTS Simple benchmarks in progress for the nanoPi M4 2G (DDR3).

SBC Dev Board tested NanoPi M4
kernel version 5.10.0-rc3
gcc version 10
display hdmi
graphical interface CLI
idle Temp ºC / freq 25 ºC / 408 Mhz
full Temp ºC / freq 55 ºC / 1.5 GHz - 2.0 GHz
RAM memory usage (avg) 97 Mbytes
i2c
spi
hdmi sound out
rt5651
spdif
Camera
Wifi
BT BCM4356A2
ethernet Gbps
sound hdmi-sound and Bluetooth
gpu panfrost
vpu
DVFS
------------------------ ------------------------------

  • Kernel 5.10.0-rc3

    • hdmi
    • hdmi sound
    • analog sound
    • Wifi
    • BT
    • Mainline u-boot
    • reboot (ok)
    • shutdown (ok)
    • gpu panfrost
    • vpu hantro

Building Vanilla Kernel natively on NanoPi M4 with gcc 10.2.0

  • Build your kernel

    cd kernel
export KVD=$PWD
make nanopim4_full_defconfig
make oldconfig
make -j6 INSTALL_MOD_PATH=output Image 
make -j6 INSTALL_MOD_PATH=output dtbs
make -j6 INSTALL_MOD_PATH=output modules
make -j6 INSTALL_MOD_PATH=output modules_install
export KV="5.10.0-rc3"
make -j6 INSTALL_HDR_PATH=output/usr/src/linux-headers-${KV} headers_install

  • Install your kernel

    sudo cp -fv ./arch/arm64/boot/Image /boot/Image_${KV}
sudo cp -vf ./arch/arm64/boot/dts/rockchip/rk3399-nanopi-m4.dtb /boot/rk3399-nanopi-m4.dtb_${KV}
sudo cp -vfr ./output/usr/* /usr/
sudo cp -vfr ./output/lib/* /usr/lib

  • Make it current kernel

    cd /boot
sudo ln -sf Image_${KV} Image
sudo ln -sf rk3399-nanopi-m4.dtb_${KV} dtb
cd ${KVD}
sync

  • Reboot

    sync && sudo reboot

Building mainline kernel

The kernel 5.10.0-rc3

  • Testing the kernel 5.10 RC (WIP)

    • GPU

      Testing the panfrost with GBM (OpenGLES2)

    • VPU

      Very simple tests

    • Wifi

      Testing Wifi with iperf3

      • 2.4 GHz

          ./iperf3 -c 192.168.254.49
  Connecting to host 192.168.254.49, port 5201
  [  5] local 192.168.254.253 port 33722 connected to 192.168.254.49 port 5201
  [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
  [  5]   0.00-1.00   sec  11.7 MBytes  98.4 Mbits/sec    8   66.5 KBytes       
  [  5]   1.00-2.00   sec  11.2 MBytes  93.6 Mbits/sec    5   83.4 KBytes       
  [  5]   2.00-3.00   sec  11.2 MBytes  94.1 Mbits/sec    7   69.3 KBytes       
  [  5]   3.00-4.00   sec  11.2 MBytes  93.6 Mbits/sec    3   83.4 KBytes       
  [  5]   4.00-5.00   sec  11.4 MBytes  95.6 Mbits/sec    6   83.4 KBytes       
  [  5]   5.00-6.00   sec  11.2 MBytes  93.6 Mbits/sec    7   84.8 KBytes       
  [  5]   6.00-7.00   sec  11.2 MBytes  94.1 Mbits/sec    7   67.9 KBytes       
  [  5]   7.00-8.00   sec  11.2 MBytes  94.1 Mbits/sec    4   83.4 KBytes       
  [  5]   8.00-9.00   sec  11.2 MBytes  93.6 Mbits/sec    7   52.3 KBytes       
  [  5]   9.00-10.00  sec  11.2 MBytes  93.6 Mbits/sec    5   69.3 KBytes       
  - - - - - - - - - - - - - - - - - - - - - - - - -
  [ ID] Interval           Transfer     Bitrate         Retr
  [  5]   0.00-10.00  sec   113 MBytes  94.5 Mbits/sec   59             sender
  [  5]   0.00-10.01  sec   112 MBytes  94.1 Mbits/sec                  receiver

      • 5 GHz

          ./iperf3 -c 192.168.254.49
  Connecting to host 192.168.254.49, port 5201
  [  5] local 192.168.254.253 port 33958 connected to 192.168.254.49 port 5201
  [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
  [  5]   0.00-1.00   sec  23.0 MBytes   193 Mbits/sec   10    197 KBytes       
  [  5]   1.00-2.00   sec  19.2 MBytes   161 Mbits/sec    0    260 KBytes       
  [  5]   2.00-3.00   sec  22.1 MBytes   186 Mbits/sec   24    304 KBytes       
  [  5]   3.00-4.00   sec  22.4 MBytes   188 Mbits/sec    0    354 KBytes       
  [  5]   4.00-5.00   sec  22.6 MBytes   190 Mbits/sec    5    396 KBytes       
  [  5]   5.00-6.00   sec  24.1 MBytes   202 Mbits/sec    0    437 KBytes       
  [  5]   6.00-7.00   sec  22.8 MBytes   191 Mbits/sec    9    355 KBytes       
  [  5]   7.00-8.00   sec  22.9 MBytes   192 Mbits/sec   14    393 KBytes       
  [  5]   8.00-9.00   sec  23.5 MBytes   197 Mbits/sec   15    433 KBytes       
  [  5]   9.00-10.00  sec  23.3 MBytes   196 Mbits/sec    0    469 KBytes       
  - - - - - - - - - - - - - - - - - - - - - - - - -
  [ ID] Interval           Transfer     Bitrate         Retr
  [  5]   0.00-10.00  sec   226 MBytes   190 Mbits/sec   77             sender
  [  5]   0.00-10.01  sec   224 MBytes   188 Mbits/sec                  receiver

    • RTL8211E Gigabit Ethernet

      Testing Eth0 with iperf3

      • 100 Mbit

          ./iperf3 -c 192.168.254.69
  Connecting to host 192.168.254.69, port 5201
  [  5] local 192.168.254.253 port 46714 connected to 192.168.254.69 port 5201
  [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
  [  5]   0.00-1.00   sec  11.7 MBytes  98.2 Mbits/sec    9   46.7 KBytes       
  [  5]   1.00-2.00   sec  11.2 MBytes  93.6 Mbits/sec    6   69.3 KBytes       
  [  5]   2.00-3.00   sec  11.4 MBytes  95.6 Mbits/sec    7   50.9 KBytes       
  [  5]   3.00-4.00   sec  11.2 MBytes  94.1 Mbits/sec    5   69.3 KBytes       
  [  5]   4.00-5.00   sec  11.2 MBytes  93.7 Mbits/sec    6   83.4 KBytes       
  [  5]   5.00-6.00   sec  11.3 MBytes  94.6 Mbits/sec    6   70.7 KBytes       
  [  5]   6.00-7.00   sec  11.2 MBytes  93.6 Mbits/sec    6   86.3 KBytes       
  [  5]   7.00-8.00   sec  11.2 MBytes  93.6 Mbits/sec    6   69.3 KBytes       
  [  5]   8.00-9.00   sec  11.2 MBytes  93.6 Mbits/sec    6   83.4 KBytes       
  [  5]   9.00-10.00  sec  11.4 MBytes  95.6 Mbits/sec    7   86.3 KBytes       
  - - - - - - - - - - - - - - - - - - - - - - - - -
  [ ID] Interval           Transfer     Bitrate         Retr
  [  5]   0.00-10.00  sec   113 MBytes  94.6 Mbits/sec   64             sender
  [  5]   0.00-10.01  sec   112 MBytes  94.1 Mbits/sec                  receiver

      • 1 Gbit

        Having problems with rgmii and rgmii-id to get IP from the router. Possibly wrong configuration. NanoPi M4 Board acts strange when can't get tthe IP

          ./iperf3 -c 192.168.254.70
  Connecting to host 192.168.254.70, port 5201
  [  5] local 192.168.254.253 port 45954 connected to 192.168.254.70 port 5201
  [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
  [  5]   0.00-1.00   sec   114 MBytes   955 Mbits/sec    0    342 KBytes       
  [  5]   1.00-2.00   sec   112 MBytes   939 Mbits/sec    0    342 KBytes       
  [  5]   2.00-3.00   sec   112 MBytes   939 Mbits/sec    0    356 KBytes       
  [  5]   3.00-4.00   sec   113 MBytes   946 Mbits/sec    0    356 KBytes       
  [  5]   4.00-5.00   sec   112 MBytes   941 Mbits/sec    0    356 KBytes       
  [  5]   5.00-6.00   sec   112 MBytes   941 Mbits/sec    0    356 KBytes       
  [  5]   6.00-7.00   sec   112 MBytes   938 Mbits/sec    0    356 KBytes       
  [  5]   7.00-8.00   sec   112 MBytes   943 Mbits/sec    0    356 KBytes       
  [  5]   8.00-9.00   sec   112 MBytes   939 Mbits/sec    0    356 KBytes       
  [  5]   9.00-10.00  sec   112 MBytes   942 Mbits/sec    0    356 KBytes       
  - - - - - - - - - - - - - - - - - - - - - - - - -
  [ ID] Interval           Transfer     Bitrate         Retr
  [  5]   0.00-10.00  sec  1.10 GBytes   942 Mbits/sec    0             sender
  [  5]   0.00-10.01  sec  1.10 GBytes   940 Mbits/sec                  receiver

        Revrese

          ./iperf3 -c 192.168.254.70 -R
  Connecting to host 192.168.254.70, port 5201
  Reverse mode, remote host 192.168.254.70 is sending
  [  5] local 192.168.254.253 port 45902 connected to 192.168.254.70 port 5201
  [ ID] Interval           Transfer     Bitrate
  [  5]   0.00-1.00   sec   111 MBytes   931 Mbits/sec                  
  [  5]   1.00-2.00   sec   112 MBytes   941 Mbits/sec                  
  [  5]   2.00-3.00   sec   112 MBytes   940 Mbits/sec                  
  [  5]   3.00-4.00   sec   112 MBytes   941 Mbits/sec                  
  [  5]   4.00-5.00   sec   112 MBytes   940 Mbits/sec                  
  [  5]   5.00-6.00   sec   112 MBytes   941 Mbits/sec                  
  [  5]   6.00-7.00   sec   112 MBytes   941 Mbits/sec                  
  [  5]   7.00-8.00   sec   112 MBytes   941 Mbits/sec                  
  [  5]   8.00-9.00   sec   112 MBytes   941 Mbits/sec                  
  [  5]   9.00-10.00  sec   112 MBytes   936 Mbits/sec                  
  - - - - - - - - - - - - - - - - - - - - - - - - -
  [ ID] Interval           Transfer     Bitrate         Retr
  [  5]   0.00-10.00  sec  1.10 GBytes   942 Mbits/sec   58             sender
  [  5]   0.00-10.00  sec  1.09 GBytes   940 Mbits/sec                  receiver

    • Bluetooth

      Testing conectivity with some hardware.

    • HDMI sound

      Testing sound output to HDMI.

    • Headphone jack sound

      Testing sound output to jack.

    • 7z b

      7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE)

LE
CPU Freq: - 64000000 - - - 256000000 - - 2048000000

RAM size:    1922 MB,  # CPU hardware threads:   6
RAM usage:   1323 MB,  # Benchmark threads:      6

		       Compressing  |                  Decompressing
Dict     Speed Usage    R/U Rating  |      Speed Usage    R/U Rating
	 KiB/s     %   MIPS   MIPS  |      KiB/s     %   MIPS   MIPS

22:       6248   524   1161   6078  |     102582   519   1685   8748
23:       6323   552   1167   6443  |     100510   519   1676   8697
24:       6027   527   1231   6481  |      98711   518   1671   8664
25:       5856   514   1301   6687  |      97221   519   1666   8652
----------------------------------  | ------------------------------
Avr:             529   1215   6422  |              519   1675   8690
Tot:             524   1445   7556

Mainline Kernel 5.9

SBC Dev Board tested NanoPi M4
kernel version 5.9
gcc version 10
display hdmi
graphical interface CLI
idle Temp ºC / freq 25 ºC / 408 Mhz
full Temp ºC / freq 55 ºC / 1.5 GHz - 2.0 GHz
RAM memory usage (avg) 92 Mbytes
i2c yes
spi
hdmi sound out yes
rt5651 yes
spdif
Camera
Wifi yes
BT yes
ethernet Gbps
sound hdmi-sound and Bluetooth
gpu panfrost
vpu wip
DVFS yes
------------------------ ------------------------------

  • Kernel 5.9.0

    OS Image file (8GB): https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.41

    • hdmi
    • hdmi sound
    • analog sound
    • Wifi
    • BT
    • Mainline u-boot
    • reboot (ok)
    • shutdown (ok)
    • gpu panfrost
    • vpu hantro

  • Kernel 5.9.0-rc7

    Kernel 5.9.0-rc7 with working:

    • hdmi
    • hdmi sound
    • analog sound
    • Wifi
    • BT
    • Mainline u-boot
    • reboot (ok)
    • shutdown (ok)
    • gpu panfrost
    • vpu hantro

    Boot log: https://gist.github.com/avafinger/ba6af660751c3e2917868bb3060beb13

    7z b

    htop 2.2.2-8

    The OS Image file for 2GB DRAM and 4 GB DRAM: Image file: https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.40

    The OS Image file with mainline u-boot for 2GB DRAM only: Image file: https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.39

  • Kernel 5.9.0-rc6

    The OS Image file will be here: Image file: https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.38

      ubuntu@nanopi-m4:~$ uname -ra
  Linux nanopi-m4 5.9.0-rc6 #1 SMP PREEMPT Sat Sep 26 19:07:46 -03 2020 aarch64 aarch64 aarch64 GNU/Linux

  ubuntu@nanopi-m4:/$ gcc --version
  gcc (Ubuntu 10-20200411-0ubuntu1) 10.0.1 20200411 (experimental) [master revision bb87d5cc77d:75961caccb7:f883c46b4877f637e0fa5025b4d6b5c9040ec566]
  Copyright (C) 2020 Free Software Foundation, Inc.
  This is free software; see the source for copying conditions.  There is NO
  warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.


  ubuntu@nanopi-m4:~$ 7z b

  7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
  p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE)

  LE
  CPU Freq: - - - - - - - - -

  RAM size:    1924 MB,  # CPU hardware threads:   6
  RAM usage:   1323 MB,  # Benchmark threads:      6

  		       Compressing  |                  Decompressing
  Dict     Speed Usage    R/U Rating  |      Speed Usage    R/U Rating
  	 KiB/s     %   MIPS   MIPS  |      KiB/s     %   MIPS   MIPS

  22:       6511   550   1151   6335  |     102629   519   1687   8752
  23:       6050   513   1202   6165  |     100584   519   1677   8703
  24:       5864   505   1248   6306  |      98898   522   1663   8680
  25:       6128   544   1286   6997  |      96949   519   1662   8628
  ----------------------------------  | ------------------------------
  Avr:             528   1222   6451  |              520   1672   8691
  Tot:             524   1447   7571

  ubuntu@nanopi-m4:~$ sudo ifconfig -a wlan0
  wlan0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
  	inet 192.168.254.49  netmask 255.255.0.0  broadcast 192.168.255.255
  	inet6 fe80::ce4b:73ff:fe23:d432  prefixlen 64  scopeid 0x20<link>
  	ether cc:4b:73:23:d4:32  txqueuelen 1000  (Ethernet)
  	RX packets 11530  bytes 15347454 (15.3 MB)
  	RX errors 0  dropped 0  overruns 0  frame 0
  	TX packets 5520  bytes 647408 (647.4 KB)
  	TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

  ubuntu@nanopi-m4:~$ iw wlan0 info
  Interface wlan0
  	ifindex 3
  	wdev 0x1
  	addr cc:4b:73:23:d4:32
  	ssid FIB-8784-5G
  	type managed
  	wiphy 0
  	channel 149 (5745 MHz), width: 80 MHz, center1: 5775 MHz
  	txpower 31.00 dBm

  ubuntu@nanopi-m4:~$ sudo iw dev wlan0 scan | egrep "signal:|SSID:" | sed -e "s/\tsignal: //" -e "s/\tSSID: //" | awk '{ORS = (NR % 2 == 0)? "\n" : " "; print}' | sort
  -43.00 dBm FIB-8784-5G
  -44.00 dBm FIB-8784
  -51.00 dBm FIB-8784
  -59.00 dBm foxy

  ubuntu@nanopi-m4:~$ hcitool dev
  Devices:
  	hci0	CC:4B:73:23:D4:33
  ubuntu@nanopi-m4:~$ 

  ubuntu@nanopi-m4:~$ cat /proc/asound/cards
   0 [realtekrt5651co]: realtek_rt5651- - realtek,rt5651-codec
  		      realtek,rt5651-codec
   1 [ROCKCHIPSPDIF  ]: ROCKCHIP_SPDIF - ROCKCHIP,SPDIF
  		      ROCKCHIP,SPDIF
   2 [hdmisound      ]: hdmi-sound - hdmi-sound
  		      hdmi-sound

Benchmarks 5.7.9-rkdec

Benchmarks with u-boot mainline and the board with nice cooler, a heatsink and ceramic, just for fun.

buntu@nanopi-m4:~$ 7z b

7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE)

LE
CPU Freq: - - - - - - - - -

RAM size:    1924 MB,  # CPU hardware threads:   6
RAM usage:   1323 MB,  # Benchmark threads:      6

		       Compressing  |                  Decompressing
Dict     Speed Usage    R/U Rating  |      Speed Usage    R/U Rating
	 KiB/s     %   MIPS   MIPS  |      KiB/s     %   MIPS   MIPS

22:       6338   530   1164   6166  |     102348   519   1682   8728
23:       5901   501   1200   6013  |     100372   518   1677   8685
24:       6377   565   1214   6857  |      98519   518   1668   8647
25:       6299   560   1285   7193  |      97049   518   1666   8637
----------------------------------  | ------------------------------
Avr:             539   1216   6557  |              518   1673   8674
Tot:             529   1445   7616

ubuntu@nanopi-m4:~$ openssl speed sha256 aes-128-cbc aes-256-cbc rsa2048
Doing sha256 for 3s on 16 size blocks: 19452925 sha256's in 3.00s
Doing sha256 for 3s on 64 size blocks: 13864911 sha256's in 3.00s
Doing sha256 for 3s on 256 size blocks: 7367936 sha256's in 2.99s
Doing sha256 for 3s on 1024 size blocks: 2553850 sha256's in 3.00s
Doing sha256 for 3s on 8192 size blocks: 359438 sha256's in 3.00s
Doing sha256 for 3s on 16384 size blocks: 180700 sha256's in 2.99s
Doing aes-128 cbc for 3s on 16 size blocks: 14735693 aes-128 cbc's in 3.00s
Doing aes-128 cbc for 3s on 64 size blocks: 4431648 aes-128 cbc's in 3.00s
Doing aes-128 cbc for 3s on 256 size blocks: 1164991 aes-128 cbc's in 3.00s
Doing aes-128 cbc for 3s on 1024 size blocks: 296218 aes-128 cbc's in 2.99s
Doing aes-128 cbc for 3s on 8192 size blocks: 37173 aes-128 cbc's in 3.00s
Doing aes-128 cbc for 3s on 16384 size blocks: 18591 aes-128 cbc's in 3.00s
Doing aes-256 cbc for 3s on 16 size blocks: 11725626 aes-256 cbc's in 2.99s
Doing aes-256 cbc for 3s on 64 size blocks: 3385548 aes-256 cbc's in 3.00s
Doing aes-256 cbc for 3s on 256 size blocks: 879341 aes-256 cbc's in 3.00s
Doing aes-256 cbc for 3s on 1024 size blocks: 222662 aes-256 cbc's in 3.00s
Doing aes-256 cbc for 3s on 8192 size blocks: 27923 aes-256 cbc's in 2.99s
Doing aes-256 cbc for 3s on 16384 size blocks: 13956 aes-256 cbc's in 3.00s
Doing 2048 bits private rsa's for 10s: 2222 2048 bits private RSA's in 9.98s
Doing 2048 bits public rsa's for 10s: 83572 2048 bits public RSA's in 9.99s
OpenSSL 1.1.1c  28 May 2019
built on: Wed May 27 19:04:47 2020 UTC
options:bn(64,64) rc4(char) des(int) aes(partial) blowfish(ptr) 
compiler: gcc -fPIC -pthread -Wa,--noexecstack -Wall -Wa,--noexecstack -g -O2 -fdebug-prefix-map=/build/openssl-KZTQCo/openssl-1.1.1c=. -fstack-protector-strong -Wformat -Werror=format-security -DOPENSSL_USE_NODELETE -DOPENSSL_PIC -DOPENSSL_CPUID_OBJ -DOPENSSL_BN_ASM_MONT -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DKECCAK1600_ASM -DVPAES_ASM -DECP_NISTZ256_ASM -DPOLY1305_ASM -DNDEBUG -Wdate-time -D_FORTIFY_SOURCE=2
The 'numbers' are in 1000s of bytes per second processed.
type             16 bytes     64 bytes    256 bytes   1024 bytes   8192 bytes  16384 bytes
aes-128 cbc      78590.36k    94541.82k    99412.57k   101447.23k   101507.07k   101531.65k
aes-256 cbc      62745.82k    72225.02k    75037.10k    76001.96k    76503.42k    76218.37k
sha256          103748.93k   295784.77k   630833.32k   871714.13k   981505.37k   990163.48k
		  sign    verify    sign/s verify/s
rsa 2048 bits 0.004491s 0.000120s    222.6   8365.6

BSP Kernel 4.19

Experiments with Kernel 4.19

  • Boot log (kernel 4.19.111)

https://gist.github.com/avafinger/64085a755c717db2263aaa64c9aa91c2

SBC Dev Board tested NanoPi M4
kernel version 4.19.111
gcc version 7.5.0
display hdmi
graphical interface CLI
idle Temp ºC / freq 25 ºC / 408 Mhz
full Temp ºC / freq 55 ºC / 1.4 GHz - 1.8 GHz
RAM memory usage (avg) 71 Mbytes
i2c yes
spi
hdmi sound out yes
rt5651 yes
spdif
Camera
Wifi yes (?)
BT yes
ethernet Gbps / 100Mbps
sound hdmi-sound and Bluetooth
gpu mali T860
vpu
DVFS yes
------------------------ ------------------------------

Kodi GPU (hw accel)

Kodi gpu

Kodi kernel

Mainline 5.7.y status

SBC Dev Board tested NanoPi M4
kernel version 5.7.9
gcc version 9.2.1
display hdmi
graphical interface CLI
idle Temp ºC / freq 33 ºC / 408 Mhz
full Temp ºC / freq 55 ºC / 1.20 GHz - 1.99 GHz
RAM memory usage (avg) 101 Mbytes
i2c yes
spi
hdmi sound out yes
rt5651 yes
spdif yes (need someone to test)
Camera
Wifi yes (new firmware)
BT yes
ethernet Gbps / 100Mbps
sound hdmi-sound and Bluetooth
gpu panfrost
vpu yes (common formats)
DVFS yes
------------------------ ------------------------------

(*) Problems / Issues

  • Reboot

Kodi mainline kernel 5.7.9

You can build Kodi for mainline with current kernel using the same instructions used in the kernel 4.4 but you get limited decoding capabilities. Support basic video codecs.

To build Kodi with your own kernel version you will need:

  • Latest kernel with V4L2 / VPU patches and Panfrost enabled
  • FFmpeg with patches from Kwiboo / jernejsk
  • Build Mesa

Kodi Panfrost

Kodi Mainline

Mainline Kernel 5.7.9

This is the Image file for booting from SD CARD for NanoPi M4 v1 (2G), with pre-built Kernel 5.7.9. The Ubuntu EOAN 19.10 OS Image has the following working:

  • DVFS
  • panfrost
  • eth0
  • wlan0
  • rt5651
  • BT
  • spdif (?)
  • i2c
  • hdmi
  • hdmi-sound
  • GBM / DRM
  • GPU / VPU

This Image is not to be used with NanoPi M4 v2 and possibly with 4GB DRAM. Image file: https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.36

  • Kernel

      Linux nanopi-m4 5.7.9 #1 SMP PREEMPT Sat Jul 18 18:14:35 -03 2020 aarch64 aarch64 aarch64 GNU/Linux

  • Finding sound device

      aplay -l
  **** List of PLAYBACK Hardware Devices ****
  card 0: realtekrt5651co [realtek,rt5651-codec], device 0: ff890000.i2s-rt5651-aif1 rt5651-aif1-0 [ff890000.i2s-rt5651-aif1 rt5651-aif1-0]
    Subdevices: 1/1
    Subdevice #0: subdevice #0
  card 1: ROCKCHIPSPDIF [ROCKCHIP,SPDIF], device 0: ff870000.spdif-dit-hifi dit-hifi-0 [ff870000.spdif-dit-hifi dit-hifi-0]
    Subdevices: 1/1
    Subdevice #0: subdevice #0
  card 2: hdmisound [hdmi-sound], device 0: ff8a0000.i2s-i2s-hifi i2s-hifi-0 [ff8a0000.i2s-i2s-hifi i2s-hifi-0]
    Subdevices: 1/1
    Subdevice #0: subdevice #0

  • Play sound (HDMI output)

    		aplay -D sysdefault:CARD=2 /usr/share/sounds/alsa/Front_Right.wav

    or

      AUDIODEV=hw:2,0 play ff-16b-2c-44100hz.mp3
  play WARN alsa: can't encode 0-bit Unknown or not applicable

  ff-16b-2c-44100hz.mp3:

   File Size: 2.99M     Bit Rate: 128k
    Encoding: MPEG audio    Info: 2016-04-12
    Channels: 2 @ 16-bit   
  Samplerate: 44100Hz      
  Replaygain: off         
    Duration: 00:03:07.12  

  In:25.2% 00:00:47.18 [00:02:19.93] Out:2.08M [-=====|=====-] Hd:1.0 Clip:0

  • Play sound rt5651 (Jack)

      AUDIODEV=hw:0,0 play ff-16b-2c-44100hz.mp3 
  play WARN alsa: can't encode 0-bit Unknown or not applicable

  ff-16b-2c-44100hz.mp3:

   File Size: 2.99M     Bit Rate: 128k
    Encoding: MPEG audio    Info: 2016-04-12
    Channels: 2 @ 16-bit   
  Samplerate: 44100Hz      
  Replaygain: off         
    Duration: 00:03:07.12  

  In:100%  00:03:07.12 [00:00:00.00] Out:8.25M [      |      ]        Clip:14   
  play WARN sox: `alsa' output clipped 14 samples; decrease volume?
  Done.

  • Bluetooth

      hcitool dev
  Devices:
  hci0	CC:4B:73:23:D4:33

  • Ethernet and Wlan interfaces

      ifconfig
  eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
          inet 192.168.254.42  netmask 255.255.0.0  broadcast 192.168.255.255
          inet6 2804:7f4:3582:cf22:3835:48ff:fe87:d8e2  prefixlen 64  scopeid 0x0<global>
          inet6 fe80::3835:48ff:fe87:d8e2  prefixlen 64  scopeid 0x20<link>
          inet6 2804:7f4:3582:cf22:b4a6:8573:441a:ec4a  prefixlen 64  scopeid 0x0<global>
          ether 3a:35:48:87:d8:e2  txqueuelen 1000  (Ethernet)
          RX packets 8478  bytes 674293 (674.2 KB)
          RX errors 0  dropped 0  overruns 0  frame 0
          TX packets 6468  bytes 1331171 (1.3 MB)
          TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
          device interrupt 27  
  
  lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
          inet 127.0.0.1  netmask 255.0.0.0
          inet6 ::1  prefixlen 128  scopeid 0x10<host>
          loop  txqueuelen 1000  (Local Loopback)
          RX packets 0  bytes 0 (0.0 B)
          RX errors 0  dropped 0  overruns 0  frame 0
          TX packets 0  bytes 0 (0.0 B)
          TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
  
  wlan0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
          inet 192.168.254.102  netmask 255.255.0.0  broadcast 192.168.255.255
          inet6 2804:7f4:3582:cf22:b5fe:bcdb:1728:273a  prefixlen 64  scopeid 0x0<global>
          inet6 fe80::ce4b:73ff:fe23:d432  prefixlen 64  scopeid 0x20<link>
          inet6 2804:7f4:3582:cf22:ce4b:73ff:fe23:d432  prefixlen 64  scopeid 0x0<global>
          ether cc:4b:73:23:d4:32  txqueuelen 1000  (Ethernet)
          RX packets 1810  bytes 185266 (185.2 KB)
          RX errors 0  dropped 0  overruns 0  frame 0
          TX packets 663  bytes 88989 (88.9 KB)
          TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

  • testing VPU (decoding and displaying video on fb)

      ffmpeg -hwaccel drm -i Jellyfish_1080_10s_30MB.mp4 -pix_fmt bgra -f fbdev /dev/fb0
  ffmpeg version 4.2.2-Matrix-Alpha1-26-g6029b361f2-Kodi Copyright (c) 2000-2019 the FFmpeg developers
    built with gcc 9 (Ubuntu 9.2.1-9ubuntu2)
    configuration: --prefix=/usr --enable-nonfree --enable-gpl --enable-version3 --enable-libmp3lame --enable-libpulse --enable-libv4l2 --enable-v4l2-request --enable-v4l2-m2m --enable-libudev --enable-libdrm --enable-shared
    libavutil      56. 31.100 / 56. 31.100
    libavcodec     58. 54.100 / 58. 54.100
    libavformat    58. 29.100 / 58. 29.100
    libavdevice    58.  8.100 / 58.  8.100
    libavfilter     7. 57.100 /  7. 57.100
    libswscale      5.  5.100 /  5.  5.100
    libswresample   3.  5.100 /  3.  5.100
    libpostproc    55.  5.100 / 55.  5.100
  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'Jellyfish_1080_10s_30MB.mp4':
    Metadata:
      major_brand     : isom
      minor_version   : 512
      compatible_brands: isomiso2avc1mp41
      encoder         : Lavf57.63.100
    Duration: 00:00:10.00, start: 0.000000, bitrate: 25030 kb/s
      Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], 25026 kb/s, 30 fps, 30 tbr, 15360 tbn, 60 tbc (default)
      Metadata:
        handler_name    : VideoHandler
  Stream mapping:
    Stream #0:0 -> #0:0 (h264 (native) -> rawvideo (native))
  Press [q] to stop, [?] for help
  [h264 @ 0xaaaad4f4f320] v4l2_request_try_format: pixelformat 875967059 not supported for type 10
  [h264 @ 0xaaaad4f4f320] v4l2_request_probe_video_device: try output format failed
  Output #0, fbdev, to '/dev/fb0':
    Metadata:
      major_brand     : isom
      minor_version   : 512
      compatible_brands: isomiso2avc1mp41
      encoder         : Lavf58.29.100
      Stream #0:0(und): Video: rawvideo (BGRA / 0x41524742), bgra, 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 1990656 kb/s, 30 fps, 30 tbn, 30 tbc (default)
      Metadata:
        handler_name    : VideoHandler
        encoder         : Lavc58.54.100 rawvideo
  frame=  300 fps= 56 q=-0.0 Lsize=N/A time=00:00:10.00 bitrate=N/A speed=1.88x    
  video:2430000kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown

Mainline Kernel 5.7.1

Bootlog: https://gist.github.com/avafinger/54a1d590308215a37e437d1a93033c15

Support for:

  • DVFS
  • GPU / VPU
  • Wifi
  • Eth
  • BT
  • hdmi
  • hdmi-sound
  • rt5651 (jack)
  • spdif (?)

Basic Benchmark

  • 7z b

      7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
  p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE)

  LE
  CPU Freq: - - - - - - 512000000 - -

  RAM size:    1924 MB,  # CPU hardware threads:   6
  RAM usage:   1323 MB,  # Benchmark threads:      6

  		       Compressing  |                  Decompressing
  Dict     Speed Usage    R/U Rating  |      Speed Usage    R/U Rating
  	 KiB/s     %   MIPS   MIPS  |      KiB/s     %   MIPS   MIPS

  22:       5692   502   1102   5538  |      98576   504   1668   8407
  23:       4857   431   1147   4949  |      96575   504   1658   8357
  24:       4589   431   1144   4935  |      94597   503   1650   8303
  25:       5601   527   1213   6396  |      93156   505   1643   8290
  ----------------------------------  | ------------------------------
  Avr:             473   1152   5454  |              504   1654   8339
  Tot:             489   1403   6897

  • openssl speed sha256 aes-128-cbc rsa2048

      Doing sha256 for 3s on 16 size blocks: 9658979 sha256's in 2.99s
  Doing sha256 for 3s on 64 size blocks: 7291386 sha256's in 3.00s
  Doing sha256 for 3s on 256 size blocks: 4299091 sha256's in 2.99s
  Doing sha256 for 3s on 1024 size blocks: 1621935 sha256's in 3.00s
  Doing sha256 for 3s on 8192 size blocks: 238842 sha256's in 2.99s
  Doing sha256 for 3s on 16384 size blocks: 120378 sha256's in 2.99s
  Doing aes-128 cbc for 3s on 16 size blocks: 10267243 aes-128 cbc's in 3.00s
  Doing aes-128 cbc for 3s on 64 size blocks: 2790474 aes-128 cbc's in 2.99s
  Doing aes-128 cbc for 3s on 256 size blocks: 718036 aes-128 cbc's in 3.00s
  Doing aes-128 cbc for 3s on 1024 size blocks: 180829 aes-128 cbc's in 2.99s
  Doing aes-128 cbc for 3s on 8192 size blocks: 22646 aes-128 cbc's in 3.00s
  Doing aes-128 cbc for 3s on 16384 size blocks: 11302 aes-128 cbc's in 2.99s
  Doing 2048 bits private rsa's for 10s: 1400 2048 bits private RSA's in 9.98s
  Doing 2048 bits public rsa's for 10s: 52169 2048 bits public RSA's in 9.98s
  OpenSSL 1.1.1c  28 May 2019
  built on: Wed May 27 19:04:47 2020 UTC
  options:bn(64,64) rc4(char) des(int) aes(partial) blowfish(ptr) 
  compiler: gcc -fPIC -pthread -Wa,--noexecstack -Wall -Wa,--noexecstack -g -O2 -fdebug-prefix-map=/build/openssl-KZTQCo/openssl-1.1.1c=. -fstack-protector-strong -Wformat -Werror=format-security -DOPENSSL_USE_NODELETE -DOPENSSL_PIC -DOPENSSL_CPUID_OBJ -DOPENSSL_BN_ASM_MONT -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DKECCAK1600_ASM -DVPAES_ASM -DECP_NISTZ256_ASM -DPOLY1305_ASM -DNDEBUG -Wdate-time -D_FORTIFY_SOURCE=2
  The 'numbers' are in 1000s of bytes per second processed.
  type             16 bytes     64 bytes    256 bytes   1024 bytes   8192 bytes  16384 bytes
  aes-128 cbc      54758.63k    59729.21k    61272.41k    61929.40k    61838.68k    61930.42k
  sha256           51686.84k   155549.57k   368082.71k   553620.48k   654379.15k   659623.13k
  		  sign    verify    sign/s verify/s
  rsa 2048 bits 0.007129s 0.000191s    140.3   5227.4

Mainline Kernel 5.7.0

  • linux-image 5.7.0

https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.35

Testing rt5651

There is support for rt5651 but the trick to make it work is described on Armbian forum. Alsamixer must set the following:

amixer set 'HPO L' on
amixer set 'HPO R' on
amixer set 'HPOVOL L' on
amixer set 'HPOVOL R' on
amixer set 'HPO MIX HPVOL' on
amixer set 'OUT MIXL DAC L1' on
amixer set 'OUT MIXR DAC R1' on
amixer set 'Stereo DAC MIXL DAC L1' on
amixer set 'Stereo DAC MIXR DAC R1' on

  • Check sound devices

    ubuntu@nanopi-m4:~$ aplay -l **** List of PLAYBACK Hardware Devices **** card 0: realtekrt5651co [realtek,rt5651-codec], device 0: ff890000.i2s-rt5651-aif1 rt5651-aif1-0 [ff890000.i2s-rt5651-aif1 rt5651-aif1-0] Subdevices: 1/1 Subdevice #0: subdevice #0 card 1: ROCKCHIPSPDIF [ROCKCHIP,SPDIF], device 0: ff870000.spdif-dit-hifi dit-hifi-0 [ff870000.spdif-dit-hifi dit-hifi-0] Subdevices: 1/1 Subdevice #0: subdevice #0 card 2: hdmisound [hdmi-sound], device 0: ff8a0000.i2s-i2s-hifi i2s-hifi-0 [ff8a0000.i2s-i2s-hifi i2s-hifi-0] Subdevices: 1/1 Subdevice #0: subdevice #0

Playing sound on every device:

rt5651

aplay -D sysdefault:CARD=0 /usr/share/sounds/alsa/Front_Right.wav

SPDIF

aplay -D sysdefault:CARD=1 /usr/share/sounds/alsa/Front_Right.wav

hdmi-sound

aplay -D sysdefault:CARD=2 /usr/share/sounds/alsa/Front_Right.wav

Testing GPU and VPU

There is support for GPU (panfrost) and VPU (hantro and rkvdec). Most H264 (1920x1080) works smooth. You can also build Kodi.

If you output decoded video to a framebuffer:

ffmpeg -hwaccel drm -i Big_Buck_Bunny_1080_10s_30MB.mp4 -pix_fmt bgra -f fbdev /dev/fb0

There is a small penalty to be paid for converting the drm_prime format to bgra that increases CPU usage, while output to a drm_prime surface like Kodi does not.

FFmpeg used to test hw decoding: ffmpeg version 4.2.2-Matrix-Alpha1-26-g6029b361f2-Kodi

You can learn more reading Mainline VPU on Armbian forum

Testing Wifi

Wifi and BT works fine with the latest brcm firmware provided on previous image. 2.4 GHz and 5 GHz has been working without any glitch, read the previous info.

Mainline Kernel 5.7.0-rc4

  • linux-image 5.7.0-rc4 plus brcm firmware update

https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.34

Panfrost 3D graphics

Panfrost works on linux-image 5.4.0-rc8. It has been tested with latest Mesa 3D and kmscube.

Mesa 3D: https://gitlab.freedesktop.org/mesa/mesa Kmscube: https://gitlab.freedesktop.org/mesa/kmscube

Panfrost Monitoring

Panfrost Output:

ubuntu@nanopi-m4:~/kmscube$ sudo ./kmscube
[sudo] password for ubuntu: 
Using display 0xaaaad69887e0 with EGL version 1.4
===================================
EGL information:
  version: "1.4"
  vendor: "Mesa Project"
  client extensions: "EGL_EXT_client_extensions EGL_EXT_device_base EGL_EXT_device_enumeration EGL_EXT_device_query EGL_EXT_platform_base EGL_KHR_client_get_all_proc_addresses EGL_KHR_debug EGL_EXT_platform_wayland EGL_EXT_platform_x11 EGL_MESA_platform_gbm EGL_MESA_platform_surfaceless EGL_EXT_platform_device"
  display extensions: "EGL_ANDROID_blob_cache EGL_EXT_buffer_age EGL_EXT_image_dma_buf_import EGL_KHR_cl_event2 EGL_KHR_config_attribs EGL_KHR_create_context EGL_KHR_create_context_no_error EGL_KHR_fence_sync EGL_KHR_get_all_proc_addresses EGL_KHR_gl_colorspace EGL_KHR_gl_renderbuffer_image EGL_KHR_gl_texture_2D_image EGL_KHR_gl_texture_3D_image EGL_KHR_gl_texture_cubemap_image EGL_KHR_image EGL_KHR_image_base EGL_KHR_image_pixmap EGL_KHR_no_config_context EGL_KHR_partial_update EGL_KHR_reusable_sync EGL_KHR_surfaceless_context EGL_EXT_pixel_format_float EGL_KHR_wait_sync EGL_MESA_configless_context EGL_MESA_drm_image EGL_MESA_image_dma_buf_export EGL_MESA_query_driver EGL_WL_bind_wayland_display "
===================================
OpenGL ES 2.x information:
  version: "OpenGL ES 2.0 Mesa 20.0.0-devel (git-02d63ee5a4)"
  shading language version: "OpenGL ES GLSL ES 1.0.16"
  vendor: "panfrost"
  renderer: "panfrost"
  extensions: "GL_EXT_blend_minmax GL_EXT_multi_draw_arrays GL_EXT_texture_format_BGRA8888 GL_OES_compressed_ETC1_RGB8_texture GL_OES_depth24 GL_OES_element_index_uint GL_OES_fbo_render_mipmap GL_OES_mapbuffer GL_OES_rgb8_rgba8 GL_OES_stencil8 GL_OES_texture_3D GL_OES_texture_float GL_OES_texture_float_linear GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_OES_texture_npot GL_OES_vertex_half_float GL_OES_EGL_image GL_OES_depth_texture GL_OES_packed_depth_stencil GL_EXT_texture_type_2_10_10_10_REV GL_OES_get_program_binary GL_APPLE_texture_max_level GL_EXT_discard_framebuffer GL_EXT_read_format_bgra GL_EXT_frag_depth GL_NV_fbo_color_attachments GL_OES_EGL_image_external GL_OES_EGL_sync GL_OES_vertex_array_object GL_EXT_occlusion_query_boolean GL_EXT_texture_rg GL_EXT_unpack_subimage GL_NV_draw_buffers GL_NV_read_buffer GL_NV_read_depth GL_NV_read_depth_stencil GL_NV_read_stencil GL_EXT_draw_buffers GL_EXT_map_buffer_range GL_KHR_debug GL_KHR_texture_compression_astc_ldr GL_OES_required_internalformat GL_OES_surfaceless_context GL_EXT_separate_shader_objects GL_EXT_compressed_ETC1_RGB8_sub_texture GL_EXT_draw_elements_base_vertex GL_EXT_texture_border_clamp GL_KHR_context_flush_control GL_OES_draw_elements_base_vertex GL_OES_texture_border_clamp GL_KHR_no_error GL_KHR_texture_compression_astc_sliced_3d GL_KHR_parallel_shader_compile "
===================================
Using modifier ffffffffffffff
Modifiers failed!
Using modifier ffffffffffffff
Modifiers failed!

How to build 3D Mesa 20.0 for Panfrost

  • Update Kernel and packages

  • Install dependencies (libdrm, libgbm, wayland protocols, x11 protocols)

  • Install meson build

     https://mesonbuild.com/Quick-guide.html

  • Build and install

Kodi on 5.4.0

I have built Kodi with same parameters as for the Mali way, but for some reason it crashed when launched. It is known to be possible to run Kodi with Panfrost since Kernel 5.2, but something is missing on my Kodi build. No luck yet.

Mainline Kernel 5.4.y follow up

  • Kernel 5.4.0-rc8 Boot log with hdmi-sound

    https://gist.github.com/avafinger/c0651125c1209b4c8a7920a1595ed239

  • Kernel 5.4.0-rc7 Boot log

    https://gist.github.com/avafinger/99108b3255596080490f3b4d0030230d

  • linux-image 5.4.0-rc8 Deb package

    https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.30

  • linux-image 5.4.0 Deb package

    https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.31

  • linux-image 5.4.1 Deb package

    https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.32

    Wifi enabled generates cpu load and heat, not recommended. https://gist.github.com/avafinger/bc9b1a8b0ea4fb482afee088b7c711d1

    To activate Wlan0 you need to recompile kernel 5.4.1 with BRCM module enabled and edit /etc/networks/interface and enable wlan

  • linux-image 5.4.8 Deb package

    https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.33

OS Image

  • Image file (8GB SD card) is available here:

    https://mega.nz/#!YLZhlYJb!uqvCIjpeBoGyfhaNYPJwb67kma7wmGTn5ZObe-CPrb4 
(use 7z / zip to unzip and flash into SD card with Win32DiskImager or etcher)

  • Flash SD CARD from Linux Box:

    You need wget and curl installed to grab the files in a Linux distro.

    Get the latest files by running (or seee below to fetch specific Release version files):

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases/latest | grep -oP '"browser_download_url": "\K(.*)(?=")')

then

sudo ./flash_sd.sh /dev/sdX (or /dev/mmcblkY) where X is a letter from b,c.. and Y is a number from 0,1..)

WARNING Find the correct device letter for your USB SD CARD or you may wipe your hdd.

Release v1.0

These are the raw files for building the OS Image with kernel 4.4.166-rockchip

Release v1.1

  • minor fixes and optimizations (4K, journaling , heart-beat)

  • DHCP enabled (default)

  • We're ready to roll

      user: ubuntu
  password: ubuntu

Get v1.1 files:

	wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.1)

Boot takes about 10 seconds or less depending on SD card in use. Tip: If you can't see anything on screen, type enter twice!

On first login:

sudo apt-get update
sudo apt-get dist-upgrade

Tip: You may need to update the file resolver.conf to reflect you network (DNS)

type in the shell: df -lh

Filesystem      Size  Used Avail Use% Mounted on
/dev/mmcblk0p2  7.3G  582M  6.4G   9% /
devtmpfs        963M     0  963M   0% /dev
tmpfs           964M     0  964M   0% /dev/shm
tmpfs           964M   17M  947M   2% /run
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           964M     0  964M   0% /sys/fs/cgroup
/dev/mmcblk0p1  113M   21M   84M  20% /boot
tmpfs           193M     0  193M   0% /run/user/1000

type in the shell: free -m

              total        used        free      shared  buff/cache   available
Mem:           1926          47        1798          24          80        1793
Swap:             0           0           0

Now we can start installing and/or configuring things:

  • ssh
  • wifi
  • 3D mali user space for OpenGLES 3.1 / OpenCL 1.2 ( fbdev and X11 )
  • bluetooth
  • VPU ( encode / decoding )
  • camera ( when ready !?! )

Instructions and DEB packages coming soon

Remote access the board

Install ssh to be able to login remotely:

	sudo apt-get install ssh

from your PC:

	ssh ubuntu@IP
	where IP is the board IP assigned by DHCP

3D Mali (fbdev)

To be able to use OpenGL ES 2 / 3 we need to install the Mali user space lib.

  • Download files:

      wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.2)

  • Install the necessary packages:

      sudo apt-get install libjpeg-turbo8 libjpeg8 libpng16-16 libegl1 libegl-mesa0 libpng-dev libjpeg-dev
  sudo apt-get install libgles2-mesa-dev ocl-icd-opencl-dev

  • Install Mali

      sudo dpkg -i --force-all mali-t86x-rk3399-linux-4.4.y_1.0-1.deb

    Ignore the warnings.

  • Install enhanced htop:

    You can monitor the health of you RK3399 (CPU Temp, CPU Freq and CPU VCore, enter F2 and add these monitors)

      sudo dpkg -i htop_2.1.1-3_arm64.deb

  • Install tools for benchmarking mali on fbdev:

      sudo dpkg -i glmark2-data_2014.03+git20150611.fa71af2d-0ubuntu5_all.deb 
  sudo dpkg -i glmark2-es2-fbdev_2014.03+git20150611.fa71af2d-0ubuntu5_arm64.deb

    If everything is Okay, then you can test it:

      sudo glmark2-es2-fbdev (test it remotely)

Wifi

Install packages:

	sudo apt-get install crda wpasupplicant

Enable wifi editing the file /etc/network/interfaces and adding:

	allow-hotplug wlan0
	iface wlan0 inet dhcp
		wpa-ssid SID
		#psk="00012345678901234567890"
		wpa-psk afde07531d767050796db24c3d449e26a449c15b98bfaf20148970ec43242078
		dns-nameservers 8.8.8.8 8.8.4.4
		wireless-power off

Where SID os you AP name and xxxxxxxxx is your encrypted password. Generate encrypted password like so:

	wpa_passphrase SSID xxxxxxxxx

and finally boot and connect to Wifi

GBM

We have now fbdev working and with OpenGLES 3.2 (fbdev) we can go further and install GBM (Graphic Buffer Management) libraries to be able to use DRM for a non-Desktop environment (no X11/Wayland). VPU has support for DRM/GBM and not for fbdev yet.

There is a DEB package ready to install VPU support. Mali user space for GBM is needed in order to be able to use GL and/or GLES 2/3. The nice thing here is that we can have Kodi Media Center to run on NanoPi M4 / NEO / T4 or any other RK3399 if you wish.

Install the gbm libraries and VPU deb package so we can have Hardware Decoding and HW accelerated display with Mali T86x.

	sudo apt-get install libgbm-dev

Test if GBM is fully working with gbm_es2_demo (170 Kb) or kmscube (1.4 Mb) Get file with in https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.7

	./gbm_es2_demo 
	using card: '/dev/dri/card0': Success
	Using display 0x557241ccf0 with EGL version 1.4
	EGL Version "1.4 Midgard-"r14p0-01rel0""
	EGL Vendor "ARM"
	EGL Extensions "EGL_KHR_partial_update EGL_KHR_image_pixmap EGL_EXT_image_dma_buf_import EGL_KHR_config_attribs EGL_KHR_image EGL_KHR_image_base EGL_KHR_fence_sync EGL_KHR_wait_sync EGL_KHR_gl_colorspace EGL_KHR_get_all_proc_addresses EGL_IMG_context_priority EGL_ARM_pixmap_multisample_discard EGL_KHR_gl_texture_2D_image EGL_KHR_gl_renderbuffer_image EGL_KHR_create_context EGL_KHR_surfaceless_context EGL_KHR_gl_texture_cubemap_image EGL_EXT_create_context_robustness EGL_KHR_cl_event2"
	FPS: 0.002751 
	FPS: 59.027754 
	FPS: 59.989142 
	FPS: 60.001338 
	FPS: 60.008244 
	FPS: 60.007122 
	FPS: 59.988592 
	FPS: 60.013970 
	FPS: 59.988422 
	FPS: 60.008008 
	FPS: 60.001338 
	FPS: 60.000630 
	FPS: 59.995440 
	FPS: 60.001102 
	FPS: 60.006768 
	FPS: 59.995967 
	FPS: 60.001397 
	FPS: 60.007831

or kmscube

	./kmscube 
	Using display 0x55b89fca00 with EGL version 1.4
	===================================
	EGL information:
	  version: "1.4 Midgard-"r14p0-01rel0""
	  vendor: "ARM"
	  client extensions: "EGL_EXT_client_extensions EGL_EXT_platform_base EGL_KHR_client_get_all_proc_addresses EGL_KHR_platform_gbm EGL_MESA_platform_gbm"
	  display extensions: "EGL_KHR_partial_update EGL_KHR_image_pixmap EGL_EXT_image_dma_buf_import EGL_KHR_config_attribs EGL_KHR_image EGL_KHR_image_base EGL_KHR_fence_sync EGL_KHR_wait_sync EGL_KHR_gl_colorspace EGL_KHR_get_all_proc_addresses EGL_IMG_context_priority EGL_ARM_pixmap_multisample_discard EGL_KHR_gl_texture_2D_image EGL_KHR_gl_renderbuffer_image EGL_KHR_create_context EGL_KHR_surfaceless_context EGL_KHR_gl_texture_cubemap_image EGL_EXT_create_context_robustness EGL_KHR_cl_event2"
	===================================
	OpenGL ES 2.x information:
	  version: "OpenGL ES 3.2 v1.r14p0-01rel0-git(966ed26).2e3fa7564ebca70897f04bd9fb7bc67e"
	  shading language version: "OpenGL ES GLSL ES 3.20"
	  vendor: "ARM"
	  renderer: "Mali-T860"
	  extensions: "GL_ARM_rgba8 GL_ARM_mali_shader_binary GL_OES_depth24 GL_OES_depth_texture GL_OES_depth_texture_cube_map GL_OES_packed_depth_stencil GL_OES_rgb8_rgba8 GL_EXT_read_format_bgra GL_OES_compressed_paletted_texture GL_OES_compressed_ETC1_RGB8_texture GL_OES_standard_derivatives GL_OES_EGL_image GL_OES_EGL_image_external GL_OES_EGL_image_external_essl3 GL_OES_EGL_sync GL_OES_texture_npot GL_OES_vertex_half_float GL_OES_required_internalformat GL_OES_vertex_array_object GL_OES_mapbuffer GL_EXT_texture_format_BGRA8888 GL_EXT_texture_rg GL_EXT_texture_type_2_10_10_10_REV GL_OES_fbo_render_mipmap GL_OES_element_index_uint GL_EXT_shadow_samplers GL_OES_texture_compression_astc GL_KHR_texture_compression_astc_ldr GL_KHR_texture_compression_astc_hdr GL_KHR_texture_compression_astc_sliced_3d GL_KHR_debug GL_EXT_occlusion_query_boolean GL_EXT_disjoint_timer_query GL_EXT_blend_minmax GL_EXT_discard_framebuffer GL_OES_get_program_binary GL_OES_texture_3D GL_EXT_texture_storage GL_EXT_multisampled_render_to_texture GL_OES_surfaceless_context GL_OES_texture_stencil8 GL_EXT_shader_pixel_local_storage GL_ARM_shader_framebuffer_fetch GL_ARM_shader_framebuffer_fetch_depth_stencil GL_ARM_mali_program_binary GL_EXT_sRGB GL_EXT_sRGB_write_control GL_EXT_texture_sRGB_decode GL_KHR_blend_equation_advanced GL_KHR_blend_equation_advanced_coherent GL_OES_texture_storage_multisample_2d_array GL_OES_shader_image_atomic GL_EXT_robustness GL_EXT_draw_buffers_indexed GL_OES_draw_buffers_indexed GL_EXT_texture_border_clamp GL_OES_texture_border_clamp GL_EXT_texture_cube_map_array GL_OES_texture_cube_map_array GL_OES_sample_variables GL_OES_sample_shading GL_OES_shader_multisample_interpolation GL_EXT_shader_io_blocks GL_OES_shader_io_blocks GL_EXT_tessellation_shader GL_OES_tessellation_shader GL_EXT_primitive_bounding_box GL_OES_primitive_bounding_box GL_EXT_geometry_shader GL_OES_geometry_shader GL_ANDROID_extension_pack_es31a GL_EXT_gpu_shader5 GL_OES_gpu_shader5 GL_EXT_texture_buffer GL_OES_texture_buffer GL_EXT_copy_image GL_OES_copy_image GL_EXT_color_buffer_half_float GL_EXT_color_buffer_float GL_EXT_YUV_target GL_OVR_multiview GL_OVR_multiview2 GL_OVR_multiview_multisampled_render_to_texture GL_KHR_robustness GL_KHR_robust_buffer_access_behavior GL_EXT_draw_elements_base_vertex GL_OES_draw_elements_base_vertex "
	===================================

If the installation is Okay, you will see a spinning 3D cube.

Kodi Media Center on RK3399

Kodi has support for GBM (DRM) and can run on our NanoPi M4 setup. Kodi 18-RC5 has been compiled succesfully. Building instructions are provided here: https://github.com/xbmc/xbmc/blob/master/docs/README.Linux.md#4-build-kodi

Tips to build Kodi v18.0 RC5 on RK3399:

  • Install gcc8 and cpp8
  • Install GBM and libdrm on top of fbdev (mali-gbm user space)
  • Install VPU support (rkmpp)
  • Build ffmpeg-rockchip and add the codecs missing
  • Install ffmpeg (rkmpp)
  • Build Kodi

If you installed Kodi v18.0 B5 remove it and install Kodi v18.0 rc5 for RK3399

	sudo apt-get remove --purge kodi-18b5-rk3399-gbm

then install Kodi 18.0 RC5

	sudo dpkg -i kodi-18rc5-rk3399-gbm_1.0-2.deb

Splash screen Kodi 18rc5 on NanoPi M4 (RK3399) Kodi 1

Kodi 18rc5 on NanoPi M4 Kodi NanoPi M4 1

Kodi 18rc5 on NanoPi M4 with kernel 4.4.169-rk3399 Kodi NanoPi M4 2

Kodi 18rc5 screenshot 1 Kodi NanoPi M4 2

Kodi 18rc5 screenshot 2 Kodi NanoPi M4 2

Kodi 18rc5 screenshot 3 Kodi NanoPi M4 2

Kodi 18rc5 screenshot 4 Kodi NanoPi M4 2

Kodi 18rc5 screenshot 5 Kodi NanoPi M4 2

Splash screen Kodi 18b5 Kodi 1

ScreenShot 1 Kodi 1

ScreenShot 2 Kodi 1

ScreenShot 3 Kodi 1

ScreenShot 4 Kodi 1

ScreenShot 5 Kodi 1

ScreenShot 6 Kodi 1

Release v1.3

  • Kernel 4.4.168
  • Faster boot times (~7 secs)
  • gcc (Ubuntu 8.2.0-1ubuntu2~18.04) 8.2.0
  • All dependencies updated and installed for Kodi Multimedia Theather (18rc3) - RK3399
  • eDP LCD was removed from the tree, for some reason, EDP-1 is the main output and HDMI-1 is the second monitor this can be trouble if you want to install a Graphics Desktop, you get a dual header even if eDP LCD is not attached.
  • Rootfs ready to deploy Kodi Multimedia Center giving your NanoPi M4 / NEO4 a full-blown Media Center (hopefully ;)

Instructions:

  • Download files:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.3)

  • Flash Image

    sudo ./flash_kodi_sd.sh /dev/sdX (or /dev/mmcblkY) where X is a letter from b,c.. and Y is a number from 0,1..)

Release v1.4

  • Kernel 4.4.169 (linux-image && kernel headers)
  • The best of BSP and mainline in one kernel

Instructions:

  • Download deb file:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.4)

  • Install

    sudo dpkg -i linux-image-4.4.169-rk3399_1.0-1.deb
sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)

Release v1.8 (OS Image for eMMC only)

  • Boot from eMMC
  • Kernel 4.4.169 (linux-image && kernel headers)
  • The best of BSP and mainline in one kernel
  • KODI 18.0 RC5

Instructions:

  • boot from SD CARD and with eMMC attached

  • install parted:

    sudo apt-get install parted

  • create a temporary directory:

    mkdir -p emmc
cd emmc

  • Download the files to flash eMMC:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.8)

    Make sure the download is complete, check with md5sum atfer download! (bad SD card or bad USB sdhc writer can corrupt the file contents):

    0521a81ed44c7274c906ae3d98769bc4  boot_kodi_emmc.tar.gz
e88855ba0775235475618309381c3759  rootfs_kodi.tar.gz

  • Install (Burn OS Image to eMMC)

    sudo ./flash_kodi_emmc.sh /dev/mmcblk1
sudo shutdown -h now (remone power and sd card)

    Boot without the sd card

Release v1.9

  • Kernel 4.4.170 (linux-image && kernel headers)
  • The best of BSP and mainline in one kernel

Instructions:

  • Download deb file:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.9)

  • Install

    sudo dpkg -i linux-image-4.4.170-rk3399_1.0-2.deb
sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)

Release v1.10

Instructions:

  • Download deb file:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.10)

  • Install

    sudo dpkg -i linux-image-4.4.171-rk3399_1.0-3.deb
sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)

Release v1.11

  • Kernel 4.4.172 (linux-image && kernel headers)
  • support for ov13850 + ov4689 included
  • F2FS code has been touched only, minor fix, need a complete re-write so it is more BSP than Mainline (you have been warned)

Instructions:

  • Download deb file:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.11)

  • Install

    sudo dpkg -i linux-image-4.4.172-rk3399_1.0-4.deb
sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)

Release v1.13

  • Kernel 4.4.173 (linux-image && kernel headers)
  • modified rfkill-bt
  • modified wifi
  • mainline 4.4.173 patches

Instructions:

  • Download deb file:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.13)

  • Install

You need at least 20 Mbytes free on /boot

	sudo dpkg -i linux-image-4.4.173_1.0-5.deb
	sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)

Release v1.15

Instructions:

You need at least 20 Mbytes free on /boot

	sudo dpkg -i linux-image-4.4.174-rk3399_1.0-7.deb
	sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)

Release v1.18

Instructions:

You need at least 20 Mbytes free on /boot

	sudo dpkg -i linux-image-4.4.175-rk3399_1.0-8.deb
	sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)

Release v1.19

  • Linux Image 4.4.177-rk3399 (linux-image && kernel headers)
  • built with gcc 7.3
  • CPU freq back to 2 GHz (2.0 / 1.5 Ghz)
  • DRM workaround to run latest Kodi

Instructions:

You need at least 20 Mbytes free on /boot

	sudo dpkg -i linux-image-4.4.177-rk3399_1.0-9.deb
	sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)

Bluetooth

We are going to set up the BT in an old fashioned way to bypass some limitations and later install a systemd service to boot with BT enabled. Kernel has been patched to hopefully fix the "timeout" issue with Bluez but still have some issues with hctool. For this we will use brcm_patchram_plus to load the firmware and turn ON the BT and have a stable BT experience.

  • Install BT service

    sudo dpkg -i bluetooth-rk3399_1.0-1.deb
sudo sync && sudo reboot

    After a reboot you can check if BT is on with:

    hcitool devi
Devices:
	hci0	CC:4B:73:23:D4:33

    The service should be the last service to be run, if not you get the "timeout" issue and BT will be useless. A trick to make BT stable is as follow:

    • Disable the BT service

      sudo systemctl disable brcm_patchram_plus.service

    • Install our trick to rc.local service that is the last service that gets pulled from systemd

      Copy and past each complete command line below:

      sudo printf '%s\n' '#!/bin/bash' 'pulseaudio -D' 'brcm_patchram_plus -d --enable_hci --no2bytes --use_baudrate_for_download --tosleep 200000 --baudrate 1500000 --patchram /system/etc/firmware/bcm4356a2.hcd --enable_lpm /dev/ttyS0 > /tmp/bt.log 2>&1 &' 'exit 0' | sudo tee -a /etc/rc.local
sudo chmod +x /etc/rc.local
sync && sudo reboot

    Check with :

    	hcitool devi
	Devices:
		hci0	CC:4B:73:23:D4:33

  • Pairing a Phone with our NanoPi M4

    Install the packages if not already installed:

    sudo apt-get install rfkill bluez

    Run pulseaudio required to pair with a phone (if not running!).

    pulseaudio -D

    If you have not installed pulse and alsa you need to to do it and check if it is working:

    ubuntu@nanopi-m4:~$ ps -e |grep pulse
  583 ?        00:00:00 pulseaudio

    Check alsamixer and turn on everything:

    alsamixer
aplay -l
**** List of PLAYBACK Hardware Devices ****
card 0: realtekrt5651co [realtek,rt5651-codec], device 0: ff890000.i2s-rt5651-aif1 rt5651-aif1-0 []
  Subdevices: 0/1
  Subdevice #0: subdevice #0
card 1: rockchiphdmi [rockchip,hdmi], device 0: ff8a0000.i2s-i2s-hifi i2s-hifi-0 []
  Subdevices: 0/1
  Subdevice #0: subdevice #0

  • Pairing test

    ubuntu@nanopi-m4:~$ sudo bluetoothctl
[sudo] password for ubuntu: 
[NEW] Controller CC:4B:73:23:D4:33 nanopi-m4 [default]
Agent registered
[bluetooth]# list
Controller CC:4B:73:23:D4:33 nanopi-m4 [default]
[bluetooth]# power on
Changing power on succeeded
[bluetooth]# agent on
Agent is already registered
[bluetooth]# default-agent
Default agent request successful
[bluetooth]# scan on
Discovery started
[CHG] Controller CC:4B:73:23:D4:33 Discovering: yes
[NEW] Device 00:17:CA:F7:38:18 Haier HW-W910
[bluetooth]# pair 00:17:CA:F7:38:18
Attempting to pair with 00:17:CA:F7:38:18
[CHG] Device 00:17:CA:F7:38:18 Connected: yes
Request confirmation
[Haie1m[agent] Confirm passkey 552791 (yes/no): Request canceled
[agent] Confirm passkey 552791 (yes/no): Failed to pair: org.bluez.Error.AuthenticationFailed
[CHG] Device 00:17:CA:F7:38:18 Connected: no
[bluetooth]# pair 00:17:CA:F7:38:18
Attempting to pair with 00:17:CA:F7:38:18
[CHG] Device 00:17:CA:F7:38:18 Connected: yes
Request confirmation
[Haie1m[agent] Confirm passkey 053012 (yes/no): yes
[CHG] Device 00:17:CA:F7:38:18 Modalias: usb:v000Ap0000d0000
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001105-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000110a-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000110c-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001112-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001116-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000111f-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000112f-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001132-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001200-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001800-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001801-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 ServicesResolved: yes
[CHG] Device 00:17:CA:F7:38:18 Paired: yes
Pairing successful
[CHG] Device 00:17:CA:F7:38:18 ServicesResolved: no
[CHG] Device 00:17:CA:F7:38:18 Connected: no
[bluetooth]# info
Missing device address argument
[bluetooth]# info 00:17:CA:F7:38:18
Device 00:17:CA:F7:38:18 (public)
	Name: Haier HW-W910
	Alias: Haier HW-W910
	Class: 0x005a020c
	Icon: phone
	Paired: yes
	Trusted: no
	Blocked: no
	Connected: no
	LegacyPairing: yes
	UUID: OBEX Object Push          (00001105-0000-1000-8000-00805f9b34fb)
	UUID: Audio Source              (0000110a-0000-1000-8000-00805f9b34fb)
	UUID: A/V Remote Control Target (0000110c-0000-1000-8000-00805f9b34fb)
	UUID: Headset AG                (00001112-0000-1000-8000-00805f9b34fb)
	UUID: NAP                       (00001116-0000-1000-8000-00805f9b34fb)
	UUID: Handsfree Audio Gateway   (0000111f-0000-1000-8000-00805f9b34fb)
	UUID: Phonebook Access Server   (0000112f-0000-1000-8000-00805f9b34fb)
	UUID: Message Access Server     (00001132-0000-1000-8000-00805f9b34fb)
	UUID: PnP Information           (00001200-0000-1000-8000-00805f9b34fb)
	UUID: Generic Access Profile    (00001800-0000-1000-8000-00805f9b34fb)
	UUID: Generic Attribute Profile (00001801-0000-1000-8000-00805f9b34fb)
	Modalias: usb:v000Ap0000d0000
	RSSI: -82
[bluetooth]# connect 00:17:CA:F7:38:18
Attempting to connect to 00:17:CA:F7:38:18
[CHG] Device 00:17:CA:F7:38:18 Connected: yes
Connection successful
[CHG] Device 00:17:CA:F7:38:18 ServicesResolved: yes
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001105-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001108-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000110a-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000110c-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001112-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001116-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000111f-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000112f-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001132-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001200-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001800-0000-1000-8000-00805f9b34fb
[CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001801-0000-1000-8000-00805f9b34fb
Authorize service
[Haie1m[agent] Authorize service 00001108-0000-1000-8000-00805f9b34fb (yes/no): yes
[Haier HW-W910]# trust 00:17:CA:F7:38:18
[CHG] Device 00:17:CA:F7:38:18 Trusted: yes
Changing 00:17:CA:F7:38:18 trust succeeded
[Haier HW-W910]# info 00:17:CA:F7:38:18
Device 00:17:CA:F7:38:18 (public)
	Name: Haier HW-W910
	Alias: Haier HW-W910
	Class: 0x005a020c
	Icon: phone
	Paired: yes
	Trusted: yes
	Blocked: no
	Connected: yes
	LegacyPairing: yes
	UUID: OBEX Object Push          (00001105-0000-1000-8000-00805f9b34fb)
	UUID: Headset                   (00001108-0000-1000-8000-00805f9b34fb)
	UUID: Audio Source              (0000110a-0000-1000-8000-00805f9b34fb)
	UUID: A/V Remote Control Target (0000110c-0000-1000-8000-00805f9b34fb)
	UUID: Headset AG                (00001112-0000-1000-8000-00805f9b34fb)
	UUID: NAP                       (00001116-0000-1000-8000-00805f9b34fb)
	UUID: Handsfree Audio Gateway   (0000111f-0000-1000-8000-00805f9b34fb)
	UUID: Phonebook Access Server   (0000112f-0000-1000-8000-00805f9b34fb)
	UUID: Message Access Server     (00001132-0000-1000-8000-00805f9b34fb)
	UUID: PnP Information           (00001200-0000-1000-8000-00805f9b34fb)
	UUID: Generic Access Profile    (00001800-0000-1000-8000-00805f9b34fb)
	UUID: Generic Attribute Profile (00001801-0000-1000-8000-00805f9b34fb)
	Modalias: usb:v000Ap0000d0000
	RSSI: -82
[Haier HW-W910]# untrust 00:17:CA:F7:38:18
[CHG] Device 00:17:CA:F7:38:18 Trusted: no
Changing 00:17:CA:F7:38:18 untrust succeeded
[Haier HW-W910]# disconnect 00:17:CA:F7:38:18
Attempting to disconnect from 00:17:CA:F7:38:18
[CHG] Device 00:17:CA:F7:38:18 ServicesResolved: no
Successful disconnected
[CHG] Device 00:17:CA:F7:38:18 Connected: no
[bluetooth]# remove 00:17:CA:F7:38:18
[DEL] Device 00:17:CA:F7:38:18 Haier HW-W910
Device has been removed
[NEW] Device 00:17:CA:F7:38:18 Haier HW-W910
[bluetooth]# scan off
Discovery stopped
[CHG] Controller CC:4B:73:23:D4:33 Discovering: no
[CHG] Device 00:17:CA:F7:38:18 RSSI is nil
[bluetooth]# quit
Agent unregistered
[DEL] Controller CC:4B:73:23:D4:33 nanopi-m4 [default]
ubuntu@nanopi-m4:~$

LibreElec or not LibreElec

If you want to run Kodi automatically without the need of logging in you can do this:

  • Boot automatically

     sudo systemctl edit [email protected]

    and copy & paste:

    [Service]
ExecStart=
ExecStart=-/sbin/agetty --noissue --autologin ubuntu %I $TERM
Type=idle

    Save and Exit

  • Run Kodi right after login:

    echo "kodi" >> .profile

    Then:

    sync && sudo reboot

    Important

    For every login, kodi will run. If you login via ssh you get kodi on main screen. Remember to exit kodi if you are going to access the board remotely

Mainline Kernel on NanoPi M4

A litle follow-up on the status of Mainline kernel 5.0.0-rc2 on RK3399.

What works:

  • HDMI
  • Bluetooth
  • USB 2
  • DVFS
  • ethernet

Some Logs here: https://gist.github.com/avafinger/a8474938b0dfb31e462ad332192b324d

Mainline kernel 5.0.0-rc3 built with gcc 8.2 Some logs: https://gist.github.com/avafinger/05048dd20cef3953559a0bddef8f5930

Boosted oop to 2.0 GHz and 1.5 GHz and board is still stable! Results here: https://gist.github.com/avafinger/a8474938b0dfb31e462ad332192b324d

Increase oop to 2.0 / 1.5 GHz 7z b

Kodi 1

Mainline Kernel 5.0-rc2 (Ubuntu minimal 18.04)

I have provided an OS Image tested on NanoPi M4:

  • rk3399_ubuntu-minimal-mainline-kernel-5-rc2.7z

Download from: https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.12

Release v1.14 (Experimental)

  • Kernel 5.0.0-rc5 (linux-image && kernel headers)

Instructions:

  • Download deb file:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.14)

  • Install

You need at least 19 Mbytes free on /boot

	sudo dpkg -i inux-image-mainline-5.0_1.0-6.deb
	sudo shutdown -h now

Release v1.16 (Experimental)

  • Kernel 5.0.0-rc6-rk3399 (linux-image && kernel headers)

Instructions:

  • Download deb file:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.16)

  • Install

You need at least 19 Mbytes free on /boot

	sudo dpkg -i linux-image-mainline-5.0_1.0-7.deb
	sudo shutdown -h now
	Reboot..

Release v1.17 (Experimental)

  • Kernel 5.0.0-rc7 (linux-image && kernel headers)

Instructions:

  • Download deb file:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.17)

  • Install

You need at least 19 Mbytes free on /boot

	sudo dpkg -i linux-image-mainline-5.0_1.0-8.deb
	sudo shutdown -h now
	Reboot..

Release v1.20 (Experimental)

  • Kernel 5.0.3 (linux-image && kernel headers)

Instructions:

  • Download deb file:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.20)

  • Install

You need at least 20 Mbytes free on /boot

	sudo dpkg - i linux-image-mainline-5.0_1.0-9.deb
	sudo shutdown -h now
	Reboot..

Release v1.21 (Experimental)

  • Kernel 5.1-rc1 (linux-image && kernel headers)

Instructions:

  • Download deb file:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.21)

  • Install

You need at least 20 Mbytes free on /boot

	sudo dpkg - i linux-image-mainline-5.1_1.0-10.deb
	sudo shutdown -h now
	Reboot..

7z b

	7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
	p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE)
	
	LE
	CPU Freq:  1938  1989  1989  1989  1989  1989  1989  1989  1989
	
	RAM size:    1989 MB,  # CPU hardware threads:   6
	RAM usage:   1323 MB,  # Benchmark threads:      6
	
	                       Compressing  |                  Decompressing
	Dict     Speed Usage    R/U Rating  |      Speed Usage    R/U Rating
	         KiB/s     %   MIPS   MIPS  |      KiB/s     %   MIPS   MIPS
	
	22:       3882   357   1058   3777  |      98473   528   1591   8398
	23:       4318   403   1092   4400  |     101357   532   1647   8770
	24:       5381   479   1207   5786  |      98415   527   1638   8638
	25:       4924   462   1216   5623  |      97324   530   1633   8661
	----------------------------------  | ------------------------------
	Avr:             425   1143   4896  |              530   1627   8617
	Tot:             477   1385   6757

lsmod

	Module                  Size  Used by
	brcmfmac              225280  0
	rockchipdrm           118784  1
	brcmutil               16384  1 brcmfmac
	cfg80211              327680  1 brcmfmac
	analogix_dp            36864  1 rockchipdrm
	dw_hdmi                32768  1 rockchipdrm
	dw_mipi_dsi            20480  1 rockchipdrm
	drm_kms_helper        180224  4 dw_mipi_dsi,rockchipdrm,dw_hdmi,analogix_dp
	realtek                20480  1
	hci_uart               49152  0
	drm                   425984  6 drm_kms_helper,dw_mipi_dsi,rockchipdrm,dw_hdmi,analogix_dp
	btbcm                  16384  1 hci_uart
	bluetooth             335872  23 hci_uart,btbcm
	dwmac_rk               28672  0
	stmmac_platform        20480  1 dwmac_rk
	crct10dif_ce           16384  1
	stmmac                135168  2 stmmac_platform,dwmac_rk
	phy_rockchip_pcie      16384  0
	ecdh_generic           24576  2 bluetooth
	rfkill                 28672  4 bluetooth,cfg80211
	drm_panel_orientation_quirks    20480  1 drm
	rtc_rk808              16384  1
	pcie_rockchip_host     20480  0
	rockchip_saradc        16384  0
	rockchip_thermal       24576  0
	ip_tables              32768  0
	x_tables               36864  1 ip_tables
	ipv6                  393216  26

Bootlog:

https://gist.github.com/avafinger/b87a07bf056c2d26b576f71e864ad30d

Release v1.22 (Experimental)

  • Kernel 5.1-rc2 (linux-image && kernel headers)

Instructions:

  • Download deb file:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.22)

  • Install

You need at least 20 Mbytes free on /boot

	sudo dpkg - i linux-image-mainline-5.1_1.0-10.deb
	sudo shutdown -h now
	Reboot..
  • Note: Install this linux-image on OS 5.y only and not on 4.4

Mainline Kernel 5.1-rc6 - Release 1.23 (experimental)

Instructions:

  • Download deb file:

    wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.23)

  • Install

You need at least 20 Mbytes free on /boot

	sudo dpkg - i linux-image-mainline-5.1_1.0-11.deb
	sudo shutdown -h now
	Reboot..

Mainline Kernel 5.2.0

Mainline kernel 5.2 has been released, here is what you can expect:

  • DVFS works
  • BT works
  • Wifi (in progress - almost)
  • Gbps

Bootlog: https://gist.github.com/avafinger/97d7faea424e386219ea4193a787d3b5

DVFS DVFS

Mainline Kernel 5.6.2

Mainline kernel 5.6.2 (status update) has some improvments:

  • DVFS works
  • BT works
  • Wifi works
  • Gbps
  • hdmi
  • hdmi-sound out works

i was surprised by some nice improvments on DVFS and Wifi and BT are working together. The missing pieces are the rt5651 codec and HW decoding.

7z b

ubuntu@nanopi-m4:~$ 7z b

7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE)

LE
CPU Freq: 64000000 - - - - - - - -

RAM size:    1920 MB,  # CPU hardware threads:   6
RAM usage:   1323 MB,  # Benchmark threads:      6

		       Compressing  |                  Decompressing
Dict     Speed Usage    R/U Rating  |      Speed Usage    R/U Rating
	 KiB/s     %   MIPS   MIPS  |      KiB/s     %   MIPS   MIPS

22:       5049   450   1092   4912  |      98605   505   1665   8409
23:       5796   522   1131   5906  |      96652   506   1652   8363
24:       5369   497   1161   5773  |      94737   504   1649   8315
25:       5838   550   1212   6666  |      93054   507   1633   8281
----------------------------------  | ------------------------------
Avr:             505   1149   5814  |              506   1650   8342
Tot:             505   1399   7078

Bootlog: https://gist.github.com/avafinger/eb14cc0d7fde87223e3c8fa7766ac238

Build Mainline Kernel on NanoPi M4 (on board)

Requirements:

  • 16 GB sd card minimum
  • Pre-built Mainline OS Image (This is important!)
  • Mainline Kernel from kernel.org to build

Instructions:

  • login into NanoPi M4

  • create directory

    mkdir -p linux
cd linux

  • grab the latest kernel: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/refs/tags

    wget https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/snapshot/linux-5.2.tar.gz
tar -xvpzf linux-5.2.tar.gz
cd linux-5.2

  • Build

    make  defconfig
#make  menuconfig (if you want to add or change kernel modules)
make  oldconfig
make -j6 INSTALL_MOD_PATH=output Image 
make -j6 INSTALL_MOD_PATH=output dtbs
make -j6 INSTALL_MOD_PATH=output modules
make -j6 INSTALL_MOD_PATH=output modules_install

  • Install

    export KV=$(strings ./arch/arm64/boot/Image |grep "Linux version"|awk '{print $3}')
sudo cp -fv ./arch/arm64/boot/Image /boot/Image_${KV}
sync
sudo cp -vfr ./output/* /
sync
sudo cp -vf arch/arm64/boot/dts/rockchip/rk3399-nanopc-t4.dtb /boot/rk3399-nanopc-t4.dtb_${KV}
sudo cp -vf arch/arm64/boot/dts/rockchip/rk3399-nanopi-m4.dtb /boot/rk3399-nanopi-m4.dtb_${KV}
        sync

  • Make it current kernel

    cd /boot
sudo ln -sf Image_${KV} Image
sudo ln -sf rk3399-nanopc-t4.dtb_${KV} dtb
sudo ln -sf rk3399-nanopi-m4.dtb_${KV} dtb
cd ${KVD}
sync

  • Reboot

    sudo shutdown -h now (remove power for 30 secs)
**Boot** with your new kernel

Building KODI 19

Instructions to build Kodi 19.0 ALPHA1

  • Upgrade to Kernel 4.4.177-rk3399 or use the latest Image i have provided (RAW Image)
  • Install all dependencies
  • Remove any Previous Installed Kodi.

KODI 19.0 ALPHA1 Kodi 1

KODI 19.0 ALPHA1 - mali Kodi 2

KODI 19.0 ALPHA1 - Web Inteerface Config Kodi 3

KODI 19.0 ALPHA1 - system Kodi 4

Install dependencies if not already installed, add or change if desired:

sudo apt-get install autoconf automake autopoint gettext autotools-dev cmake curl default-jre gawk gcc g++ cpp gdc gperf     libasound2-dev libass-dev libavahi-client-dev libavahi-common-dev libbluetooth-dev libbluray-dev libbz2-dev libcdio-dev     libcec-dev libp8-platform-dev libcrossguid-dev libcurl4-openssl-dev libcwiid-dev libdbus-1-dev libegl1-mesa-dev libenca-     dev libflac-dev libfontconfig1-dev libfmt-dev libfreetype6-dev libfribidi-dev libfstrcmp-dev libgcrypt20-dev libgif-dev     libgles2-mesa-dev libglew-dev libglu1-mesa-dev libgnutls28-dev libgpg-error-dev libiso9660-dev libjpeg-dev liblcms2-dev     liblirc-dev libltdl-dev liblzo2-dev libmicrohttpd-dev libmysqlclient-dev libnfs-dev libogg-dev libomxil-bellagio-dev         libpcre3-dev libplist-dev libpng-dev libpulse-dev libsmbclient-dev libsqlite3-dev libssl-dev libtag1-dev libtiff5-dev       libtinyxml-dev libtool libudev-dev libva-dev libvdpau-dev libvorbis-dev libxkbcommon-dev libxmu-dev libxrandr-dev           libxslt1-dev libxt-dev netcat lsb-release nasm python-dev python-pil python-minimal rapidjson-dev swig unzip uuid-dev       yasm zip zlib1g-dev

Build the Kodi on-board

mkdir -p kodi
cd kodi
mkdir -p kodi-build
git clone https://github.com/xbmc/xbmc kodi
cd kodi
sudo make -C tools/depends/target/crossguid PREFIX=/usr
sudo make -C tools/depends/target/flatbuffers PREFIX=/usr
sudo make -C tools/depends/target/libfmt PREFIX=/usr
cd ../kodi-build
cmake ../kodi -DCMAKE_INSTALL_PREFIX=/usr/local -DCORE_PLATFORM_NAME=gbm -DGBM_RENDER_SYSTEM=gles
cmake --build . -- VERBOSE=0 -j4
sudo make install
cd ../kodi
sudo make -j4 -C tools/depends/target/binary-addons PREFIX=/usr/local

Testing

kodi

Pre-built Kodi 19 RK3399

  • Latest rockchip update

    https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/1.24

Fix for memory leak and random crahes

Kernel 4.4.177 fix https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.25

nanopi-m4-ubuntu-base-minimal 19.10 development

Deploying Ubuntu 19.10 Eoan Ermine (development branch)

Welcome to Ubuntu Eoan Ermine (development branch) (GNU/Linux 5.3.0-rc5-rk3399 aarch64)

 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
 * Support:        https://ubuntu.com/advantage

Last login: Wed Aug 21 23:13:19 2019
ubuntu@nanopi-m4:~$

  • Info

      DISTRIB_ID=Ubuntu
  DISTRIB_RELEASE=19.10
  DISTRIB_CODENAME=eoan
  DISTRIB_DESCRIPTION="Ubuntu Eoan Ermine (development branch)"

  • memory usage kernel 4.4:

      	      total        used        free      shared  buff/cache   available
  Mem:           1926          54        1782           8          90        1794
  Swap:             0           0           0

  • memory usage kernel 5.3 (ssh):

      	      total        used        free      shared  buff/cache   available
  Mem:           1985          78        1715           8         191        1826
  Swap:             0           0           0

  • gcc dev tools

      gcc (Ubuntu 9.2.1-2ubuntu1) 9.2.1 20190819
  Copyright (C) 2019 Free Software Foundation, Inc.
  This is free software; see the source for copying conditions.  There is NO
  warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Mainline Linux Kernel 5.3.0-rc7

Bootlog: https://gist.github.com/avafinger/84aa9fac1c810765ec84844cb0da94b6

  • Flash Image to SD CARD

    https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.27

*Compiled with gcc 9.2.1

Bootlog: https://gist.github.com/avafinger/5d2e7586b4b10cb45a8a97f9d33d093b

Mainline Linux Kernel 5.3.1

Bootlog: https://gist.github.com/avafinger/28d976dbe48bc92580efba3fffc37078

  • Linux-image

    https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.28

Mainline Linux Kernel 5.4.0-rc4

Bootlog: https://gist.github.com/avafinger/0d3d90ad478fb3457707b9652c9710ea

  • Linux-image

    https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.29

  • 7z b

    7z b burning test

alex@svn:~$ ssh [email protected]
[email protected]'s password: 
Welcome to Ubuntu 19.10 (GNU/Linux 5.4.0-rc4 aarch64)

 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
 * Support:        https://ubuntu.com/advantage

Last login: Tue Oct 22 21:06:53 2019 from 192.168.254.253
ubuntu@nanopi-m4:~$ 7z b
   
7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE)

LE
CPU Freq: - - - - - - - - -

RAM size:    1986 MB,  # CPU hardware threads:   6
RAM usage:   1323 MB,  # Benchmark threads:      6

                       Compressing  |                  Decompressing
Dict     Speed Usage    R/U Rating  |      Speed Usage    R/U Rating
         KiB/s     %   MIPS   MIPS  |      KiB/s     %   MIPS   MIPS

22:       5165   471   1067   5025  |     103265   533   1652   8807
23:       4807   447   1096   4898  |     100202   531   1633   8670
24:       3885   373   1119   4178  |      99252   533   1633   8712
25:       5253   498   1203   5998  |      94648   518   1626   8423
----------------------------------  | ------------------------------
Avr:             447   1122   5025  |              529   1636   8653
Tot:             488   1379   6839
ubuntu@nanopi-m4:~$

7z b stress

Mainline Bluetooth

Mailine Bluetooth works out-of-the-box on 5.3.y and 5.4.y

Here is how to play music with a Bluetooth speaker like JBL CHARGE3

  • Install Bluetooth stack

    sudo apt-get update
sudo apt-get dist-upgrade
sudo apt-get install dialog alsa-utils libasound2 alsa-base
sudo apt-get install bluez bluez-tools libbluetooth-dev
sudo apt-get install pulseaudio pulseaudio-utils pavucontrol pulseaudio-module-bluetooth

  • Find the BT

    ubuntu@nanopi-m4:~$ hciconfig -a
hci0:	Type: Primary  Bus: UART
BD Address: CC:4B:73:23:D4:33  ACL MTU: 1021:8  SCO MTU: 64:1
UP RUNNING PSCAN 
RX bytes:3640 acl:0 sco:0 events:418 errors:0
TX bytes:64284 acl:0 sco:0 commands:418 errors:0
Features: 0xbf 0xfe 0xcf 0xfe 0xdb 0xff 0x7b 0x87
Packet type: DM1 DM3 DM5 DH1 DH3 DH5 HV1 HV2 HV3 
Link policy: RSWITCH SNIFF 
Link mode: SLAVE ACCEPT 
Name: 'nanopi-m4'
Class: 0x0c0000
Service Classes: Rendering, Capturing
Device Class: Miscellaneous, 
HCI Version: 4.1 (0x7)  Revision: 0x210a
LMP Version: 4.1 (0x7)  Subversion: 0x230f
Manufacturer: Broadcom Corporation (15)

  • Configure ALSA

    cat /etc/asound.conf
pcm.!default {
    type plug
    slave {
        pcm "hw:1,0"
    }
}
		
ctl.!default {
   type hw
   card 1
}

  • Check for Pulse (must be running)

    ubuntu@nanopi-m4:~$ rfkill list all
0: hci0: Bluetooth
Soft blocked: no
Hard blocked: no

ubuntu@nanopi-m4:~$ ps -e|grep pulse
603 ?        00:00:00 pulseaudio

    if Pulse is not running, install and run:

     pulseaudio --start

  • Find, pair and connect with CHARGE3

    sudo bluetoothctl
power on
agent on
scan on
scan off
trust 8E:06:78:D2:E1:3C
pair 8E:06:78:D2:E1:3C
connect 8E:06:78:D2:E1:3C
exit

  • Play music

    sudo apt-get install sox libsox-fmt-all
play music.mp3

    I played this: https://www.soundhelix.com/examples/mp3/SoundHelix-Song-1.mp3

    play SoundHelix-Song-1.mp3 

SoundHelix-Song-1.mp3:

File Size: 8.95M     Bit Rate: 192k
  Encoding: MPEG audio    Info: 2009
  Channels: 2 @ 16-bit   
Samplerate: 44100Hz      
Replaygain: off         Artist: SoundHelix
Duration: 00:06:12.73  

In:9.39% 00:00:35.02 [00:05:37.71] Out:1.54M [!=====|=====!] Hd:0.1 Clip:0

Build instructions

  • Pre-requisites

    sudo apt-get install build-essential git bison flex bc device-tree-compiler dh-make bzr-builddeb p7zip-full
sudo apt-get install libssl-dev rsync wget

  • Build

    Get your kernel or use the linus kernel (stable kernel 5.3.1 on Ubuntu 19.10):

    mkdir -p linux
cd linux/
wget https://cdn.kernel.org/pub/linux/kernel/v5.x/linux-5.3.1.tar.xz
tar -xf linux-5.3.1.tar.xz
cd linux-5.3.1/

    Build:

    export KVD=$PWD
make  distclean
rm -rf ./output/*
make  mrproper
make  defconfig
make  menuconfig # enable,diable,add,remove driver(s) or configuration
make  oldconfig
make -j6 INSTALL_MOD_PATH=output Image 
make -j6 INSTALL_MOD_PATH=output dtbs
make -j6 INSTALL_MOD_PATH=output modules
make -j6 INSTALL_MOD_PATH=output modules_install
export KV=$(strings ./arch/arm64/boot/Image |grep "Linux version"|awk '{print $3}')
make INSTALL_HDR_PATH=output/usr/src/linux-headers-${KV} headers_install

    Install:

    sudo cp -vfr ./output/usr/* /usr/
sudo cp -vfr ./output/lib/* /usr/lib
sync
sudo cp -vf arch/arm64/boot/dts/rockchip/rk3399-nanopc-t4.dtb /boot/rk3399-nanopc-t4.dtb_${KV}
sudo cp -vf arch/arm64/boot/dts/rockchip/rk3399-nanopi-m4.dtb /boot/rk3399-nanopi-m4.dtb_${KV}
sync
cd /boot
sudo ln -sf Image_${KV} Image
sudo ln -sf rk3399-nanopc-t4.dtb_${KV} dtb
sudo ln -sf rk3399-nanopi-m4.dtb_${KV} dtb
cd $KVD
sync

    Reboot with:

    sudo shutdown -h now

    Remove power for 15 secs and power again!

    PS: it takes about 45 min to complete, depends on your SD CARD and how you cool your board!!!

You can also monitor the health of your board with htop 2.2.2 from here:

https://github.com/avafinger/htop_2.2.2

Fix Wifi on Mainline Kernels

Until recently i was able to use Wifi or Bluetooth but not both together. This has been fixed following some simple instructions.

I used the old way (the ugly way) to set the Wifi and Ethernet, editing the file /etc/network/interfaces instead of netplan, the recommended way which i found a bit hard to configure.

For some reason, the wifi works smooth with power save off in 2.4 GHz and 5 GHz, and now Bluetooth can work together. Setting the wireless-power off in /etc/network/interfaces does not work but using iw works:

sudo apt-get update
sudo apt-get install iw
sudo iw dev wlan0 set power_save off

Now Wifi and Bluetooth work smooth.

Also for a better performance you can update the firmware from here (which is more up-to-date):

https://people.linaro.org/~manivannan.sadhasivam/rock960_wifi/

You can add the power save command at boot time adding the command to rc.local file:

#!/bin/bash
iw dev wlan0 set power_save off
exit 0

You might need to add the rc.local service if you have not done it yet before you edit the rc.local file above;

sudo systemctl status rc-local
sudo systemctl enable rc-local
printf '%s\n' '#!/bin/bash' 'exit 0' | sudo tee -a /etc/rc.local
sudo chmod +x /etc/rc.local
sudo systemctl enable rc-local

Check for SSID(s):

sudo iw dev wlan0 scan | egrep "signal:|SSID:" | sed -e "s/\tsignal: //" -e "s/\tSSID: //" | awk '{ORS = (NR % 2 == 0)? "\n" : " "; print}' | sort

Enjoy the maximum performance of both Wifi and BT.

MIPI Camera

Experiments with MIPI camera in Kernel 4.19. In these experiments i will try to grab images from the cameras with the kernel 4.19.111

  • gstreamer

  • v4l2 app

    OV4689 sensor is configured and detected.

      ubuntu@nanopi-m4:~/camera$ v4l2-ctl -V -d /dev/video1
  Format Video Capture Multiplanar:
  	Width/Height      : 1280/960
  	Pixel Format      : 'NV12' (Y/CbCr 4:2:0)
  	Field             : None
  	Number of planes  : 1
  	Flags             : 
  	Colorspace        : Default
  	Transfer Function : Default
  	YCbCr/HSV Encoding: Default
  	Quantization      : Full Range
  	Plane 0           :
  	   Bytes per Line : 1280
  	   Size Image     : 1843200
  ubuntu@nanopi-m4:~/camera$ v4l2-ctl -d /dev/v4l-subdev0 --all
  Media Driver Info:
  	Driver name      : rkisp1
  	Model            : rkisp1
  	Serial           : 
  	Bus info         : 
  	Media version    : 4.19.111
  	Hardware revision: 0x00000000 (0)
  	Driver version   : 4.19.111
  Interface Info:
  	ID               : 0x0300002d
  	Type             : V4L Sub-Device
  Entity Info:
  	ID               : 0x00000001 (1)
  	Name             : rkisp1-isp-subdev
  	Function         : Unknown V4L2 Sub-Device
  	Pad 0x01000002   : 0: Sink, Must Connect
  	  Link 0x02000012: from remote pad 0x1000011 of entity 'rkisp1_dmapath': Data
  	  Link 0x02000023: from remote pad 0x100001e of entity 'rockchip-mipi-dphy-rx': Data
  	Pad 0x01000003   : 1: Sink
  	  Link 0x02000025: from remote pad 0x1000019 of entity 'rkisp1-input-params': Data
  	Pad 0x01000004   : 2: Source
  	  Link 0x02000027: to remote pad 0x100000d of entity 'rkisp1_selfpath': Data
  	  Link 0x02000029: to remote pad 0x1000009 of entity 'rkisp1_mainpath': Data
  	Pad 0x01000005   : 3: Source
  	  Link 0x0200002b: to remote pad 0x1000015 of entity 'rkisp1-statistics': Data

  User Controls

  		       exposure 0x00980911 (int)    : min=4 max=1550 step=1 default=1536 value=1536

  Image Source Controls

  	      vertical_blanking 0x009e0901 (int)    : min=34 max=31247 step=1 default=34 value=34
  	    horizontal_blanking 0x009e0902 (int)    : min=4294967192 max=4294967192 step=1 default=4294967192 value=-104 flags=read-only
  		  analogue_gain 0x009e0903 (int)    : min=128 max=2040 step=1 default=128 value=128

  Image Processing Controls

  		 link_frequency 0x009f0901 (intmenu): min=0 max=0 default=0 value=0 (500000000 0x1dcd6500) flags=read-only
  				0: 500000000 (0x1dcd6500)
  		     pixel_rate 0x009f0902 (int64)  : min=0 max=400000000 step=1 default=400000000 value=400000000 flags=read-only
  		   test_pattern 0x009f0903 (menu)   : min=0 max=4 default=0 value=0 (Disabled)
  				0: Disabled
  				1: Vertical Color Bar Type 1
  				2: Vertical Color Bar Type 2
  				3: Vertical Color Bar Type 3
  				4: Vertical Color Bar Type 4
  ubuntu@nanopi-m4:~/camera$ v4l2-ctl -d /dev/v4l-subdev1 --all
  Media Driver Info:
  	Driver name      : rkisp1
  	Model            : rkisp1
  	Serial           : 
  	Bus info         : 
  	Media version    : 4.19.111
  	Hardware revision: 0x00000000 (0)
  	Driver version   : 4.19.111
  Interface Info:
  	ID               : 0x0300002f
  	Type             : V4L Sub-Device
  Entity Info:
  	ID               : 0x0000001c (28)
  	Name             : rockchip-mipi-dphy-rx
  	Function         : Video Interface Bridge
  	Pad 0x0100001d   : 0: Sink, Must Connect
  	  Link 0x02000021: from remote pad 0x1000020 of entity 'ov4689 1-0036': Data
  	Pad 0x0100001e   : 1: Source, Must Connect
  	  Link 0x02000023: to remote pad 0x1000002 of entity 'rkisp1-isp-subdev': Data

  User Controls

  		       exposure 0x00980911 (int)    : min=4 max=1550 step=1 default=1536 value=1536

  Image Source Controls

  	      vertical_blanking 0x009e0901 (int)    : min=34 max=31247 step=1 default=34 value=34
  	    horizontal_blanking 0x009e0902 (int)    : min=4294967192 max=4294967192 step=1 default=4294967192 value=-104 flags=read-only
  		  analogue_gain 0x009e0903 (int)    : min=128 max=2040 step=1 default=128 value=128

  Image Processing Controls

  		 link_frequency 0x009f0901 (intmenu): min=0 max=0 default=0 value=0 (500000000 0x1dcd6500) flags=read-only
  				0: 500000000 (0x1dcd6500)
  		     pixel_rate 0x009f0902 (int64)  : min=0 max=400000000 step=1 default=400000000 value=400000000 flags=read-only
  		   test_pattern 0x009f0903 (menu)   : min=0 max=4 default=0 value=0 (Disabled)
  				0: Disabled
  				1: Vertical Color Bar Type 1
  				2: Vertical Color Bar Type 2
  				3: Vertical Color Bar Type 3
  				4: Vertical Color Bar Type 4
  ubuntu@nanopi-m4:~/camera$ v4l2-ctl -d /dev/v4l-subdev2 --all
  Media Driver Info:
  	Driver name      : rkisp1
  	Model            : rkisp1
  	Serial           : 
  	Bus info         : 
  	Media version    : 4.19.111
  	Hardware revision: 0x00000000 (0)
  	Driver version   : 4.19.111
  Interface Info:
  	ID               : 0x03000031
  	Type             : V4L Sub-Device
  Entity Info:
  	ID               : 0x0000001f (31)
  	Name             : ov4689 1-0036
  	Function         : Camera Sensor
  	Pad 0x01000020   : 0: Source
  	  Link 0x02000021: to remote pad 0x100001d of entity 'rockchip-mipi-dphy-rx': Data

  User Controls

  		       exposure 0x00980911 (int)    : min=4 max=1550 step=1 default=1536 value=1536

  Image Source Controls

  	      vertical_blanking 0x009e0901 (int)    : min=34 max=31247 step=1 default=34 value=34
  	    horizontal_blanking 0x009e0902 (int)    : min=4294967192 max=4294967192 step=1 default=4294967192 value=-104 flags=read-only
  		  analogue_gain 0x009e0903 (int)    : min=128 max=2040 step=1 default=128 value=128

  Image Processing Controls

  		 link_frequency 0x009f0901 (intmenu): min=0 max=0 default=0 value=0 (500000000 0x1dcd6500) flags=read-only
  				0: 500000000 (0x1dcd6500)
  		     pixel_rate 0x009f0902 (int64)  : min=0 max=400000000 step=1 default=400000000 value=400000000 flags=read-only
  		   test_pattern 0x009f0903 (menu)   : min=0 max=4 default=0 value=0 (Disabled)
  				0: Disabled
  				1: Vertical Color Bar Type 1
  				2: Vertical Color Bar Type 2
  				3: Vertical Color Bar Type 3
  				4: Vertical Color Bar Type 4
  ubuntu@nanopi-m4:~/camera$

    First check:

      ubuntu@nanopi-m4:~$ v4l2-ctl -d /dev/video1 -vwidth=1920,height=1080,pixelformat=NV12 --stream-mmap --stream-skip=3
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fps
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fps
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fps
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fps
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fps
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fps
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fps

    Kernel output:

      [  692.916523] rkisp1: waiting on params stream on event timeout
  [  692.916574] rkisp1 ff910000.rkisp1: can not get first iq setting in stream on
  [  692.917944] rockchip-mipi-dphy-rx ff770000.syscon:mipi-dphy-rx0: stream on:1
  [  700.472033] rockchip-mipi-dphy-rx ff770000.syscon:mipi-dphy-rx0: stream on:0

    Sensor is working. What's next? We need to grab real image from the sensor, but sensor does not show up as a char device, we need a way to link the sensor.

    Here is the topology:

      ubuntu@nanopi-m4:~/camera$ media-ctl -d /dev/media0 -p
  Media controller API version 4.19.111

  Media device information
  ------------------------
  driver          rkisp1
  model           rkisp1
  serial          
  bus info        
  hw revision     0x0
  driver version  4.19.111

  Device topology
  - entity 1: rkisp1-isp-subdev (4 pads, 6 links)
  	    type V4L2 subdev subtype Unknown flags 0
  	    device node name /dev/v4l-subdev0
  	pad0: Sink
  		[fmt:SBGGR10_1X10/2688x1520 field:none
  		 crop.bounds:(0,0)/2688x1520
  		 crop:(0,0)/2688x1520]
  		<- "rkisp1_dmapath":0 []
  		<- "rockchip-mipi-dphy-rx":1 [ENABLED]
  	pad1: Sink
  		<- "rkisp1-input-params":0 [ENABLED]
  	pad2: Source
  		[fmt:YUYV8_2X8/2688x1520 field:none
  		 crop.bounds:(0,0)/2688x1520
  		 crop:(0,0)/2688x1520]
  		-> "rkisp1_selfpath":0 [ENABLED]
  		-> "rkisp1_mainpath":0 [ENABLED]
  	pad3: Source
  		-> "rkisp1-statistics":0 [ENABLED]

  - entity 6: rkisp1_mainpath (1 pad, 1 link)
  	    type Node subtype V4L flags 0
  	    device node name /dev/video0
  	pad0: Sink
  		<- "rkisp1-isp-subdev":2 [ENABLED]

  - entity 10: rkisp1_selfpath (1 pad, 1 link)
  	     type Node subtype V4L flags 0
  	     device node name /dev/video1
  	pad0: Sink
  		<- "rkisp1-isp-subdev":2 [ENABLED]

  - entity 14: rkisp1_dmapath (1 pad, 1 link)
  	     type Node subtype V4L flags 0
  	     device node name /dev/video2
  	pad0: Source
  		-> "rkisp1-isp-subdev":0 []

  - entity 20: rkisp1-statistics (1 pad, 1 link)
  	     type Node subtype V4L flags 0
  	     device node name /dev/video3
  	pad0: Sink
  		<- "rkisp1-isp-subdev":3 [ENABLED]

  - entity 24: rkisp1-input-params (1 pad, 1 link)
  	     type Node subtype V4L flags 0
  	     device node name /dev/video4
  	pad0: Source
  		-> "rkisp1-isp-subdev":1 [ENABLED]

  - entity 28: rockchip-mipi-dphy-rx (2 pads, 2 links)
  	     type V4L2 subdev subtype Unknown flags 0
  	     device node name /dev/v4l-subdev1
  	pad0: Sink
  		[fmt:SBGGR10_1X10/2688x1520@10000/300000 field:none]
  		<- "ov4689 1-0036":0 [ENABLED]
  	pad1: Source
  		[fmt:SBGGR10_1X10/2688x1520@10000/300000 field:none]
  		-> "rkisp1-isp-subdev":0 [ENABLED]

  - entity 31: ov4689 1-0036 (1 pad, 1 link)
  	     type V4L2 subdev subtype Sensor flags 0
  	     device node name /dev/v4l-subdev2
  	pad0: Source
  		[fmt:SBGGR10_1X10/2688x1520@10000/300000 field:none]
  		-> "rockchip-mipi-dphy-rx":0 [ENABLED]

  ubuntu@nanopi-m4:~/camera$

    ov13850 sensor is configured and detected.

      ubuntu@nanopi-m4:~$ v4l2-ctl -d /dev/video6 -vwidth=1920,height=1080,pixelformat=NV12 --stream-mmap --stream-skip=3
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
  <<^C
  ubuntu@nanopi-m4:~$ v4l2-ctl -V -d /dev/video6
  Format Video Capture Multiplanar:
  	Width/Height      : 1920/1080
  	Pixel Format      : 'NV12' (Y/CbCr 4:2:0)
  	Field             : None
  	Number of planes  : 1
  	Flags             : 
  	Colorspace        : Default
  	Transfer Function : Default
  	YCbCr/HSV Encoding: Default
  	Quantization      : Full Range
  	Plane 0           :
  	   Bytes per Line : 1920
  	   Size Image     : 3110400
  ubuntu@nanopi-m4:~$ dmesg|tail
  [   10.379757] [dhd-wlan0] wl_ext_iapsta_event : [S] Link UP with 86:ea:ea:aa:87:8f
  [   10.468710] [dhd-wlan0] wl_notify_connect_status : wl_bss_connect_done succeeded with 86:ea:ea:aa:87:8f 
  [   31.201529] vcc_lcd: disabling
  [   69.606312] ttyFIQ ttyFIQ0: tty_port_close_start: tty->count = 1 port count = 2
  [  174.538452] ttyFIQ ttyFIQ0: tty_port_close_start: tty->count = 1 port count = 3
  [  174.760610] ttyFIQ ttyFIQ0: tty_port_close_start: tty->count = 1 port count = 2
  [  530.785357] rkisp1: waiting on params stream on event timeout
  [  530.785408] rkisp1 ff920000.rkisp1: can not get first iq setting in stream on
  [  530.786813] rockchip-mipi-dphy-rx ff968000.mipi-dphy-tx1rx1: stream on:1
  [  539.035127] rockchip-mipi-dphy-rx ff968000.mipi-dphy-tx1rx1: stream on:0
  ubuntu@nanopi-m4:~$ media-ctl -d /dev/media1 -p
  Media controller API version 4.19.111

  Media device information
  ------------------------
  driver          rkisp1
  model           rkisp1
  serial          
  bus info        
  hw revision     0x0
  driver version  4.19.111

  Device topology
  - entity 1: rkisp1-isp-subdev (4 pads, 6 links)
  	    type V4L2 subdev subtype Unknown flags 0
  	    device node name /dev/v4l-subdev3
  	pad0: Sink
  		[fmt:SBGGR10_1X10/2112x1568 field:none
  		 crop.bounds:(0,0)/2112x1568
  		 crop:(0,0)/2112x1568]
  		<- "rkisp1_dmapath":0 []
  		<- "rockchip-mipi-dphy-rx":1 [ENABLED]
  	pad1: Sink
  		<- "rkisp1-input-params":0 [ENABLED]
  	pad2: Source
  		[fmt:YUYV8_2X8/2112x1568 field:none
  		 crop.bounds:(0,0)/2112x1568
  		 crop:(0,0)/2112x1568]
  		-> "rkisp1_selfpath":0 [ENABLED]
  		-> "rkisp1_mainpath":0 [ENABLED]
  	pad3: Source
  		-> "rkisp1-statistics":0 [ENABLED]

  - entity 6: rkisp1_mainpath (1 pad, 1 link)
  	    type Node subtype V4L flags 0
  	    device node name /dev/video5
  	pad0: Sink
  		<- "rkisp1-isp-subdev":2 [ENABLED]

  - entity 10: rkisp1_selfpath (1 pad, 1 link)
  	     type Node subtype V4L flags 0
  	     device node name /dev/video6
  	pad0: Sink
  		<- "rkisp1-isp-subdev":2 [ENABLED]

  - entity 14: rkisp1_dmapath (1 pad, 1 link)
  	     type Node subtype V4L flags 0
  	     device node name /dev/video7
  	pad0: Source
  		-> "rkisp1-isp-subdev":0 []

  - entity 20: rkisp1-statistics (1 pad, 1 link)
  	     type Node subtype V4L flags 0
  	     device node name /dev/video8
  	pad0: Sink
  		<- "rkisp1-isp-subdev":3 [ENABLED]

  - entity 24: rkisp1-input-params (1 pad, 1 link)
  	     type Node subtype V4L flags 0
  	     device node name /dev/video9
  	pad0: Source
  		-> "rkisp1-isp-subdev":1 [ENABLED]

  - entity 28: rockchip-mipi-dphy-rx (2 pads, 2 links)
  	     type V4L2 subdev subtype Unknown flags 0
  	     device node name /dev/v4l-subdev4
  	pad0: Sink
  		[fmt:SBGGR10_1X10/2112x1568@10000/300000 field:none]
  		<- "ov13850 2-0010":0 [ENABLED]
  	pad1: Source
  		[fmt:SBGGR10_1X10/2112x1568@10000/300000 field:none]
  		-> "rkisp1-isp-subdev":0 [ENABLED]

  - entity 31: ov13850 2-0010 (1 pad, 1 link)
  	     type V4L2 subdev subtype Sensor flags 0
  	     device node name /dev/v4l-subdev5
  	pad0: Source
  		[fmt:SBGGR10_1X10/2112x1568@10000/300000 field:none]
  		-> "rockchip-mipi-dphy-rx":0 [ENABLED]

  ubuntu@nanopi-m4:~$

  • mjpg-streamer Build from source, take a photo with cam and run:

    mjpg_streamer -i "./input_uvc.so -y -r 1920x1080 -d /dev/video1" -o "./output_http.so -w ./www"

MIPI Camera Mainline

There is a porting of the OV13850 driver to the mainline kernel, so I decided to take a look and see if we can pull the raw image from the sensor using mjpg-streamer on NanoPi M4. For one reason, i used Kernel v5.10.0-rc1 to test its work since my kernel v5.10.0, which has some of my hacks just failed to load the ISP.

Now we have our character device as i expected to have it in kernel 4.19:

ubuntu@nanopi-m4:~$ cat /sys/dev/char/81:131/device/name
ov13850

Doing some check to find out about the sensor and rkisp1:

ubuntu@nanopi-m4:~$ /usr/local/bin/media-ctl -d /dev/media0 -p|grep enti
- entity 1: rkisp1_isp (4 pads, 5 links)
- entity 6: rkisp1_resizer_mainpath (2 pads, 2 links)
- entity 9: rkisp1_resizer_selfpath (2 pads, 2 links)
- entity 12: rkisp1_mainpath (1 pad, 1 link)
- entity 16: rkisp1_selfpath (1 pad, 1 link)
- entity 20: rkisp1_stats (1 pad, 1 link)

Configuring the sensor:

/usr/local/bin/media-ctl --device "platform:rkisp1" --reset
# connect pad 0 (sink) of the ISP with pad 0 of the camera and enable the link
/usr/local/bin/media-ctl --device "platform:rkisp1" --links "'ov13850 1-0010':0 -> 'rkisp1_isp':0 [1]"
# create a link between the selfpath (preview) and the ISP output on pad 2 (source), but keep it deactivated
/usr/local/bin/media-ctl --device "platform:rkisp1" --links "'rkisp1_isp':2 -> 'rkisp1_resizer_selfpath':0 [0]"
# create a link between the mainpath and the ISP output on pad 2 (source) and enable the link
/usr/local/bin/media-ctl --device "platform:rkisp1" --links "'rkisp1_isp':2 -> 'rkisp1_resizer_mainpath':0 [1]"

# Set the video format on the camera (this is very dependent on your camera)
/usr/local/bin/media-ctl --device "platform:rkisp1" --set-v4l2 '"ov13850 1-0010":0 [fmt:SBGGR10_1X10/2112x1568]'
# Set the input video format for the ISP, this must match the video format of the camera, crop it down to 1920x1080
/usr/local/bin/media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_isp":0 [fmt:SBGGR10_1X10/2112x1568 crop: (0,0)/1920x1080]'
# Set the output video format of the ISP, the maximum size was propagated from the sink pad, and the format size is taken from the crop format
/usr/local/bin/media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_isp":2 [fmt:YUYV8_2X8/1920x1080 crop: (0,0)/1920x1080]'

# Set the input format for the mainpath resizer
/usr/local/bin/media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_resizer_mainpath":0 [fmt:YUYV8_2X8/1920x1080]'
# Set the output format for the mainpath resizer
/usr/local/bin/media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_resizer_mainpath":1 [fmt:YUYV8_2X8/1280x720]'

# Configure the format at the mainpath DMA-engine, which is the point that is accessed by user-space
/usr/local/bin/v4l2-ctl --media-bus-info "platform:rkisp1" --device "rkisp1_mainpath" --set-fmt-video "width=1280,height=720,pixelformat=422P"

Check if this is working:

ubuntu@nanopi-m4:~$ /usr/local/bin/v4l2-ctl -d /dev/video1 -vwidth=1280,height=720,pixelformat=YUYV --stream-mmap --stream-skip=3
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<^C
ubuntu@nanopi-m4:~$ 
ubuntu@nanopi-m4:~$ /usr/local/bin/v4l2-ctl -d /dev/v4l-subdev3 --all

User Controls

		       exposure 0x00980911 (int)    : min=4 max=1660 step=1 default=1536 value=1536

Image Source Controls

	      vertical_blanking 0x009e0901 (int)    : min=96 max=31199 step=1 default=96 value=96
	    horizontal_blanking 0x009e0902 (int)    : min=2688 max=2688 step=1 default=2688 value=2688 flags=read-only
		  analogue_gain 0x009e0903 (int)    : min=16 max=248 step=1 default=16 value=16

Image Processing Controls

		 link_frequency 0x009f0901 (intmenu): min=0 max=0 default=0 value=0 (300000000 0x11e1a300) flags=read-only
				0: 300000000 (0x11e1a300)
		     pixel_rate 0x009f0902 (int64)  : min=0 max=120000000 step=1 default=120000000 value=120000000 flags=read-only
		   test_pattern 0x009f0903 (menu)   : min=0 max=4 default=0 value=0 (Disabled)
				0: Disabled
				1: Vertical Color Bar Type 1
				2: Vertical Color Bar Type 2
				3: Vertical Color Bar Type 3
				4: Vertical Color Bar Type 4
ubuntu@nanopi-m4:~$ /usr/local/bin/v4l2-ctl -d /dev/v4l-subdev2 --all
Media Driver Info:
	Driver name      : rkisp1
	Model            : rkisp1
	Serial           : 
	Bus info         : platform:rkisp1
	Media version    : 5.10.0
	Hardware revision: 0x00000000 (0)
	Driver version   : 5.10.0
Interface Info:
	ID               : 0x03000030
	Type             : V4L Sub-Device
Entity Info:
	ID               : 0x00000009 (9)
	Name             : rkisp1_resizer_selfpath
	Function         : Video Scaler
	Pad 0x0100000a   : 0: Sink, Must Connect
	  Link 0x02000024: from remote pad 0x1000004 of entity 'rkisp1_isp': Data
	Pad 0x0100000b   : 1: Source, Must Connect
	  Link 0x02000026: to remote pad 0x1000013 of entity 'rkisp1_selfpath': Data, Enabled, Immutable
ubuntu@nanopi-m4:~$ /usr/local/bin/v4l2-ctl -d /dev/v4l-subdev1 --all
Media Driver Info:
	Driver name      : rkisp1
	Model            : rkisp1
	Serial           : 
	Bus info         : platform:rkisp1
	Media version    : 5.10.0
	Hardware revision: 0x00000000 (0)
	Driver version   : 5.10.0
Interface Info:
	ID               : 0x0300002e
	Type             : V4L Sub-Device
Entity Info:
	ID               : 0x00000006 (6)
	Name             : rkisp1_resizer_mainpath
	Function         : Video Scaler
	Pad 0x01000007   : 0: Sink, Must Connect
	  Link 0x02000020: from remote pad 0x1000004 of entity 'rkisp1_isp': Data, Enabled
	Pad 0x01000008   : 1: Source, Must Connect
	  Link 0x02000022: to remote pad 0x100000f of entity 'rkisp1_mainpath': Data, Enabled, Immutable
ubuntu@nanopi-m4:~$ /usr/local/bin/v4l2-ctl -d /dev/v4l-subdev0 --all
Media Driver Info:
	Driver name      : rkisp1
	Model            : rkisp1
	Serial           : 
	Bus info         : platform:rkisp1
	Media version    : 5.10.0
	Hardware revision: 0x00000000 (0)
	Driver version   : 5.10.0
Interface Info:
	ID               : 0x0300002c
	Type             : V4L Sub-Device
Entity Info:
	ID               : 0x00000001 (1)
	Name             : rkisp1_isp
	Function         : Video Pixel Formatter
	Pad 0x01000002   : 0: Sink, Must Connect
	  Link 0x0200001e: from remote pad 0x100001d of entity 'ov13850 1-0010': Data, Enabled
	Pad 0x01000003   : 1: Sink
	  Link 0x02000028: from remote pad 0x1000019 of entity 'rkisp1_params': Data, Enabled, Immutable
	Pad 0x01000004   : 2: Source
	  Link 0x02000020: to remote pad 0x1000007 of entity 'rkisp1_resizer_mainpath': Data, Enabled
	  Link 0x02000024: to remote pad 0x100000a of entity 'rkisp1_resizer_selfpath': Data
	Pad 0x01000005   : 3: Source
	  Link 0x0200002a: to remote pad 0x1000015 of entity 'rkisp1_stats': Data, Enabled, Immutable
ubuntu@nanopi-m4:~$

Testing the performance again:

ubuntu@nanopi-m4:~$ /usr/local/bin/v4l2-ctl --media-bus-info "platform:rkisp1" --device "rkisp1_mainpath" --stream-mmap --stream-count=150
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Media order keeps changing on every boot, here you can find the sensor name and the corresponding /dev/videoX:

ubuntu@nanopi-m4:~$ ls /dev/media*
/dev/media0  /dev/media1  /dev/media2  /dev/media3

Finding the sensor in use:

ubuntu@nanopi-m4:~$ media-ctl -p -d 1 |grep ENABLED |grep -v "rkisp"|grep -o "\".*\""|tr -d \"
ov4689 1-0036

where -d 1 is the media index, searching from media0,media1,...media3

Finding the video device for the sensor:

ubuntu@nanopi-m4:~$ media-ctl -e "rkisp1_mainpath" -d 1
/dev/video2

Build mjpg-streamer from source and run:

mjpg_streamer -i "./input_uvc.so -y -r 1280x720 -d /dev/video1" -o "./output_http.so -w ./www"
MJPG Streamer Version: git rev: 58e952383cbe973641a3ce6c6a738bafc1605337
 i: Using V4L2 device.: /dev/video1
 i: Desired Resolution: 1280 x 720
 i: Frames Per Second.: -1
 i: Format............: YUYV
 i: JPEG Quality......: 80
 i: TV-Norm...........: DEFAULT
Using mplane plugin for capture 
UVCIOC_CTRL_ADD - Error at Pan (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Tilt (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Pan Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Pan/tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Focus (absolute): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Pan (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Tilt (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Pan Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Pan/tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Focus (absolute): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at LED1 Mode: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at LED1 Frequency: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Disable video processing: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Raw bits per pixel: Inappropriate ioctl for device (25)
 o: www-folder-path......: ./www/
 o: HTTP TCP port........: 8080
 o: HTTP Listen Address..: (null)
 o: username:password....: disabled
 o: commands.............: enabled

As we can see by the errors, we still need a way to use ISP while grabbing the frames, they are dark and greenish:

mjpg-streamer pulling raw images - 1280x720 ~29 FPS (80% quality) streaming

Monitoring mjpg-streamer in action mjpg-streamer

Mainline 5.11.0-rc2

With the help of Sebastian (the author), it was possible to make use of ISP. Grabbing images still greenish but far better quality than pulling raw images directly from the sensor. Unfortunately Mjpg-streamer dropped from 29 FPS to 15 FPS and CPU usage seems a bit higher.

mjpg-streamer 1280x720 ~15 FPS (80% quality) streaming 15 FPS

Monitoring traffic and CPU usage mjpg-streamer isp

Streaming 1920x1080 with Mainline

Experimenting with OV13850 in low light condition with window size 1920x1080 10 FPS.

/usr/local/bin/media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_resizer_mainpath":1 [fmt:YUYV8_2X8/1920x1080]'
/usr/local/bin/v4l2-ctl --media-bus-info "platform:rkisp1" --device "rkisp1_mainpath" --set-fmt-video "width=1920,height=1080,pixelformat=YUYV"

Mjpg-streamer command line:

mjpg_streamer -i "./input_uvc.so -y -r 1920x1080 -d /dev/video1" -o "./output_http.so -w ./www"

Mjpg-streamer 1920x1080 OV13850 mjpg-streamer isp 1920x1080

Mjpg-streamer 1920x1080 OV4689 (IR cut - Indirect light) mjpg-streamer isp 1920x1080

Streaming video with Mjpg-streamer 2688x1520 gives 5 FPS over Gbit ethernet.

mjpg_streamer -i "./input_uvc.so -y -r 2688x1520 -d /dev/video2" -o "./output_http.so -w ./www"
MJPG Streamer Version: git rev: 58e952383cbe973641a3ce6c6a738bafc1605337
 i: Using V4L2 device.: /dev/video2
 i: Desired Resolution: 2688 x 1520
 i: Frames Per Second.: -1
 i: Format............: YUYV
 i: JPEG Quality......: 80
 i: TV-Norm...........: DEFAULT
Using mplane plugin for capture 
UVCIOC_CTRL_ADD - Error at Pan (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Tilt (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Pan Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Pan/tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Focus (absolute): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Pan (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Tilt (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Pan Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Pan/tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Focus (absolute): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at LED1 Mode: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at LED1 Frequency: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Disable video processing: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Raw bits per pixel: Inappropriate ioctl for device (25)
 o: www-folder-path......: ./www/
 o: HTTP TCP port........: 8080
 o: HTTP Listen Address..: (null)
 o: username:password....: disabled

mjpg-streamer isp 2688x1520

MIPI Dual Camera

Initial support for dual-camera has been done in Kernel 4.19.111 and the Kernel is made available here: https://github.com/avafinger/kernel-rockchip-dual-camera

You can attach two cameras (OV13850 or OV4689) to the NanoPi M4 and stream video.

MIPI Dual Camera Mainline

Initial support for dual-camera has been introduced in Kernel 5.11.0 with pre-built camera application

The setup must follow one of this:

  • Single OV13850 installed in CSI-1
  • Single OV4689 installed in CSI-1
  • Dual camera OV13850 installed in CSI-1 and CSI-2
  • Dual Camera OV4689 installed in CSI-1 and CSI-2

Limitations:

The camera sensor tested with ov4689 is the camera w/o IR cut filter

Pulling video from the cameras

  • Camera 1 (CSI-1)

     cam --camera=1 --capture=100 --file=cam1-frames-100_1920x1080.nv21 -s height=1080,width=1920,pixelformat=NV21

  • Camera 2 (CSI-2)

     cam --camera=2 --capture=100 --file=cam2-frames-100_1920x1080.nv21 -s height=1080,width=1920,pixelformat=NV21

  • Converting NV21 to MP4 using ffmpeg in you PC

    ffmpeg -f rawvideo -vcodec rawvideo -s 1920x1080 -r 30 -pix_fmt nv21 -i cam1-frames-100_1920x1080.nv21 -c:v libx264 -preset ultrafast -qp 0 -y -hide_banner test-cam1.mp4
ffmpeg -f rawvideo -vcodec rawvideo -s 1920x1080 -r 30 -pix_fmt nv21 -i cam2-frames-100_1920x1080.nv21 -c:v libx264 -preset ultrafast -qp 0 -y -hide_banner test-cam2.mp4

8GB SD CARD Image https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/1.42

Mainline Porting

You can get further info about the porting:

Driver:

https://sebastianfricke.me/porting-the-ov13850-camera/

Obs: Porting OV4689 is very similar to the OV13850.

rkisp1 (Helen Koike):

https://www.collabora.com/news-and-blog/news-and-events/kernel-5.10-rockchip-h264-bifrost-more.html

MIPI Camera Experiments

Here we can compare some photos taken with FE Kernel 4.4.179, Kernel 4.19.111 and mainline 5.11.0-rc2 (OV13850). I have the impression that in BSP, the image is taken at a higher resolution and then resized to fit 1920x1080 (16:9). It looks a little distorted. You can draw your conclusions.

1 - Photo in 1920x1080 size This is the image taken with cam application from FE 4.4.179. Real Image 1920x1080

2 - Screenshot mjpg-streamer with FE 4.4.179 This is a screenshot of mjpg-streamer while streaming video in 1920x1080 taken from FE 4.4.179. mjpg-streamer FE 1920x1080

3 - Screenshot YU12 1920x1080 with KFE Kernel 4.19.111 This is a screenshot of YU12 1920x1080 grabed image with Kernel 4.19.11, better focus but no Gain / Exposure controls. YU12 1920x1080

4 - Screenshot mjpg-streamer with Mainline 5.11.0-rc2 This is a screenshot of mjpg-streamer while streaming video in 1920x1080 taken from the mainline kernel 5.11.0-rc2. mjpg-streamer 1920x1080

OV4689 w/o IR cut filter with mainline kernel 5.11.0-rc6

  • Config sensor to be used by v4l2 pplications

      media-ctl --device "platform:rkisp1" --reset
  # connect pad 0 (sink) of the ISP with pad 0 of the camera and enable the link
  media-ctl --device "platform:rkisp1" --links "'ov4689 1-0036':0 -> 'rkisp1_isp':0 [1]"
  # create a link between the selfpath (preview) and the ISP output on pad 2 (source), but keep it deactivated
  media-ctl --device "platform:rkisp1" --links "'rkisp1_isp':2 -> 'rkisp1_resizer_selfpath':0 [0]"
  # create a link between the mainpath and the ISP output on pad 2 (source) and enable the link
  media-ctl --device "platform:rkisp1" --links "'rkisp1_isp':2 -> 'rkisp1_resizer_mainpath':0 [1]"

  # Set the video format on the camera (this is very dependent on your camera)
  media-ctl --device "platform:rkisp1" --set-v4l2 '"ov4689 1-0036":0 [fmt:SBGGR10_1X10/2688x1520]'
  # Set the input video format for the ISP, this must match the video format of the camera, crop it down to 1920x1080
  media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_isp":0 [fmt:SBGGR10_1X10/2688x1520 crop: (0,0)/1920x1080]'
  # Set the output video format of the ISP, the maximum size was propagated from the sink pad, and the format size is taken from the crop format
  media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_isp":2 [fmt:YUYV8_2X8/1920x1080 crop: (0,0)/1920x1080]'

  # Set the input format for the mainpath resizer
  media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_resizer_mainpath":0 [fmt:YUYV8_2X8/1920x1080]'
  # Set the output format for the mainpath resizer
  media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_resizer_mainpath":1 [fmt:YUYV8_2X8/1920x1080]'

  # Configure the format at the mainpath DMA-engine, which is the point that is accessed by user-space
  v4l2-ctl --media-bus-info "platform:rkisp1" --device "rkisp1_mainpath" --set-fmt-video "width=1920,height=1080,pixelformat=YU12"

This will configure the sensor OV4689 but grabbed images will appear green and dark, so we need a trick to bypass this limitation, run the cam application to grab a few images and adjust exposure automatically for our v4l2 application and then repeat the previous config.

cam --camera=1 --capture=15 --file=/dev/null -s height=1520,width=2688,pixelformat=NV21

Now we can run mjpg streamer and stream video to our web clients. Build the latest mjpg streamer from source, install and run like:

mjpg_streamer -i "input_uvc.so -y -r 1920x1080 -d /dev/video1" -o "output_http.so -w /usr/local/share/mjpg-streamer/www"

ov4689 1920x1080

Credits

  • FriendlyElec (for the sample)
  • Amanda Finger (Expertise on Kodi and help building)
  • Armbian (knowledge base)

nanopi-m4-ubuntu-base-minimal's People

Contributors

avafinger avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar avatar

Forkers

andyshrk wingtangwong mrtiptop jujinwu mrhaoxx jshsakura martinatcoventry cmst0us light1707 lyvivian0077

nanopi-m4-ubuntu-base-minimal's Issues

Re-create uboot images

Hi @avafinger,

I've noticed you have released uboot and trust images along with v1.8 eMMC version. I know that booting from eMMC requires a different command line in uboot env. So I'm wondering if you possibly have helpful scripts for cooking uboot from scratch for RK3399, that can be shared?

Many thanks!

Kodi on 5.7.x

Hi, just a question.
IN the README I see that kodi on the 5.7.x compiles and works, but with limited decoding capabilities.

Can you elaborate more on that? I'd like to understand what it means and what it would be needed to make it work properly as the 4.4 kernel version, or event if it is would be possible in the near future.

Sorry for the "silly" question but I really like to grasp things

Camera Parameters for ov4689

Hey, I have had good success working with the ov4689 but I am bashing my head against the wall right now trying to figure out the best path for controlling the camera parameters.

It seems that in the driver there are only controls for some of the basics (ie, exposure and analog gain). Currently it looks like the best route is going to be expanding the driver to extend the functionality. For example with v4l2-ctl setting the exposure doesn't work correctly because auto exposure is always enabled.

Short of modifying the driver is there anything you found for controlling this cameras parameters? Any help or direction would be great.

"green" images from cameras in 5.10/5.11

Not a issue - just for information ;)

By my understanding, color correction of this "green" images implemented in RkISP shared library (https://github.com/rockchip-linux/camera_engine_rkisp), based on information about sensor from IQ files (also in repo, in iqfiles directory) - and therefore not exist at kernel V4L2 driver(and mjpg_streamer). This repo also contain rkisp gStreamer driver (which used in FriendlyElec example scripts) and C API (with example apps/rkisp_demo) - so MJPEG streamer can be updated to use RkISPlib/IQ files too.

SD card images

Ca you please make/link SD card images for those of us who don't have Linux installed.

No built-in rt5651-sound audio card

I've built mainline 5.9 kernel and have only hdmi audio

# aplay -l
**** List of PLAYBACK Hardware Devices ****
card 0: hdmisound [hdmi-sound], device 0: ff8a0000.i2s-i2s-hifi i2s-hifi-0 [ff8a0000.i2s-i2s-hifi i2s-hifi-0]
  Subdevices: 0/1
  Subdevice #0: subdevice #0

then compared dts (from dtb inside image) and found some related pieces in your version:

rt5651-sound {
  status = "okay";
  compatible = "simple-audio-card";
  simple-audio-card,name = "realtek,rt5651-codec";
  simple-audio-card,format = "i2s";
  simple-audio-card,mclk-fs = <0x100>;
  simple-audio-card,widgets = "Microphone\0Mic Jack\0Headphone\0Headphone Jack";
  simple-audio-card,routing = "Mic Jack\0micbias1\0IN1P\0Mic Jack\0Headphone Jack\0HPOL\0Headphone Jack\0HPOR";

  simple-audio-card,cpu {
    sound-dai = <0xc4>;
  };

  simple-audio-card,codec {
    sound-dai = <0xc5>;
  };
};
...
rt5651@1a {
  #sound-dai-cells = <0x00>;
  compatible = "realtek,rt5651";
  reg = <0x1a>;
  clocks = <0x08 0x59>;
  clock-names = "mclk";
  pinctrl-names = "default";
  pinctrl-0 = <0x3c>;
  status = "okay";
  phandle = <0xc5>;
};
...

I'm not really into kernel development and think I could miss something.. right now rt5651 is included only in rk3399-sapphire-excavator of mainline kernel

Could you push your dts patch for nanopi-m4?

No need to package a idbloader for eMMC

@flash_kodi_emmc.sh

...
pt_warn "Writting u-boot $out ..."
sudo dd if=./idbloader.img of=${out} seek=64 conv=notrunc
sync
sudo dd if=./trust.img of=${out} seek=24576 conv=notrunc
sync
sudo dd if=./uboot.img of=${out} seek=16384 conv=notrunc
sync
...

Kernel config in /proc/ or /boot/

Just to be sure while compiling mainline kernel and not to rely on defconfig,
please, leave a config inside a rom under /boot
or better, leave it under /proc/config.gz using CONFIG_IKCONFIG_PROC=y

Nanopi M4 RK3399 eMCC native image

Hi,

I have a MicroSD to eMCC adapter and would like to burn ubuntu/kodi image directly to eMCC using etcher. Would it be possible to get the burn ready eMCC image?

Thanks in advance!

Any xhci speed limits on NanoPI?

What seem strange is a USB 3.0 camera won't work on its full FPS, as it does on the desktop, even with the newest EOAN kernel. I have to admit, 5.4 kernel so far shows the best FPS rate of all options, which is a pretty nice job!

FriendlyArm's 4.4 had ugly bugs on xhci, making USB 3.0 mostly not working at all. This was fixed only very recently.

Still, 5.4 kernel is yet far beyond the expected frame rate of desktop. I see CPU load is only about 30%. USB3 device is shown 5000M SuperSpeed, which is correct. The FPS rate seems to get down, if sdcard is intensively in use. Do you know of any measures to improve the xhci performance?

Nanopi M4 emmc not booting

I have followed the instructions, and my SBC is not booting. The green light turns on for a few seconds before shutting off. My monitor displays a black screen instead of the "no signal" messag,e

Kernel Configuration file release

Hello, it would be really appreciated to have you release the kernel configuration file along with each release, so everyone can do its own modifications to the kernel without asking to you.

Kernel Panic (probably) when trying to recompile kernel 4.4

I was trying to recompile the kernel to add my own modules. I followed your readme steps for kernel 5 and used the defconfig you passed to me.
What I obtain is (I think( a kernel panic on boot but I cannot confirm as I cannot see anythinh on the console so probably it hangs immediately.

These are the steps I did. Maybe I missed something? There are more steps you do when producing your releases? Could you write the steps you do?

Thanks!

//*************************************//
The steps are adapted for my will to recompile for 4.4

  • login into NanoPi M4

  • create directory

mkdir -p linux
cd linux  

wget https://cdn.kernel.org/pub/linux/kernel/v4.x/linux-4.4.176.tar.xz
tar -xvpzf linux-4.4.176.tar.xz
cd linux-linux-4.4.176

export KV=$(strings ./arch/arm64/boot/Image |grep "Linux version"|awk '{print $3}')
sudo cp -fv ./arch/arm64/boot/Image /boot/Image_${KV}
sync
sudo cp -vfr ./output/* /
sync
  • Make it current kernel
cd /boot
sudo ln -sf Image_${KV} Image
cd ${KVD}
sync
  • Reboot
sudo shutdown -h now (remove power for 30 secs)
**Boot** with your new kernel
  • HANGS!!! :(

ISP1 Pipeline error

When testing out the camera I get some errors in kernel log. I am working with 5.11

I have an ov4689 connected to CSI1

media-ctl --device /dev/media2 --reset
media-ctl --device /dev/media2 --links "'ov4689 2-0036':0 -> 'rkisp1_isp':0 [1]"
media-ctl --device /dev/media2 --links "'rkisp1_isp':2 -> 'rkisp1_resizer_selfpath':0 [0]"
media-ctl --device /dev/media2 --links "'rkisp1_isp':2 -> 'rkisp1_resizer_mainpath':0 [1]"
media-ctl --device /dev/media2 --set-v4l2 '"ov4689 2-0036":0 [fmt:SBGGR10_1X10/2112x1568]'
media-ctl --device /dev/media2 --set-v4l2 '"rkisp1_isp":0 [fmt:SBGGR10_1X10/2112x1568 crop: (0,0)/1920x1080]'
media-ctl --device /dev/media2 --set-v4l2 '"rkisp1_isp":2 [fmt:YUYV8_2X8/1920x1080 crop: (0,0)/1920x1080]'
media-ctl --device /dev/media2 --set-v4l2 '"rkisp1_resizer_mainpath":0 [fmt:YUYV8_2X8/1920x1080]'
media-ctl --device /dev/media2 --set-v4l2 '"rkisp1_resizer_mainpath":1 [fmt:YUYV8_2X8/1280x720]'

and the error I see is

[ 5500.322202] rkisp1 ff920000.isp1: start pipeline failed -32
[ 5509.280513] rkisp1 ff920000.isp1: start pipeline failed -67

Problems with EOAN release (v1.27)

Hi, I've been trying the EOAN release. As it does not boot for some reason, I tried to use EOAN linux-image-5.4.1_1.0-28.deb with the previous KODI release, but got the following:

ERROR: Could not update kernel! Try to fix it manually before reboot.
dpkg: error processing package linux-image-5.4.1 (--install):
 installed linux-image-5.4.1 package post-installation script subprocess returned error exit status 1
Errors were encountered while processing:
 linux-image-5.4.1

Noticed that the postinstall script checks for /lib/modules/, however, the package installs them to /usr/lib/modules.

EDIT: I have edited this first message to put it more along the lines of the discussion below.

dm-crypt issues, can we get it as a module

Hi,
when I try to mount a luks volume, I am getting this error:

device-mapper: table: 253:0: crypt: unknown target type
device-mapper: reload ioctl on   failed: Invalid argument

According to my researches, this bug can be resolved by providing dm-crypt as a kernel module instead of built-in.
Could you update the build to reflect that?
That would be pretty dope :)
Thanks

Kodi Add-ons installed using apt are not recognized

I installed the 1.24 release (Kodi 19 ALPHA1 NanoPi M4 RK3399), and while Kodi works without issue for the built-in add-ons, I can't get the apt installed add-ons to work -- Kodi doesn't recognize they've been installed. All the pvr add-ons suffer from this problem (pvr.hts for example).
I assume this is because of the custom build of Kodi, but in reading the Kodi build instructions, they don't talk about this issue. Do I need to build the add-on myself, or do you know of any way (changing configs, etc.) to have Kodi recognize the apt-installed add-ons?

No 5.1 output on HDMI, with release 1.24

hello,
I tried your release 1.24 and I did not get 5.1 sound with kodi over HDMI. In fact, my AV amplifier is always receiving a stereo pcm signal. I tried to read the video with passthrough, and it does not work too. I read all day long how to configure kodi, pulseaudio, ... but it's a chess.
It is not a problem from my AV : I can perfectly read a video with VLC on my laptop (with the same hdmi cable), either using passthrough or configuring my sound output to be HDMI 5.1. In both cases, I really have 5.1 sound out of my speakers.

In conclusion, I would like to know if you have the same behavior, so if it is normal. Or if I have something badly installed, configured, ... And in this case, have you got an idea about what could be wrong.

Thanks

Kernel modifications (TUN)

Hello, I really appreciate your effort, and I just flashed the v1.4 on my nanopi m4. Installs and run like a charm, but I have a question: could it be possible to modify/recompile the kernel so I can add the TUN module or other modules in the future? I'd really like to use it as an openvpn gateway in my house.
Thanks

Wireguard

Hello, thanks again for the big work you're doing.
I'm currently testing the 5.7.9 release with kodi (building it right now) starting from the raw image provided. So far all good.

I know that since kernel 5.6 the wireguard protocol has been included directly in the kernel, but I'm unable to understand how to make it usable on the 5.7.9 kernel provided.

From what I read, I saw that it should be sufficient to apt install wireguard, but it's not the case as it tries to install linux firmware kernel and other things of version 5.3 for raspberry, and obviously I don't want to as it will break the current image

Have you got some clue on how to make wireguard usable?

Kodi Rebuild procedure

Hello, I tried to follow the quick guide o how to rebuild kodi, but each time I try following the guide I always get stuck with an invalid executable causing a stack trace when executed.
For sure I'm missing some steps.

Would it be possible for you to update the readme with a detailed step-by-step on how to build kodi starting from a scratch flashed image of base nanopi m4 ubuntu base minimal?

Thanks!

Nice work

Hi! I have been testing m4 on mainline woth armbian. I never achieved vpu acceleration while hantro modele It's confirmed to be there. How I need to compile ffmpeg to get hantro to run at least h264 format?? What other formats it can decode?? Thanks on advance.

Unstable boot times due to u-boot ext4 read speed deviations

FWIW, I would like to leave this tip here for any good use.

I've noticed U-Boot's speed of reading img files from boot partition can differ dramatically. If the files are fragmented on the partition in terms of ext4 (for example, if you have overwritten partition files multiple times), reading speed may degrade to really concerning figures of several KiB/s. Apparently, this is a known issue, which may or may not be fixed on the mainline. An interesting, yet controversial fix is to switch boot/ partition to FAT32. It's up to you, but it seems fixing ext4 read speed on U-Boot seems to be a lot harder.

Provide sources/patches/scripts?

Hi,
I have succesfully used you images on my brand new NanoPi M4.
I have even used just the u-boot parts to start up Archlinux ARM on this board, and everything seems as it should be (meaning: no wifi but everything else seems in working order).

I would love to know how you made the u-boot_v2 files. I have tried to create these but I have no idea which files from the u-boot repository to choose. It would be great if you could provide the exact steps you performed to create your binaries.
If you patch the linux kernel in any way, or use a specific build configuration, could you provide it as well? I'd like to make sure I don't miss anything and can reproduce your great work for my Archlinux setup.

Thanks a bunch for this great work! I hope I can contribute something back some day.

No web interface in kodi

I can not find the web interface in kodi. I don't know if you hide it. Could you restore it, so that I can control Jodi using my phone

is it possible to have a version of release 1.41 taht boots on emmc ?

Hello,
first of all thanks for your great work. I used to work with a former release but now I would like to test with the most recent kernel. Unfortunately, the image you provide does not work as is if put on an emmc card. I tried to modify boot.src but it changes nothing : the m4is freezing, without launching the kernel.
So, do you know what I have to tune so that I can boot on emmc, or, can you provide an image that could be used directly on emmc ?
Thanks

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.