Starter Documentation

Getting started with AI Vision Solution Kit

Documentation

If you need detailed information on the kit’s contents, or how to setup the hardware, please refer to Dev Kit Documentation. Please note, that the daA4200-30mci-JNANO-NVDK Developer Kit and the daA4200-30mci-JNANO-NVDK-AIA AI Solution Kit are two different products, so the installed software packages and their version numbers, as described in the "Debian Packages" section, may differ.

daA4200-30mci-JNANO-NVDK-AIA

Step 1 - Initial Configuration:

Step 2 - Network Connection:

  • Plug in an ethernet cable to connect the AI Vision Solution Kit with the Internet.

  • Open a terminal (ctrl + alt + t).

  • Enter ip address list dev eth0 |grep -w inet to find out the network address of the kit.

ifconfig_inet_grep_ip

  • Remember this address as you will need it later to connect via ssh and to open the Web GUI. We will refer to it as the Nano IP.

You can now unplug the monitor connection to the kit, as it is now finally ready to be accessed from your workstation computer.

Step 3 - Setup the AI Vision Solution Kit Software:

  • Create an AWS account if you don't have one. One can create an AWS account for free. The new user has access to AWS free tier service for the first 12 months. For more information, please visit AWS Free Tier

  • Then sign-in to the AWS console AWS Sign-in.

  • Visit our Solution Kit update area to check for a new package file. Download it to your workstation computer.

  • Open a terminal session on your workstation computer and change the terminal's current folder to the download location.

  • Enter scp basler-ai-vision-solution-kit_([major].[minor])_arm64.deb ([username]@[Nano IP]):/tmp/ to transfer the downloaded Solution Kit package file to the Solution Kit.

  • Enter ssh -t ([username]@[Nano IP]) sudo dpkg -i /tmp/basler-ai-vision-solution-kit_([major].[minor])_arm64.deb to install the updated Solution Kit package file.

  • Enter ssh -t ([username]@[Nano IP]) ai-vision-solution-kit to initially download the necessary docker containers (about 500MB), prepare the environment and to start the AI Vision Solution Kit software.

  • The execution of the ai-vision-solution-kit script is interactive and will take some time depending mainly on your internet connection.

  • Note that you must allow sudo access so the configuration can be done. The script will ask you for credentials, if needed.

  • In the process you need to enter your AWS Access Key Id and the AWS Secret Access Key to use the cloud connector. They will be stored locally on the Nano for later use.

  • Note: If you do not want to do this in the part of the process, you can enter random data and use ssh -t ([username]@[Nano IP]) ai-vision-solution-kit store_credentials [AWS Access Key Id] [AWS Secret Access Key] later on to setup the correct AWS credentials. These will be needed to enable the connection to AWS (see step 7 for more details).

  • How to create a new account - Create and deactivate an AWS account.

Step 4 - Get a Live Image:

  • Start a web browser on your workstation computer and run the WebGUI using the Nano IP. Checkout Step 2 if you don't know how to find out the Nano IP address.

  • Wait, until you can press the Play button.

ai_web_page_start

Step 5 - Camera Configuration:

  • With the help of the parameters in the WebGUI, the camera can be configured.
  • To configure the camera please move the sliders.
  • Note: please lower the resolution to get a better frame rate.

camera_parameters

Step 6 - AI Models:

  • Pre-trained and optimized models for People Detection, Office Item Detection and Mask Detection are available in the WebGUI for deployment.
  • Choose one of these inference-models and hit the apply button to run it.
  • To see a result image switch switch from “Live Image” to “Result Image” by using the controls you see when moving the mouse pointer inside the image.
  • Note that the initial download and build of a model will take some minutes. As the result will be cached future use is much faster (about 35s). WebGUI_pretrained_models

Step 7 - AWS Connection:

With the Solution Kit, you have the option to send the resulting meta data from your inference-models to the AWS IoT Core. Please refer to this AWS documentation to learn how to get started with the AWS IoT Core.

  • First make sure that your AWS credentials are entered correctly as described in step 3.
  • Access the WebGUI and switch the send results to AWS switch to ON. If the switch is grayed out and not working check if the credentials are entered correctly. slider_grayed_out
  • Restart the ai-kit by entering ai-vision-solution-kit restart in the terminal on the Jetson Nano.
  • Reload the WebGUI, load a model as described in step 6.
  • Access your AWS-Console, select the IoT-Core service and go to Test. Make sure you have the permissions to access IoT services.
  • Subscribe to aikit/Results. You should now see the results, sent to AWS. aws_test

From here on you might want to do one of the following:

Files
Title Description Format
ai_web_page_startv2.png png
Info

Project State

Public Project

Licences

Software Licence: Project has no software
Hardware Licence: Project has no hardware

Project Tags

Admins

emeusel
Nina_Boehm
MeyerMel
TimM
jstoltz
kilian-hohm
TomE
abd

Members

Does this project pique your interest?

Login or register to join or follow this project.

Comments
Back to top

Your comments, please!

Want to comment this ... Show more