I think you might have problems with the linux on both the TX1 and TX2 with the real time requirements. They can both do the processing in their GPUs (probably fast enough) but you will need fast reaction times to move the hardware. 5ms is really tight. Two possibilities either real time linux on the TX1 or move to an FPGA based system (but not GigE).
You might also have trouble with the intrinsic latency of the camera. You should test this beforehand and see if it fits the requirements of your set up.
2017-04-14 09:28:03 UTC WeepingAngel - 44 points
Image aquisition at the rate of 30 fps per second that provides stabilisation can be provided using the eSOMTK1 using the ACC-TK1-CUMI1820C
AM provided by e-con systems. In case of 5 ms a test should be made with the same.
Refer the following for further details :
2017-07-24 10:53:35 UTC erics - 21 points