Fix calibration offset in object instance segment

• Fix calibration offset being lost after a second synchronization
• Fix calibration offset being lost due to hitting the joint limits of the robot model

With @daab

added bug label

assigned to @kartmann

approved this merge request

merged

mentioned in commit 27663b4a