I will add just one thing to this very valuable thread. To verify if GPS is used by chrony you can run
chronyc sources -v
refclock SHM 0 offset 0.5 delay 0.2 refid GPS
sudo systemctl restart chrony