No. Rekord Buddy needs the information it gathers from syncing in order to keep things properly in sync. This is why the initial sync takes so long to perform.
Disabling any part of the syncing would mean starting from scratch again the next time you sync.
Any syncs after the initial init should be much faster. Contact support if for some reason that’s not the case for you.