Should i worry? I got a dwi a few years ago in Vermont.?

I got a dwi in Vermont and it hasn't affected my driving privleges in Jersey. I'm supposed to go take a crash course in Vermont in order to get my driving priveleges reinstated up there. But the truth is, i don't ever go up there anymore. But i'm worried that it will eventually affect my license in Jersey.