How should Junglers play around their Roamers?

So, I was playing in a 5man as a jungler in Legend 1. I was picking either Bane or Sun cause I enjoy the late game oriented junglers more. My general goal was the usual stuff like farming, ganking gold lane, objectives, stealing buffs and so on. The problem, however, according to our tank, Hylos, was that I wasn't helping them in team fights enough. For example, if all of them were clashing in gold (3v4), instead of helping them, I would push mid or steal the buff on the opposite side. I was getting blamed progressively more and eventually got called a slur and threatened. We won and that guy immediately kicked me while saying some rude things.

My question is, how to Jungle around my roamer? I am relatively new (playing since June) and gravitate towards late game heroes.

TL:DR Tank scolded me (jungle) for not following him. How to jungle better?