Why just roll (which would be the ailerons?)and not pitch (stabilisers?) or yaw (rudder?)
Pitch will always change with speed variation. Go faster, tail makes more (negative) lift, and you'll need nose down trim. Go slower and the reverse happens.
In piston engined aircraft, much the same thing happens. The vertical tail is mounted at very slight angle, largely to account for the slightly crosswise air flow that's caused by the propellor. So, at different speeds, and power settings, you'll need different rudder inputs. Jet aircraft don't have this effect, and additionally they are invariably fitted with yaw dampers, which tend to remove any small effects in yaw. If you have an engine out, you'll be back to trimming the rudder for each and every power setting and speed.
On a straight, and properly rigged aircraft, roll inputs should normally be in balance. A change in roll with speed tells you that the wings are slightly 'different'. That could be caused by the flight controls not settling into exactly the same positions, or the whole aircraft could be very slightly twisted. Even slight variations will become evident.
Airbus masks all of this behind the FBW, but it becomes very evident if you have a law change that removes the autopilot. Then the ailerons will remove any trimming input they've been providing, and go to a faired position. The one time I saw this in the aircraft, almost a quarter of aileron input was required to hold wings level. The lack of trim means that you cannot trim out this loading, and have to keep the input applied for the remainder of the flight. A way around this exists to a degree, as the secondary effect of rudder is roll, so by using the rudder trim you can balance a moderate roll input, but at the expense of flying slightly sideways. It's dumb that provision for roll trim isn't provided.